Appearance
Explore LLM, image and video benchmark results for Olares One, with hardware specifications and the software settings used in each test.
| Model | Benchmark | Configuration | Olares One |
|---|---|---|---|
| Qwen3.8-27B | IFBench Evaluation time | llama.cpp, NVFP4 LOW | 8.7 h |
| Qwen3.8-Flash-Next | IFBench Evaluation time | Strata, IQ2_XS | 7.7 h |
| Qwen3.8-27B | GPQA Diamond Evaluation time | llama.cpp, NVFP4 LOW | 11.5 h |
| Qwen3.8-27B | Inference speed Token generation, single request | llama.cpp, NVFP4 LOW | 93 tok/s |
| Qwen3.8-Flash-Next | Inference speed Token generation, single request | Strata, Q2_0 | 166 tok/s |
| Qwen-Image-2.1 Base | Text to image Per image | ComfyUI, Nunchaku FP4 | 12 s |
| Qwen-Image-2.1 Base | Image edit Per image | ComfyUI, Nunchaku FP4 | 17 s |
| Qwen-Image-2.1 Turbo | Image edit Per image | ComfyUI, Nunchaku FP4 | 5.2 s |
| MiniMax H3 FastH3 v2 | Text to video Sampling time 720p, 5 s | ComfyUI, nvfp4 | 78 s |
llama.cpp, NVFP4 LOW
--mmproj mmproj-F16.gguf -c 104448 -ngl all -fa on -ctk q8_0 -ctv q8_0 --jinja -np 1 --spec-type draft-mtp --spec-draft-n-max 4llama.cpp, UD-Q4_K_XL
--mmproj mmproj-F16.gguf -c 104448 -ngl all -fa on -ctk q8_0 -ctv q8_0 --jinja -np 1 --spec-type draft-mtp --spec-draft-n-max 5llama.cpp, NVFP4 LOW
-c 104448 -ngl all -fa on -ctk q8_0 -ctv q8_0 --jinja -np 2 -kvu --mmproj mmproj-F16.gguf --spec-type draft-mtp --spec-draft-n-max 4llama.cpp, NVFP4 LOW
--mmproj mmproj-F16.gguf -c 104448 -ngl all -fa on -ctk q8_0 -ctv q8_0 --jinja -np 4 -kvu --spec-type draft-mtp --spec-draft-n-max 4llama.cpp, UD-Q4_K_XL
--mmproj mmproj-F16.gguf -c 104448 -ngl all -fa on -ctk q8_0 -ctv q8_0 --jinja -np 4 -kvu --spec-type draft-mtp --spec-draft-n-max 2Strata, IQ2_XS
--pack iq2_xs --native Qwen3.8-Flash-Next-GSQ-RCO-IQ2_XS-00001-of-00002.gguf --ple-gguf Qwen3.8-Flash-Next-GSQ-RCO-IQ2_XS-00002-of-00002.gguf --expert-profile expert-profile.bin --expert-cache auto --prefill auto --spec 4 --spec-min-p 0.5 --mtp rt --max-context 131072 --kv int8 --ple-io ram --pool-workers 15 --vram-reserve-mib 1024 --adapt-every 100000Strata, IQ3_XXS
--pack iq3_xxs --native Qwen3.8-Flash-Next-GSQ-RCO-IQ3_XXS-00001-of-00002.gguf --ple-gguf Qwen3.8-Flash-Next-GSQ-RCO-IQ3_XXS-00002-of-00002.gguf --expert-profile expert-profile.bin --expert-cache auto --prefill auto --spec 4 --spec-min-p 0.5 --mtp rt --max-context 131072 --kv int8 --pool-workers 15 --vram-reserve-mib 1024 --adapt-every 100000Strata, UD-IQ4_XS
--pack unsloth-ud-iq4_xs --native Qwen3.8-Flash-Next-UD-IQ4_XS-00001-of-00003.gguf --expert-profile expert-profile.bin --expert-cache auto --prefill auto --spec 4 --spec-min-p 0.5 --mtp rt --max-context 131072 --kv int8 --ple-io ram --resident-budget-gib 56 --pool-workers 15 --vram-reserve-mib 1024 --adapt-every 100000Strata, Q2_0
--pack q2_0 --native Qwen3.8-Flash-Next-GSQ-RCO-Q2_0-00001-of-00002.gguf --ple-gguf Qwen3.8-Flash-Next-GSQ-RCO-Q2_0-00002-of-00002.gguf --expert-profile expert-profile.bin --expert-cache auto --prefill auto --spec 4 --spec-min-p 0.5 --mtp rt --max-context 131072 --kv int8 --ple-io ram --pool-workers 15 --vram-reserve-mib 1024 --adapt-every 100000Strata, IQ3_S
--pack iq3_s --native Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S-00001-of-00002.gguf --ple-gguf Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S-00002-of-00002.gguf --expert-profile expert-profile.bin --expert-cache auto --prefill auto --spec 4 --spec-min-p 0.5 --mtp rt --max-context 131072 --kv int8 --pool-workers 15 --vram-reserve-mib 1024 --adapt-every 100000Qwen-Image-2.1 Base: Text to image, Image edit
Qwen-Image-2.1 Turbo: Image edit
--listen 127.0.0.1 --port 8288 --extra-model-paths-config extra_model_paths.yaml --output-directory images --input-directory inputsQwen-Image-2.1 Base: Text to image, Image edit
Qwen-Image-2.1 Turbo: Image edit
--listen 127.0.0.1 --port 8288 --extra-model-paths-config extra_model_paths.yaml --output-directory images --input-directory inputsQwen-Image-2.1 Base: Text to image, Image edit
Qwen-Image-2.1 Turbo: Image edit
--listen 127.0.0.1 --port 8288 --extra-model-paths-config extra_model_paths.yaml --output-directory images --input-directory inputsComfyUI, nvfp4
--listen 127.0.0.1 --port 8288 --disable-auto-launch --disable-dynamic-vram --disable-pinned-memory --disable-cuda-malloc --use-ck-attention --disable-smart-memory --cache-none --reserve-vram 1 --extra-model-paths-config extra_model_paths.yaml --output-directory output --input-directory input --temp-directory temp --user-directory user, PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True H3_METRICS_DIR=metrics