Skip to content

Qwen3.8-Flash-Next inference speed

Compare Qwen3.8-Flash-Next token generation and prompt processing across quantizations on Olares One, NVIDIA DGX Spark and Mac Studio M5 Max.

Qwen3.8-Flash-Next

20 prompts, medium reasoning, 3,072-token output limit

One request at a time. Hardware and Strata settings differ between systems. Q2_0 has speed results only, with no IFBench evaluation.

View test configurations

Token generation, single request

Higher is better
Mac Studio M5 MaxStrata, Q2_0
130 tok/s
DGX SparkStrata, Q2_0
80 tok/s
DGX SparkStrata, IQ3_XXS
68 tok/s
DGX SparkStrata, IQ3_S
59 tok/s
DGX SparkStrata, UD-IQ4_XS
52 tok/s
Mac Studio M5 MaxStrata, IQ3_XXS, no MTP
47 tok/s
Mac Studio M5 MaxStrata, IQ3_S, no MTP
41 tok/s

Scroll horizontally to view all metrics.

Prompt processing (prefill)

Client-observed prompt processing speed, median of three runs per prompt length

Calculated as prompt tokens divided by time to first token. This differs from the engine-reported metric on the Qwen3.8-27B page. Use the same metric when comparing models.

View test configurations

Prompt length in tokens. Speed in tokens per second.

Scroll horizontally to compare all prompt lengths.