Qwen vs GPT: benchmarks and API costs

GPT-6.1 Sol leads SciCode at 54.17% versus 50.58%. Qwen3.8-Flash-Next has the lower illustrated request cost at $0.0025; the other model costs $0.03.

Updated · 6 sources · Methodology

DimensionWinnerMarginEvidence
SciCode (%)GPT-6.1 Sol3.59 ppQwen3.8-Flash-Next 50.58% / GPT-6.1 Sol 54.17%12
Output speed (tokens/s)GPT-6.1 Sol23.9 tokens/sQwen3.8-Flash-Next 55.4 / GPT-6.1 Sol 79.3 tokens/s
AA time to first answer token (s)Qwen3.8-Flash-Next213.27 sQwen3.8-Flash-Next 38.17 s / GPT-6.1 Sol 251.44 s
Estimated request costQwen3.8-Flash-Next$0.027510K + 1K: Qwen3.8-Flash-Next $0.0025 / GPT-6.1 Sol $0.0334

AA coding quality benchmarks

MetricQwen3.8-Flash-NextGPT-6.1 Sol (Max)
SciCode (%)50.58154.172

Performance

MetricQwen3.8-Flash-NextGPT-6.1 Sol (Max)
Output speed (tokens/s)55.479.3
AA time to first answer token (s)38.17251.44

Prices and request cost

MetricQwen3.8-Flash-NextGPT-6.1 Sol
Input / 1M tokens$0.24$23
Output / 1M tokens$0.54$103
Context window (tokens)123262,14451,050,000
Max output (tokens)131,0726128,0003
Cost example: 10,000 input + 1,000 billed output tokens
Qwen3.8-Flash-Next$0.0025
GPT-6.1 Sol$0.03

Coding, reasoning, context and cost

Coding benchmark

  • AA SciCode: Qwen3.8-Flash-Next 50.58% / GPT-6.1 Sol 54.17%.12

Reasoning benchmark

  • The configured AA first-answer wait is 38.17 s for Qwen3.8-Flash-Next and 251.44 s for GPT-6.1 Sol.12

Context window (tokens)

  • The larger hosted input allowance belongs to GPT at 1,050,000 tokens; Qwen provides 262,144.12

Estimated request cost

  • Qwen’s Lyceum tariff yields $0.0025 per example, while direct OpenAI billing yields $0.03 for GPT.34

Methodology and sources

SciCode is AA’s scientific-coding evaluation, reported as a percentage; higher is better. It is separate from the 10,000-input-token performance test and is not an in-editor Cline evaluation. Quality and performance use the configurations shown beside the model names. A current AA v5 Intelligence Index is displayed only where both models have a published value. AA performance uses the 10,000-input-token benchmark at each model’s displayed configuration; reasoning settings vary by model. Output speed is the median output rate. Answer latency measures the first answer token after reasoning, not the initial streamed reasoning chunk. For non-streamed reasoning and non-reasoning models, AA reports the same first-chunk and first-answer event. AA estimates answer latency from initial response and reasoning duration; it is not a separately sampled median. These are reference deployments, not Novita endpoint guarantees. The uncached cost example bills 10,000 input and 1,000 output tokens at each named seller’s tariff; it is not the cost of the AA benchmark. Prices, context and output limits use the cited seller sources.

  1. Artificial Analysis · Qwen3.8-Flash-Next · quality and performance
  2. Artificial Analysis · GPT-6.1 Sol (Max) · quality and performance
  3. OpenAI · GPT-6.1 Sol · API pricing and limits
  4. Lyceum · Qwen3.8-Flash-Next · API pricing and limits
  5. Lyceum · Qwen3.8-Flash-Next · native context specification
  6. Lyceum · serverless request limits

Build with Novita Model APIs

Create an API key and connect your application.

Start BuildingExplore Models