DeepSeek vs Llama: benchmarks and API costs

DeepSeek V4.1 Flash 1017 leads SciCode at 55.90% versus 31.71%. Llama 4 Maverick has the lower illustrated request cost at $0.00355; the other model costs $0.0042.

Updated · 4 sources · Methodology

DimensionWinnerMarginEvidence
SciCode (%)DeepSeek V4.1 Flash 101724.19 ppDeepSeek V4.1 Flash 1017 55.90% / Llama 4 Maverick 31.71%12
Output speed (tokens/s)DeepSeek V4.1 Flash 1017128.3 tokens/sDeepSeek V4.1 Flash 1017 178.3 / Llama 4 Maverick 50.0 tokens/s
Illustrated request costLlama 4 Maverick$0.00065DeepSeek V4.1 Flash 1017 $0.0042 / Llama 4 Maverick $0.00355

AA coding quality benchmarks

MetricDeepSeek V4.1 Flash 1017 (Max)Llama 4 Maverick
SciCode (%)55.90131.712

Performance

MetricDeepSeek V4.1 Flash 1017Llama 4 Maverick
Output speed (tokens/s)178.350.0
AA time to first answer token (s)12.410.97

Prices and request cost

MetricDeepSeek V4.1 Flash 1017 · Novita AILlama 4 Maverick · Novita AI
Input / 1M tokens$0.33$0.274
Output / 1M tokens$1.23$0.854
Context window (tokens)1,048,57631,048,5764
Max output (tokens)393,21638,1924
API documentationNovita AI · Chat API
Cost example: 10,000 input + 1,000 billed output tokens

Coding, reasoning, context and cost

Coding benchmark

  • AA SciCode: DeepSeek V4.1 Flash 1017 55.90% / Llama 4 Maverick 31.71%.12

Reasoning benchmark

Context window (tokens)

  • Both Novita endpoints expose 1,048,576 context tokens, so input capacity alone does not distinguish them.12

Estimated request cost

  • Llama’s $0.00355 example is the budget choice; DeepSeek requires $0.0042 for the same uncached token quantities.

Methodology and sources

SciCode is AA’s scientific-coding evaluation, reported as a percentage; higher is better. It is separate from the 10,000-input-token performance test and is not an in-editor Cline evaluation. Quality and performance use the configurations shown beside the model names. A current AA v5 Intelligence Index is displayed only where both models have a published value. AA performance uses the 10,000-input-token benchmark at each model’s displayed configuration; reasoning settings vary by model. Output speed is the median output rate. Answer latency measures the first answer token after reasoning, not the initial streamed reasoning chunk. For non-streamed reasoning and non-reasoning models, AA reports the same first-chunk and first-answer event. AA estimates answer latency from initial response and reasoning duration; it is not a separately sampled median. These are reference deployments, not Novita endpoint guarantees. The uncached cost example bills 10,000 input and 1,000 output tokens at each named seller’s tariff; it is not the cost of the AA benchmark. Prices, context and output limits use the cited seller sources.

  1. Artificial Analysis · DeepSeek V4.1 Flash 1017 (Max) · quality and performance
  2. Artificial Analysis · Llama 4 Maverick · quality and performance
  3. Novita AI · DeepSeek V4.1 Flash 1017 · endpoint pricing and limits
  4. Novita AI · Llama 4 Maverick · endpoint pricing and limits

Build with Novita Model APIs

Create an API key and connect your application.