Open-source vs proprietary LLMs: DeepSeek vs GPT

SciCode is AA’s scientific-coding evaluation, reported as a percentage; higher is better. It is separate from the 10,000-input-token performance test and is not an in-editor Cline evaluation. Quality and performance use the configurations shown beside the model names. A current AA v5 Intelligence Index is displayed only where both models have a published value. AA performance uses the 10,000-input-token benchmark at each model’s displayed configuration; reasoning settings vary by model. Output speed is the median output rate. Answer latency measures the first answer token after reasoning, not the initial streamed reasoning chunk. For non-streamed reasoning and non-reasoning models, AA reports the same first-chunk and first-answer event. AA estimates answer latency from initial response and reasoning duration; it is not a separately sampled median. These are reference deployments, not Novita endpoint guarantees. The uncached cost example bills 10,000 input and 1,000 output tokens at each named seller’s tariff; it is not the cost of the AA benchmark. Prices, context and output limits use the cited seller sources.⁴

1. Artificial Analysis · DeepSeek V4.1 Flash 1017 (Max) · quality and performance
2. Artificial Analysis · GPT-6.1 Sol (Max) · quality and performance
3. OpenAI · GPT-6.1 Sol · API pricing and limits
4. Novita AI · DeepSeek V4.1 Flash 1017 · endpoint pricing and limits