Wizardlm 2 8x22B
microsoft/wizardlm-2-8x22b
WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.
Features
Serverless API
Docs
microsoft/wizardlm-2-8x22b is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.
Available Serverless
Run queries immediately, pay only for usage
Input$0.62 / M Tokens
Output$0.62 / M Tokens
Use the following code examples to integrate with our API:
1from openai import OpenAI
2
3client = OpenAI(
4 api_key="<Your API Key>",
5 base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9 model="microsoft/wizardlm-2-8x22b",
10 messages=[
11 {"role": "system", "content": "You are a helpful assistant."},
12 {"role": "user", "content": "Hello, how are you?"}
13 ],
14 max_tokens=8000,
15 temperature=0.7
16)
17
18print(response.choices[0].message.content)Info
Provider
Others
Quantization
bf16
Supported Functionality
Context Length
65535
Max Output
8000
Serverless
Supported
Structured Output
Supported
Input Capabilities
text
Output Capabilities
text
Everything you need to build production AI.
200+ models, on-demand GPUs, and secure agent runtimes — unified under one API. Free to start, scales as you grow.