WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.
microsoft/wizardlm-2-8x22b is available via Novita's serverless API, where you pay per token. There are several ways to call the API, including OpenAI-compatible endpoints with exceptional reasoning performance.
Run queries immediately, pay only for usage
Get your API key
Sign up and create a key to run the code below. The API is OpenAI-compatible.
The API is OpenAI-compatible: point any OpenAI SDK at the base URL and pass this model ID.
1from openai import OpenAI
2
3client = OpenAI(
4 api_key="<Your API Key>",
5 base_url="https://api.novita.ai/openai"
6)
7
8response = client.chat.completions.create(
9 model="microsoft/wizardlm-2-8x22b",
10 messages=[
11 {"role": "system", "content": "You are a helpful assistant."},
12 {"role": "user", "content": "Hello, how are you?"}
13 ],
14 max_tokens=8000,
15 temperature=0.7
16)
17
18print(response.choices[0].message.content)