Azure
Microsoft

WizardLM-2 7B

microsoft/wizardlm-2-7b

WizardLM-2 7B is the smaller variant of Microsoft AI's latest Wizard model. It is the fastest and achieves comparable performance with existing 10x larger opensource leading models

It is a finetune of Mistral 7B Instruct, using the same technique as WizardLM-2 8x22B.

To read more about the model release, click here.

#moe

Community

Open Source

Context Window

32,000

0

Using WizardLM-2 7B with Python API

Using WizardLM-2 7B with OpenAI compatible API

import openai

client = openai.Client(
  api_key= '{your_api_key}',
  base_url="https://api.model.box/v1",
)
response = client.chat.completions.create(
model="microsoft/wizardlm-2-7b",
messages: [
  {
    role: 'user',
    content:
      'introduce your self',
    },
  ]
)
print(response)