Mistral: Mixtral 8x22B Instruct

Mistral

Mistral: Mixtral 8x22B Instruct

mistralai/mixtral-8x22b-instruct

Mistral's official instruct fine-tuned version of Mixtral 8x22B. It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include:

strong math, coding, and reasoning
large context length (64k)
fluency in English, French, Italian, German, and Spanish

See benchmarks on the launch announcement here. #moe

Community

Open Source

Context Window

65,536

Max Output Tokens

8,192

Language

Python JavaScript Curl

Using Mistral: Mixtral 8x22B Instruct with Python API

Using Mistral: Mixtral 8x22B Instruct with OpenAI compatible API

import openai

client = openai.Client(
  api_key= '{your_api_key}',
  base_url="https://api.model.box/v1",
)
response = client.chat.completions.create(
model="mistralai/mixtral-8x22b-instruct",
messages: [
  {
    role: 'user',
    content:
      'introduce your self',
    },
  ]
)
print(response)