Mistral
Mistral

Mixtral 8x7B Instruct

mistralai/mixtral-8x7b-instruct

A pretrained generative Sparse Mixture of Experts, by Mistral AI, for chat and instruction use. Incorporates 8 experts (feed-forward networks) for a total of 47 billion parameters.

Instruct model fine-tuned by Mistral. #moe

Community

Open Source

Context Window

32,768

Max Output Tokens

8,192

Language

PythonJavaScriptCurl

Using Mixtral 8x7B Instruct with Python API

Using Mixtral 8x7B Instruct with OpenAI compatible API

import openai

client = openai.Client(
  api_key= '{your_api_key}',
  base_url="https://api.model.box/v1",
)
response = client.chat.completions.create(
model="mistralai/mixtral-8x7b-instruct",
messages: [
  {
    role: 'user',
    content:
      'introduce your self',
    },
  ]
)
print(response)