Snowflake

Snowflake: Arctic Instruct

snowflake/snowflake-arctic-instruct

Arctic is a dense-MoE Hybrid transformer architecture pre-trained from scratch by the Snowflake AI Research Team. Arctic combines a 10B dense transformer model with a residual 128x3.66B MoE MLP resulting in 480B total and 17B active parameters chosen using a top-2 gating.

To read more about this model's release, click here.

Context Window

4,096

0

Language

PythonJavaScriptCurl

Using Snowflake: Arctic Instruct with Python API

Using Snowflake: Arctic Instruct with OpenAI compatible API

import openai

client = openai.Client(
  api_key= '{your_api_key}',
  base_url="https://api.model.box/v1",
)
response = client.chat.completions.create(
model="snowflake/snowflake-arctic-instruct",
messages: [
  {
    role: 'user',
    content:
      'introduce your self',
    },
  ]
)
print(response)