Base Models

We provide a range of open-source models for easy fine-tuning and serving access. Our selection is regularly updated, and you can also use your existing OpenAI models.

  • Llama-8b: $0.4 per million tokens
  • Llama-v3-70b-instruct: $1.1 per million tokens
  • Mixtral-8x22b-instruct: $0.8 per million tokens
  • Mixtral-8x7b-instruct: $0.8 per million tokens

Open-source inference API pricing is subject to change and might not be up to date.