Skip to content

Supported LLM Providers 💪

The available API providers for LLMs are:

  • Groq - more info about Groq models that can be used and how they can be used, can be found here
  • Mistral AI - more info about Mistral AI models that can be used and how they can be used, can be found here
  • Gemini - more info about Gemini models that can be used and how they can be used, can be found here
  • Bedrock - more info about Bedrock models that can be used and how they can be used, can be found here
  • Anthropic - more info about Anthropic models that can be used and how they can be used, can be found here
  • OpenAI - more info about OpenAI models that can be used, and how they can be used, can be found here
  • Hugging Face - more info about Hugging Face models that can be used, and how they can be used, can be found here
  • Ollama - more info about Ollama models that can be used, and how they can be used, can be found here
  • vLLM - more info about vLLM models that can be used and how they can be used, can be found here
  • SageMaker - more info about SageMaker models that can be used and how they can be used, can be found here
  • Azure - more info about Azure and Azure AI models that can be used and how they can be used, can be found here & here
  • Vertex AI - more info about Vertex AI models that can be used and how they can be used, can be found here