Skip to Content
Provider Integrations

Provider Integrations

⚠️

Important: Use the exact environment key names from the table below. Third-party provider packages require these specific key names.

ProxAI supports a wide range of AI providers. You need to get an API key from the provider and add it to your environment variables.

~/.zshrc, ~/.bashrc etc. files:

export OPENAI_API_KEY="..."; export ANTHROPIC_API_KEY="..."; ...

After adding the API key, you need to restart your terminal or run:

source ~/.zshrc;
  • Add at least one API key to your environment variables.
  • For Google Colab, check the Google Colab Example page.

Supported Providers List

If you are interested, you can check the full list of models from the ProxAI GitHub repo .

The following table is a quick reference for the providers and their API keys.

ProviderEnvironment KeyQuick API Key Generation Link
Google Gemini GEMINI_API_KEYaistudio.google.com/apikey 
OpenAI OPENAI_API_KEYplatform.openai.com/api-keys 
Claude ANTHROPIC_API_KEYconsole.anthropic.com/settings/keys 
Grok XAI_API_KEYdocs.x.ai/docs/overview 
DeepSeek DEEPSEEK_API_KEYplatform.deepseek.com/api_keys 
Mistral MISTRAL_API_KEYconsole.mistral.ai/api-keys/ 
Cohere CO_API_KEYdashboard.cohere.com/api-keys 
Databricks DATABRICKS_TOKEN
DATABRICKS_HOST
See instructions below
HuggingFace HUGGINGFACE_API_KEYhuggingface.co/settings/tokens 
  • Check the roadmap page for the upcoming provider integrations.

Gemini (aistudio.google.com )

Environment Key: GEMINI_API_KEY
API Key Instructions:
Open an account and create an API key at aistudio.google.com/apikey .
Model Documentation:
ai.google.dev/gemini-api/docs/models 

OpenAI (openai.com )

Environment Key: OPENAI_API_KEY
API Key Instructions:
Open an account and create an API key at platform.openai.com/api-keys .
Model Documentation:
platform.openai.com/docs/models 
platform.openai.com/docs/pricing 

Claude (anthropic.com )

Environment Key: ANTHROPIC_API_KEY
API Key Instructions:
Open an account and create an API key at console.anthropic.com/settings/keys .
Model Documentation:
docs.anthropic.com/en/models 

Grok (x.ai )

Environment Key: XAI_API_KEY
API Key Instructions:
Open an account and create an API key at x.ai . See their documentation  for detailed instructions.
Model Documentation:
docs.x.ai/docs/models 

DeepSeek (deepseek.com )

Environment Key: DEEPSEEK_API_KEY
API Key Instructions:
Open an account and create an API key at platform.deepseek.com/api_keys .
Model Documentation:
api-docs.deepseek.com/quick_start/pricing 

Mistral (mistral.ai )

Environment Key: MISTRAL_API_KEY
API Key Instructions:
Open an account and create an API key at console.mistral.ai/api-keys/ .
Model Documentation:
docs.mistral.ai/models/ 

Cohere (cohere.com )

Environment Key: CO_API_KEY
API Key Instructions:
Open an account and create an API key at dashboard.cohere.com/api-keys .
Model Documentation:
docs.cohere.com/docs/models 

Databricks (databricks.com )

Environment Keys: DATABRICKS_TOKEN, DATABRICKS_HOST
API Key Instructions:
1 - Create a Databricks account and create a workspace. Open your workspace from accounts.cloud.databricks.com/workspaces  > Click the “Open” button to the left of the workspace row.
2 - Add the workspace host URL as DATABRICKS_HOST='https://<your-workspace-name>.cloud.databricks.com'.
Note: For DATABRICKS_HOST, it is important that it does not end with a slash.
3 - In your workspace, open “Profile” > “Settings” > “Developer” > “Access Tokens”.
4 - Create a new token and add it as DATABRICKS_TOKEN.
Model Documentation:
docs.databricks.com/aws/en/machine-learning/model-serving/foundation-model-overview 

HuggingFace (huggingface.co )

Environment Key: HUGGINGFACE_API_KEY
API Key Instructions:
Open an account and create an API key at huggingface.co/settings/tokens .
Model Documentation:
huggingface.co/docs/inference-providers/en/index 
huggingface.co/docs/inference-providers/en/tasks/chat-completion  (Suggested Models)

Last updated on