Provider Integrations

ProxAI supports a wide range of AI providers. You need to get an API key from the provider and add it to your environment variables.

~/.zshrc, ~/.bashrc etc. files:

export OPENAI_API_KEY="...";
export ANTHROPIC_API_KEY="...";
...

After adding the API key, you need to restart your terminal or run:

source ~/.zshrc;

• Add at least one API key to your environment variables.
• For Google Colab, check the Google Colab Example page.

Supported Providers List

If you are interested, you can check the full list of models from the ProxAI GitHub repo.

The following table is a quick reference for the providers and their API keys.

• Check the roadmap page for the upcoming provider integrations.

Gemini (aistudio.google.com)

Environment Key: GEMINI_API_KEY
API Key Instructions:
Open an account and create an API key at aistudio.google.com/apikey.
Model Documentation:
ai.google.dev/gemini-api/docs/models

OpenAI (openai.com)

Environment Key: OPENAI_API_KEY
API Key Instructions:
Open an account and create an API key at platform.openai.com/api-keys.
Model Documentation:
platform.openai.com/docs/models
platform.openai.com/docs/pricing

Claude (anthropic.com)

Environment Key: ANTHROPIC_API_KEY
API Key Instructions:
Open an account and create an API key at console.anthropic.com/settings/keys.
Model Documentation:
docs.anthropic.com/en/models

Grok (x.ai)

Environment Key: XAI_API_KEY
API Key Instructions:
Open an account and create an API key at x.ai. See their documentation for detailed instructions.
Model Documentation:
docs.x.ai/docs/models

DeepSeek (deepseek.com)

Environment Key: DEEPSEEK_API_KEY
API Key Instructions:
Open an account and create an API key at platform.deepseek.com/api_keys.
Model Documentation:
api-docs.deepseek.com/quick_start/pricing

Mistral (mistral.ai)

Environment Key: MISTRAL_API_KEY
API Key Instructions:
Open an account and create an API key at console.mistral.ai/api-keys/.
Model Documentation:
docs.mistral.ai/models/

Cohere (cohere.com)

Environment Key: CO_API_KEY
API Key Instructions:
Open an account and create an API key at dashboard.cohere.com/api-keys.
Model Documentation:
docs.cohere.com/docs/models

Databricks (databricks.com)

Environment Keys: DATABRICKS_TOKEN, DATABRICKS_HOST
API Key Instructions:
1 - Create a Databricks account and create a workspace. Open your workspace from accounts.cloud.databricks.com/workspaces > Click the “Open” button to the left of the workspace row.
2 - Add the workspace host URL as DATABRICKS_HOST='https://<your-workspace-name>.cloud.databricks.com'.
Note: For DATABRICKS_HOST, it is important that it does not end with a slash.
3 - In your workspace, open “Profile” > “Settings” > “Developer” > “Access Tokens”.
4 - Create a new token and add it as DATABRICKS_TOKEN.
Model Documentation:
docs.databricks.com/aws/en/machine-learning/model-serving/foundation-model-overview

HuggingFace (huggingface.co)

Environment Key: HUGGINGFACE_API_KEY
API Key Instructions:
Open an account and create an API key at huggingface.co/settings/tokens.
Model Documentation:
huggingface.co/docs/inference-providers/en/index
huggingface.co/docs/inference-providers/en/tasks/chat-completion (Suggested Models)