BerriAI/litellm
What It Calls
Calls external APIs · local option
Cloud by default
Can switch to local
Partial check
The repository's own service
Without a key: Text generation · Image generation · Speech-to-text · Embeddings (Azure OpenAI): has a branch that stops with an error without a key. Text generation (Anthropic Claude): skips this call without a key. External API (ai-gateway.vercel.sh): skips this call without a key. The other rows are in the table below.
| Feature | Provider | Use | Default | Alternative |
|---|---|---|---|---|
| Text generation | Anthropic Claude
10 call sites
|
Undetermined | api.anthropic.com |
Skipped without a key (ANTHROPIC_API_KEY), Local runtime (Ollama) +1 more |
| Text generation · Image generation · Embeddings | Amazon Bedrock | Undetermined | bedrock-runtime.eu-west-1.amazonaws.com |
None |
| Text generation · Image generation · Speech-to-text · Embeddings | Azure OpenAI
8 call sites
|
Undetermined | resource.services.ai.azure.com, env.services.ai.azure.com |
None |
| Text generation · Embeddings · Reranking | Cohere | Undetermined | api.cohere.com, api.cohere.ai |
Local runtime (Ollama), Other providers (Ollama) |
| Text generation · Image generation · Embeddings | Google Gemini API
1 call sites |
Undetermined | generativelanguage.googleapis.com |
None |
| Text generation · Embeddings · Document OCR | Mistral AI | Undetermined | api.mistral.ai, codestral.mistral.ai |
Local runtime (Ollama), Other providers (Ollama) |
| Text generation · Image generation · Speech-to-text · Text-to-speech · Embeddings | OpenAI | Undetermined | api.openai.com |
Skipped without a key (ANTHROPIC_API_KEY), Configurable address (OPENAI_API_BASE) +3 more |
| Text generation · Image generation · Embeddings | Google Vertex AI | Undetermined | aiplatform.googleapis.com, europe-west4-aiplatform.googleapis.com |
None |
Show 19 more rows
| Feature | Provider | Use | Default | Alternative |
|---|---|---|---|---|
| Text generation · Image generation | xAI Grok | Undetermined | api.x.ai |
None |
| External API (cloud.google.com) | cloud.google.com | Undetermined | cloud.google.com |
None |
| External API (platform.reducto.ai) | platform.reducto.ai | Undetermined | platform.reducto.ai |
None |
| Text generation | OpenRouter
2 call sites |
Optional | openrouter.ai |
Local runtime (Ollama), Other providers (Ollama) +1 more |
| External API (ai-gateway.vercel.sh) | ai-gateway.vercel.sh
2 call sites |
Optional | ai-gateway.vercel.sh |
Local runtime (Ollama), Other providers (Ollama) +1 more |
| External API (api.cometapi.com) | api.cometapi.com
2 call sites |
Optional | api.cometapi.com |
Local runtime (Ollama), Other providers (Ollama) +1 more |
| External API (api.inference.wandb.ai) | api.inference.wandb.ai
1 call sites |
Optional | api.inference.wandb.ai |
Skipped without a key (ANTHROPIC_API_KEY), Local runtime (Ollama) +1 more |
| External API (api.sambanova.ai) | api.sambanova.ai
1 call sites |
Optional | api.sambanova.ai |
Skipped without a key (ANTHROPIC_API_KEY), Local runtime (Ollama) +1 more |
| External API (litellm.ai) | litellm.ai The repository's own service | Optional | litellm.ai |
Local runtime (Ollama), Other providers (Ollama) +1 more |
| External API (oai.endpoints.kepler.ai.cloud.ovh.net) | oai.endpoints.kepler.ai.cloud.ovh.net
2 call sites |
Optional | oai.endpoints.kepler.ai.cloud.ovh.net |
Local runtime (Ollama), Other providers (Ollama) +1 more |
| Text generation · Speech-to-text | Groq
1 call sites |
Optional | api.groq.com |
Local runtime (Ollama), Other providers (Ollama) |
| Image generation · Video generation · Hosted model inference | Replicate
1 call sites |
Optional | api.replicate.com |
Local runtime (Ollama) |
| External API (api.aleph-alpha.com) | api.aleph-alpha.com
1 call sites |
Optional | api.aleph-alpha.com |
Local runtime (Ollama), Other providers (Ollama) |
| External API (api.compactif.ai) | api.compactif.ai
1 call sites |
Optional | api.compactif.ai |
Local runtime (Ollama), Other providers (Ollama) |
| External API (api.inceptionlabs.ai) | api.inceptionlabs.ai
1 call sites |
Optional | api.inceptionlabs.ai |
Local runtime (Ollama), Other providers (Ollama) |
| External API (api.minimax.io) | api.minimax.io
1 call sites |
Optional | api.minimax.io |
Local runtime (Ollama), Other providers (Ollama) |
| External API (api.nlpcloud.io) | api.nlpcloud.io
1 call sites |
Optional | api.nlpcloud.io |
Local runtime (Ollama), Other providers (Ollama) |
| External API (api.nova.amazon.com) | api.nova.amazon.com
1 call sites |
Optional | api.nova.amazon.com |
Local runtime (Ollama), Other providers (Ollama) |
| External API (chat.maritaca.ai) | chat.maritaca.ai
1 call sites |
Optional | chat.maritaca.ai |
Local runtime (Ollama), Other providers (Ollama) |
Switch to local
OPENAI_API_BASE=http://localhost:11434
| API | Credential | Code evidence | Pricing | Pricing page | Checked |
|---|---|---|---|---|---|
| Anthropic Claude | Your API key | litellm/main.py:2864The default is Anthropic Claude (api.anthropic.com); without a key, it calls another path. A local Ollama path is also available in the same file. |
Paid | Pricing | 2026-10-05 |
| OpenAI | Your API key | litellm/assistants/main.py:450The default is OpenAI (api.openai.com); the address can be changed to a local server via OPENAI_API_BASE. |
Paid | Pricing | 2026-10-05 |
| Amazon Bedrock | Sign-in needed (not an API key) | litellm-rust/crates/llms/src/bedrock/audio_transcription/mod.rs:286A language without path tracing |
Paid | Pricing | 2026-10-05 |
| Azure OpenAI | Your API key | litellm-rust/crates/llms/src/azure_ai/messages/transformation.rs:185A language without path tracing |
Paid | Pricing | 2026-10-05 |
| Cohere | Your API key | litellm/main.py:3087Cohere (api.cohere.com) can be used for text generation, embeddings, and reranking. A local Ollama path is available, or other providers can be chosen. |
Free tier | Pricing | 2026-10-05 |
| Google Gemini API | Your API key | litellm/types/google_genai/main.py:8Not traced to an entry point |
Free tier | Pricing | 2026-10-05 |
| Mistral AI | Your API key | litellm/main.py:2761Mistral AI (api.mistral.ai) can be used for text generation, embeddings, and document OCR. A local Ollama path is available, or other providers can be chosen. |
Free tier | Pricing | 2026-10-05 |
| Google Vertex AI | Sign-in needed (not an API key) | litellm-rust/crates/llms/src/vertex_ai/ocr/deepseek_transformation.rs:20A language without path tracing |
Paid | Pricing | 2026-10-05 |
Show 19 more
| API | Credential | Code evidence | Pricing | Pricing page | Checked |
|---|---|---|---|---|---|
| xAI Grok | Your API key | litellm/realtime_api/main.py:509Not traced to an entry point |
Paid | Pricing | 2026-10-05 |
| cloud.google.com | Credential unclear | litellm/llms/vertex_ai/vertex_ai_partner_models/main.py:25Not traced to an entry point |
No pricing info | - | - |
| platform.reducto.ai | Credential unclear | litellm-rust/crates/llms/src/reducto/ocr/transformation.rs:25A language without path tracing |
No pricing info | - | - |
| OpenRouter | Your API key | litellm/main.py:3471The default is OpenRouter (openrouter.ai); without a key, it calls another path. A local Ollama path is also available in the same file. |
Free tier | Pricing | 2026-10-05 |
| ai-gateway.vercel.sh | Credential unclear | litellm/main.py:3581The default is ai-gateway.vercel.sh; without a key, it calls another path. A local Ollama path is also available in the same file. |
No pricing info | - | - |
| api.cometapi.com | Credential unclear | litellm/main.py:2477The default is api.cometapi.com; without a key, it calls another path. A local Ollama path is also available in the same file. |
No pricing info | - | - |
| api.inference.wandb.ai | Credential unclear | litellm/main.py:7053The default is api.inference.wandb.ai; without a key, it calls another path. A local Ollama path is also available in the same file. |
No pricing info | - | - |
| api.sambanova.ai | Credential unclear | litellm/main.py:7071The default is api.sambanova.ai; without a key, it calls another path. A local Ollama path is also available in the same file. |
No pricing info | - | - |
| litellm.aiThe repository's own service | Credential unclear | litellm/main.py:3481The default is litellm.ai; without a key, it calls another path. A local Ollama path is also available in the same file. |
No pricing info | - | - |
| oai.endpoints.kepler.ai.cloud.ovh.net | Credential unclear | litellm/main.py:4895The default is oai.endpoints.kepler.ai.cloud.ovh.net; without a key, it calls another path. A local Ollama path is also available in the same file. |
No pricing info | - | - |
| Groq | Your API key | litellm/main.py:2138Groq (api.groq.com) can be used for text generation and speech-to-text. A local Ollama path is available, or other providers can be chosen. |
Free tier | Pricing | 2026-10-05 |
| Replicate | Your API key | litellm/main.py:2806Image generation · Video generation · Hosted model inference can use Replicate (api.replicate.com). The same file has a local Ollama path. |
Paid | Pricing | 2026-10-05 |
| api.aleph-alpha.com | Credential unclear | litellm/main.py:3029The code can call api.aleph-alpha.com. A local Ollama path is available, or other providers can be chosen. |
No pricing info | - | - |
| api.compactif.ai | Credential unclear | litellm/main.py:3289The code can call api.compactif.ai. A local Ollama path is available, or other providers can be chosen. |
No pricing info | - | - |
| api.inceptionlabs.ai | Credential unclear | litellm/main.py:4075The code can call api.inceptionlabs.ai. A local Ollama path is available, or other providers can be chosen. |
No pricing info | - | - |
| api.minimax.io | Credential unclear | litellm/main.py:2526The code can call api.minimax.io. A local Ollama path is available, or other providers can be chosen. |
No pricing info | - | - |
| api.nlpcloud.io | Credential unclear | litellm/main.py:2973The code can call api.nlpcloud.io. A local Ollama path is available, or other providers can be chosen. |
No pricing info | - | - |
| api.nova.amazon.com | Credential unclear | litellm/main.py:3172The code can call api.nova.amazon.com. A local Ollama path is available, or other providers can be chosen. |
No pricing info | - | - |
| chat.maritaca.ai | Credential unclear | litellm/main.py:3137The code can call chat.maritaca.ai. A local Ollama path is available, or other providers can be chosen. |
No pricing info | - | - |
Data sent out: audio·embedding input·images·prompt text·usage telemetry · 6 provider(s) unconfirmed
Fetched over the network: GitHub
Checked scope: Partial check — 400/14,119 files · tree not truncated · no submodules · 919 unresolved import path(s) · 1 files in languages not read (C)
Next
Badge preview
[](https://whatitcalls.com/en/BerriAI/litellm)
Shows as “external API · used · local option” in a README.
Was this analysis helpful?
Freshness details
- Checked commit
63a4f3f2f3334bbd239c4c3e4c3302b63b02f71d- Committed
- 2026-10-09 11:56 UTC
- Checked
- 2026-10-09 12:05 UTC
- HEAD last seen
- 2026-10-09 12:05 UTC ·
63a4f3f(same as the checked commit) - Read depth
- Basic (up to 400 files · 8 MB)
- Scanner · rules
scan-5+verdict-5- Pricing catalog
- version 2
- Correction revision
- 0
- Summary
- Model ollama-cloud/gemma4:31b-cloud · some rule sentences
What is sent out
- Confirmed Sends audio to OpenAI, xAI Grok.
litellm/main.py:8111litellm/main.py:8434litellm/realtime_api/main.py:699 - Confirmed Sends text for embeddings to ai-gateway.vercel.sh, api.cometapi.com, api.inference.wandb.ai, api.sambanova.ai, litellm.ai, oai.endpoints.kepler.ai.cloud.ovh.net, OpenAI, OpenRouter.
litellm/batches/main.py:288litellm/batches/main.py:370litellm/batches/main.py:1163 - Confirmed Sends images to ai-gateway.vercel.sh, api.cometapi.com, api.inference.wandb.ai, api.sambanova.ai, litellm.ai, oai.endpoints.kepler.ai.cloud.ovh.net, OpenAI, OpenRouter.
litellm/batches/main.py:288litellm/batches/main.py:370litellm/main.py:6547 - Confirmed Sends prompt text to Anthropic Claude, Cohere, Groq, ai-gateway.vercel.sh, api.aleph-alpha.com, api.cometapi.com, api.compactif.ai, api.inceptionlabs.ai, api.minimax.io, api.nlpcloud.io, api.nova.amazon.com, chat.maritaca.ai, litellm.ai, oai.endpoints.kepler.ai.cloud.ovh.net, Mistral AI, OpenAI, OpenRouter, Replicate.
litellm/assistants/main.py:617litellm/assistants/main.py:687litellm/batches/main.py:288 - Confirmed Sends usage telemetry to OpenAI.
litellm/main.py:7976litellm/main.py:8101 - Estimated Audio may go to Amazon Bedrock (estimated: not linked to a call site).
litellm-rust/crates/llms/src/bedrock/audio_transcription/mod.rs:222 - Estimated Images may go to Anthropic Claude, Amazon Bedrock, Mistral AI, Google Vertex AI (estimated: not linked to a call site).
litellm-rust/crates/llms/src/anthropic/common_utils.rs:841litellm-rust/crates/llms/src/bedrock/audio_transcription/mod.rs:258litellm-rust/crates/llms/src/mistral/ocr/transformation.rs:246 - Estimated Prompt text may go to Anthropic Claude, Azure OpenAI, Google Vertex AI (estimated: not linked to a call site).
litellm-rust/crates/llms/src/anthropic/batches/transformation.rs:310litellm-rust/crates/llms/src/anthropic/common_utils.rs:1682litellm-rust/crates/llms/src/anthropic/messages/transformation.rs:325 - Unconfirmed Providers whose payload was not found in the code: Amazon Bedrock, Azure OpenAI, Google Gemini API, cloud.google.com, platform.reducto.ai, Google Vertex AI
README claims ↔ code
No README claim contradicts the code.
Code quotes
Source files are not stored. Code is linked at the checked commit on GitHub; stored quotes are at most 3 lines per evidence and 6 per file.
Source: BerriAI/litellm · commit 63a4f3f · litellm/main.py
Source: BerriAI/litellm · commit 63a4f3f · litellm/assistants/main.py
Source: BerriAI/litellm · commit 63a4f3f · litellm/batches/main.py
L287default value
Checked scope details
Files
- In the repository
- 14,119
- Checked
- 400 (2%)
Manifests
All priority files read
pyproject.tomlvscode-extension/package.jsontests/pass_through_tests/package.jsonui/litellm-dashboard/package.json
Unresolved import paths (919)
__name__litellm/images/main.py:1054__name__litellm/images/main.py:72mcp.typeslitellm/responses/main.py:72litellm.proxy.db.db_url_settingsbackend/main.py:21litellm.proxy.proxy_serverbackend/main.py:25
not read 857 · entry not read 59 · importlib 2 · missing file 1
Excluded files
out/714dist/233.md296.sql268.yaml263.json246
+46 more
- External code not checked
- None
- Limits hit
- file count limit
- Files in languages not read
- C 1
- Untraced languages
- rust 24
- Symbolic links not followed
- 2
Correction history
No corrections yet.