(https://github.githubassets.com) (https://avatars.githubusercontent.com) (https://github-cloud.s3.amazonaws.com) (https://user-images.githubusercontent.com/) (https://github.githubassets.com) (https://avatars.githubusercontent.com)   (https://github.githubassets.com/assets/react-e27d1b3e03961e68.js)  (https://github.githubassets.com/assets/react-compiler-runtime-4610bd6d3de9c049.js)  (https://github.githubassets.com/assets/scheduler-58b860b049ca307c.js)  (https://github.githubassets.com/assets/react-dom-e5fd46a22d5c4058.js)  (https://github.githubassets.com/assets/react-dom-client-1b4a3ee065998cea.js)  (https://github.githubassets.com/assets/react-is-e0b593954b4706d8.js)  (https://github.githubassets.com/assets/react-jsx-runtime-4915cb0f5b3aff04.js)  (https://github.githubassets.com/assets/react-reconciler-8e99e505c4429605.js)  (../../github.githubassets.com/assets/light-99f877e9ddfc0e51.css)  (../../github.githubassets.com/assets/light_high_contrast-48fdd0811afbab3c.css)  (../../github.githubassets.com/assets/dark-79ad2ace604703b3.css)  (../../github.githubassets.com/assets/dark_high_contrast-24484a076f02295f.css)                (../../github.githubassets.com/assets/primer-primitives-ed9ca172356fd545.css)  (../../github.githubassets.com/assets/primer-1d2c7f7b52a6068b.css)  (../../github.githubassets.com/assets/global-adcabba7b5c5d221.css)  (../../github.githubassets.com/assets/github-552513ad07a183a1.css)  (../../github.githubassets.com/assets/repository-11ee8a031c040c1a.css)  (../../github.githubassets.com/assets/code-2d56bdb0166c0238.css)  (https://github.githubassets.com/assets/wp-runtime-3e64f89c3e4c451b.js)  (https://github.githubassets.com/assets/app-foundation-89338d13d121427c.js)  (https://github.githubassets.com/assets/app-runtime-79275629e212a8de.js)  (https://github.githubassets.com/assets/fetch-utilities-ef80792c471f3488.js)  (https://github.githubassets.com/assets/ser-564408e9198dff6d.js)  (../../github.githubassets.com/assets/app-runtime.db39abd7070fb379.module.css)  (https://github.githubassets.com/assets/catalyst-86a8f5de995615f8.js)  (https://github.githubassets.com/assets/selector-observer-e88088f989b27670.js)  (https://github.githubassets.com/assets/relative-time-element-85cb37305f54dec4.js)  (https://github.githubassets.com/assets/by4-73006a52f155289f.js)  (https://github.githubassets.com/assets/ja9-36f036c13c2e3a4c.js)  (https://github.githubassets.com/assets/kw-866fd9513ae95106.js)  (https://github.githubassets.com/assets/r1-b075aab3204f32f9.js)  (https://github.githubassets.com/assets/jz5-7c5d1669717041f8.js)  (https://github.githubassets.com/assets/hj-5126390ff433704d.js)  (https://github.githubassets.com/assets/j05-dce4d588268f0f7e.js)  (https://github.githubassets.com/assets/runtime-helpers-f3f5d71440009c48.js)  (https://github.githubassets.com/assets/aria-live-edd4f18194230d9e.js)  (https://github.githubassets.com/assets/hotkey-5109c77d7ac61078.js)  (https://github.githubassets.com/assets/react-core-220b14bbb2e5a3aa.js)  (https://github.githubassets.com/assets/04-a76c47ec12c12e01.js)  (https://github.githubassets.com/assets/ur-024971cb63acad59.js)  (https://github.githubassets.com/assets/4t-9933bcccf9a9524f.js)  (https://github.githubassets.com/assets/6ny-c969fbae697a356f.js)  (https://github.githubassets.com/assets/yhq-3a209035a30b1a09.js)  (https://github.githubassets.com/assets/z1v-da5b33b877bfa358.js)  (https://github.githubassets.com/assets/wo-09f85d22a6c8931b.js)  (https://github.githubassets.com/assets/9y-81cfe57dc9040f3e.js)  (https://github.githubassets.com/assets/j0-41a4cf04cbd99503.js)  (https://github.githubassets.com/assets/0p-50de93b282dbc67c.js)  (../../github.githubassets.com/assets/react-core.1d66df2418934e22.module.css)  (https://github.githubassets.com/assets/n9-97e2e5539969aaaf.js)  (https://github.githubassets.com/assets/ic-991f04433f366e7b.js)  (https://github.githubassets.com/assets/primer-react-7450ad822d7699b5.js)  (https://github.githubassets.com/assets/react-lib-3b03eb55bae46c70.js)  (https://github.githubassets.com/assets/aq-ba5f008999aedbd0.js)  (https://github.githubassets.com/assets/j6-363f0ebf4f62f310.js)  (https://github.githubassets.com/assets/t7l-bf6f21d7e7a43c35.js)  (https://github.githubassets.com/assets/fe-7576d9b281e2106a.js)  (https://github.githubassets.com/assets/wsr-5fd3071e5a9061ab.js)  (https://github.githubassets.com/assets/0n-27006551de0ea3c6.js)  (https://github.githubassets.com/assets/xv-51cb34754bda73a9.js)  (https://github.githubassets.com/assets/n4u-6317ce1c31aed1db.js)  (https://github.githubassets.com/assets/j8s-d05eedc69cebc200.js)  (https://github.githubassets.com/assets/la-de176c4ee471f2b3.js)  (https://github.githubassets.com/assets/pj-da0fc66367c63559.js)  (https://github.githubassets.com/assets/oo-ed8e4c10812fc721.js)  (https://github.githubassets.com/assets/50-3e117c4737ded7c8.js)  (https://github.githubassets.com/assets/5gq-0ecd117c4ccaf4f0.js)  (https://github.githubassets.com/assets/nsi-926ffbc13301c5b7.js)  (https://github.githubassets.com/assets/3np-a0186ba63220b6ce.js)  (https://github.githubassets.com/assets/on-75d8015f7c16be87.js)  (https://github.githubassets.com/assets/bi0-e2f78de823e39ca9.js)  (https://github.githubassets.com/assets/b1-78b9e19270a36df1.js)  (https://github.githubassets.com/assets/0l5-4e7d0bd60ed3a66a.js)  (https://github.githubassets.com/assets/c2z-702903d1c83e2892.js)  (https://github.githubassets.com/assets/f9-038758dcbfe08dab.js)  (https://github.githubassets.com/assets/0k-b7df0a74912a42bf.js)  (https://github.githubassets.com/assets/sp-2bbb73a69162e23b.js)  (https://github.githubassets.com/assets/og-93ae8b358505d372.js)  (https://github.githubassets.com/assets/q5-fc1f2b54f1d10663.js)  (https://github.githubassets.com/assets/qod-79dedcb2e7d13687.js)  (https://github.githubassets.com/assets/du-dc47d4c63c11d935.js)  (https://github.githubassets.com/assets/ql0-52233a028822e2ef.js)  (https://github.githubassets.com/assets/20-69395c63e3e4b526.js)  (https://github.githubassets.com/assets/dsj-4cca625a20b72565.js)  (https://github.githubassets.com/assets/wp-2413e3416979956b.js)  (https://github.githubassets.com/assets/e84-4da7096eb6b55d6d.js)  (https://github.githubassets.com/assets/0pz-9106948caa5e015a.js)  (https://github.githubassets.com/assets/7mh-23cfe0e4aeb0e064.js)  (https://github.githubassets.com/assets/bsb-4f4ac8c20da73fac.js)  (https://github.githubassets.com/assets/46-90fb1c98afc2cd5a.js)  (https://github.githubassets.com/assets/jga-3f6576d6f86d4e43.js)  (https://github.githubassets.com/assets/me-dfecacc72ba91157.js)  (https://github.githubassets.com/assets/0dh-eb608edac481e761.js)  (https://github.githubassets.com/assets/xc-f5d51b571cd317cb.js)  (https://github.githubassets.com/assets/7c-a3aa1fcc96ee2fd8.js)  (https://github.githubassets.com/assets/4b-c63a3f3820a90d31.js)  (https://github.githubassets.com/assets/qv-5ae49538d02f5979.js)  (https://github.githubassets.com/assets/gtp-bb135af2e2127c94.js)  (../../github.githubassets.com/assets/primer-react-css.bad9067f7ec9f6d1.module.css)  (../../github.githubassets.com/assets/ql0.98d0f45ff87777ec.module.css)  (../../github.githubassets.com/assets/46.3e560835284be460.module.css)  (../../github.githubassets.com/assets/xc.13e027137438fd9f.module.css)  (../../github.githubassets.com/assets/4b.e524e9f270f17ecc.module.css)  (../../github.githubassets.com/assets/qv.9631adba022ab320.module.css)  (../../github.githubassets.com/assets/code-view.772f7c8fe7b5e8fd.module.css)  (https://github.githubassets.com/assets/hu-0d4aa5ab34269698.js)  (https://github.githubassets.com/assets/31k-472f1465ccb55aa9.js)  (../../github.githubassets.com/assets/primer-react-css.bad9067f7ec9f6d1.module.css)  (../../github.githubassets.com/assets/notifications-subscriptions-menu.0a66d77e55c4d744.module.css)  GitHub - kennethwolters/litelm: litellm without the bloat · GitHub      (repo_source) (https://github.githubassets.com/)   (https://github.com/opensearch.xml) (GitHub) (https://github.com/fluidicon.png) (GitHub)                        (https://github.githubassets.com/assets/pinned-octocat-093da3e6fa40.svg) (https://github.githubassets.com/favicons/favicon.png) (../../github.githubassets.com/favicons/favicon.svg)  (../manifest.json)   (litelm.html#start-of-content) Skip to content   (https://github.githubassets.com/assets/l7j2-38580375b86d2d15.js)  (https://github.githubassets.com/assets/keyboard-shortcuts-dialog-f274be466b9e5398.js)  (../../github.githubassets.com/assets/primer-react-css.bad9067f7ec9f6d1.module.css)  (../../github.githubassets.com/assets/keyboard-shortcuts-dialog.b73101bd6774abf6.module.css)    (https://github.githubassets.com/assets/nvz-deeea5270ef3dfb4.js)  (https://github.githubassets.com/assets/mz-a6c5397389be3fff.js)  (https://github.githubassets.com/assets/fz5-23f28c0f388769c9.js)  (https://github.githubassets.com/assets/lht-b91be4a9ea8a3210.js)  (https://github.githubassets.com/assets/p1-76a75a6081059b19.js)  (https://github.githubassets.com/assets/3d-82c347d20a13fb90.js)  (https://github.githubassets.com/assets/tua-81c88ff7e39af43c.js)  (https://github.githubassets.com/assets/4s-854aef8a5dc4797a.js)  (https://github.githubassets.com/assets/marketing-header-4063c2d1a725df21.js)  (../../github.githubassets.com/assets/primer-react-css.bad9067f7ec9f6d1.module.css)  (../../github.githubassets.com/assets/primer-react-brand-css.206bbd4fd232654e.module.css)  (../../github.githubassets.com/assets/4s.795b697dd2335e43.module.css)  Navigation Menu       (https://github.com/)    (https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fkennethwolters%2Flitelm) Sign in         Appearance settings   Platform   AI CODE CREATION (https://github.com/features/copilot)    GitHub Copilot Write better code with AI    (https://github.com/features/ai/github-app)   GitHub Copilot app Direct agents from issue to merge    (https://github.com/mcp)    MCP Registry Integrate external tools       DEVELOPER WORKFLOWS (https://github.com/features/actions)   Actions Automate any workflow    (https://github.com/features/codespaces)    Codespaces Instant dev environments    (https://github.com/features/issues)    Issues Plan and track work    (https://github.com/features/code-review)   Code Review Manage code changes    (https://github.com/features/code-quality)    Code Quality Enforce quality at merge       APPLICATION SECURITY (https://github.com/security/advanced-security)   GitHub Advanced Security Find and fix vulnerabilities    (https://github.com/security/advanced-security/code-security)   Code security Secure your code as you build    (https://github.com/security/advanced-security/secret-protection)   Secret protection Stop leaks before they start       EXPLORE (https://github.com/why-github) Why GitHub   (https://docs.github.com) Documentation     (https://github.blog) Blog     (https://github.blog/changelog) Changelog     (https://github.com/marketplace) Marketplace       (https://github.com/features) View all features         Solutions   BY COMPANY SIZE (https://github.com/enterprise) Enterprises   (https://github.com/team) Small and medium teams   (https://github.com/enterprise/startups) Startups   (https://github.com/solutions/industry/nonprofits) Nonprofits      BY USE CASE (https://github.com/solutions/use-case/app-modernization) App Modernization   (https://github.com/solutions/use-case/devsecops) DevSecOps   (https://github.com/solutions/use-case/devops) DevOps   (https://github.com/solutions/use-case/ci-cd) CI/CD   (https://github.com/solutions/use-case) View all use cases         BY INDUSTRY (https://github.com/solutions/industry/healthcare) Healthcare   (https://github.com/solutions/industry/financial-services) Financial services   (https://github.com/solutions/industry/manufacturing) Manufacturing   (https://github.com/solutions/industry/government) Government   (https://github.com/solutions/industry) View all industries          (https://github.com/solutions) View all solutions         Resources   EXPLORE BY TOPIC (https://github.com/resources/articles?topic=ai) AI   (https://github.com/resources/articles?topic=software-development) Software Development   (https://github.com/resources/articles?topic=devops) DevOps   (https://github.com/resources/articles?topic=security) Security   (https://github.com/resources/articles) View all topics         EXPLORE BY TYPE (https://github.com/customer-stories) Customer stories   (https://github.com/resources/events) Events & webinars   (https://github.com/resources/whitepapers) Ebooks & reports   (https://github.com/solutions/executive-insights) Business insights   (https://skills.github.com) GitHub Skills        SUPPORT & SERVICES (https://docs.github.com) Documentation     (https://support.github.com) Customer support     (https://github.com/orgs/community/discussions) Community forum   (https://github.com/trust-center) Trust center   (https://github.com/partners) Partners       (https://github.com/resources) View all resources         Open Source   COMMUNITY (https://github.com/open-source/sponsors)   GitHub Sponsors Fund open source developers       PROGRAMS (https://securitylab.github.com) Security Lab     (https://maintainers.github.com) Maintainer Community     (https://stars.github.com) GitHub Stars     (https://archiveprogram.github.com) Archive Program        REPOSITORIES (https://github.com/topics) Topics   (https://github.com/trending) Trending   (https://github.com/collections) Collections          Enterprise   ENTERPRISE SOLUTIONS (https://github.com/enterprise)   Enterprise platform AI-powered developer platform       AVAILABLE ADD-ONS (https://github.com/security/advanced-security)   GitHub Advanced Security Enterprise-grade security features    (https://github.com/features/copilot/copilot-business)    Copilot for Business Enterprise-grade AI features    (https://github.com/enterprise/premium-support)   Premium Support Enterprise-grade 24/7 support           (https://github.com/pricing) Pricing      Search /       (https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fkennethwolters%2Flitelm) Sign in    (https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=kennethwolters%2Flitelm) Sign up         Appearance settings            You signed in with another tab or window. (litelm.html) Reload to refresh your session. You signed out in another tab or window. (litelm.html) Reload to refresh your session. You switched accounts on another tab or window. (litelm.html) Reload to refresh your session.    Dismiss alert       (https://github.com/kennethwolters) kennethwolters   / (litelm.html) litelm   Public   (https://github.com/login?return_to=%2Fkennethwolters%2Flitelm)   Notifications  You must be signed in to change notification settings  (https://github.com/login?return_to=%2Fkennethwolters%2Flitelm)   Fork (0) 0   (https://github.com/login?return_to=%2Fkennethwolters%2Flitelm)   Star  (59) 59        (litelm.html)   Code (Not available)    (https://github.com/kennethwolters/litelm/issues)    Issues (0) 0   (https://github.com/kennethwolters/litelm/pulls)   Pull requests (0) 0   (https://github.com/kennethwolters/litelm/actions)   Actions (Not available)    (https://github.com/kennethwolters/litelm/projects)   Projects (Not available)    (https://github.com/kennethwolters/litelm/security)   Security and quality (0) 0   (https://github.com/kennethwolters/litelm/pulse)   Insights (Not available)        Additional navigation options (litelm.html)    Code    (https://github.com/kennethwolters/litelm/issues)     Issues    (https://github.com/kennethwolters/litelm/pulls)    Pull requests    (https://github.com/kennethwolters/litelm/actions)    Actions    (https://github.com/kennethwolters/litelm/projects)    Projects    (https://github.com/kennethwolters/litelm/security)    Security and quality    (https://github.com/kennethwolters/litelm/pulse)    Insights                (litelm.html)          main           (https://github.com/kennethwolters/litelm/branches)    Branches   (https://github.com/kennethwolters/litelm/tags)    Tags    (https://github.com/kennethwolters/litelm/branches)    (https://github.com/kennethwolters/litelm/tags)          (Go to file) ()      Go to file        Code         Open more actions menu     Latest commit   History (https://github.com/kennethwolters/litelm/commits/main/)    69 Commits     (https://github.com/kennethwolters/litelm/commits/main/)      69 Commits      Folders and files Name  Name  (Last commit message) Last commit message   (Last commit date) Last commit date       (This path skips through empty directories) (https://github.com/kennethwolters/litelm/tree/main/.github/workflows) .github/ workflows         (This path skips through empty directories) (https://github.com/kennethwolters/litelm/tree/main/.github/workflows) .github/ workflows               (litelm) (https://github.com/kennethwolters/litelm/tree/main/litelm) litelm        (litelm) (https://github.com/kennethwolters/litelm/tree/main/litelm) litelm              (scripts) (https://github.com/kennethwolters/litelm/tree/main/scripts) scripts        (scripts) (https://github.com/kennethwolters/litelm/tree/main/scripts) scripts              (tests) (https://github.com/kennethwolters/litelm/tree/main/tests) tests        (tests) (https://github.com/kennethwolters/litelm/tree/main/tests) tests              (.gitignore) (https://github.com/kennethwolters/litelm/blob/main/.gitignore) .gitignore        (.gitignore) (https://github.com/kennethwolters/litelm/blob/main/.gitignore) .gitignore              (AGENTS.md) (https://github.com/kennethwolters/litelm/blob/main/AGENTS.md) AGENTS.md        (AGENTS.md) (https://github.com/kennethwolters/litelm/blob/main/AGENTS.md) AGENTS.md              (CHANGELOG.md) (https://github.com/kennethwolters/litelm/blob/main/CHANGELOG.md) CHANGELOG.md        (CHANGELOG.md) (https://github.com/kennethwolters/litelm/blob/main/CHANGELOG.md) CHANGELOG.md              (CLAUDE.md) (https://github.com/kennethwolters/litelm/blob/main/CLAUDE.md) CLAUDE.md        (CLAUDE.md) (https://github.com/kennethwolters/litelm/blob/main/CLAUDE.md) CLAUDE.md              (LICENSE) (https://github.com/kennethwolters/litelm/blob/main/LICENSE) LICENSE        (LICENSE) (https://github.com/kennethwolters/litelm/blob/main/LICENSE) LICENSE              (README.md) (https://github.com/kennethwolters/litelm/blob/main/README.md) README.md        (README.md) (https://github.com/kennethwolters/litelm/blob/main/README.md) README.md              (pyproject.toml) (https://github.com/kennethwolters/litelm/blob/main/pyproject.toml) pyproject.toml        (pyproject.toml) (https://github.com/kennethwolters/litelm/blob/main/pyproject.toml) pyproject.toml              (uv.lock) (https://github.com/kennethwolters/litelm/blob/main/uv.lock) uv.lock        (uv.lock) (https://github.com/kennethwolters/litelm/blob/main/uv.lock) uv.lock            View all files       Repository files navigation  (litelm.html#)    README   (litelm.html#)    MIT license     Moreitems               litelm (litelm.html#litelm)     (https://pypi.org/project/litelm/) (PyPI)  (https://pypi.org/project/litelm/) (Python)  (https://github.com/kennethwolters/litelm/actions/workflows/test.yml) (Tests)  (https://opensource.org/licenses/MIT) (License: MIT)   litellm's routing + translation in ~2,900 lines and 2 dependencies (openai , httpx ). litellm routes LLM calls across providers and translates between message formats. That core is buried under 100k+ LOC of proxy servers, caching layers, cost tracking, and dozens of features most users never touch. litelm extracts just the call path — model routing, message translation, streaming, tool use, embeddings — and nothing else. No Router class, no proxy, no caching. Install (litelm.html#install)     pip install litelm # openai + httpx pip install litelm[anthropic] # + anthropic SDK pip install litelm[bedrock] # + boto3 pip install litelm[all] # everything   Usage (litelm.html#usage)     import litelm # Basic completion response = litelm .completion ("openai/gpt-4o" , messages = [{"role" : "user" , "content" : "Hello!" }]) print (response .choices [0 ].message .content ) # Streaming for chunk in litelm .completion ("groq/llama-3.1-70b-versatile" , messages = [...], stream = True ): print (chunk .choices [0 ].delta .content or "" , end = "" ) # Embeddings response = litelm .embedding ("openai/text-embedding-3-small" , input = ["hello world" ])  Every function has an async variant: acompletion , aembedding , aresponses , atext_completion . The API mirrors litellm — same function names, same arguments, same response types. If you're using litellm today, switching is s/litellm/litelm/ in your imports. What's in / what's out (litelm.html#whats-in--whats-out)      litellm litelm   Model routing (provider/model → right endpoint) ✓ ✓  Message translation (Anthropic, Bedrock, Cloudflare, Mistral) ✓ ✓  Streaming + stream_chunk_builder  ✓ ✓  Tool use (function calling) ✓ ✓  Embeddings ✓ ✓  Text completions ✓ ✓  OpenAI Responses API ✓ ✓  Mock responses ✓ ✓  Router (load balancing, fallbacks) ✓ ✗  Proxy server ✓ ✗  Caching / budgeting / cost tracking ✓ ✗  Token counting ✓ ✗  Image gen, audio, OCR, fine-tuning ✓ ✗  Agents, guardrails, scheduler ✓ ✗     Providers (litelm.html#providers)     Routes to 19 providers via "provider/model-name" syntax. Any OpenAI-compatible endpoint works via api_base . Provider Env Var Handler Verified   OpenAI OPENAI_API_KEY  OpenAI SDK Yes  Anthropic ANTHROPIC_API_KEY  Custom Yes  Groq GROQ_API_KEY  OpenAI-compat Yes  Mistral MISTRAL_API_KEY  Custom Yes  xAI XAI_API_KEY  OpenAI-compat Yes  OpenRouter OPENROUTER_API_KEY  OpenAI-compat Yes  Azure AZURE_API_KEY  OpenAI SDK (Azure) Yes  Bedrock AWS_ACCESS_KEY_ID  Custom No  Cloudflare CLOUDFLARE_API_TOKEN  Custom No  Together TOGETHERAI_API_KEY  OpenAI-compat No  Fireworks FIREWORKS_API_KEY  OpenAI-compat No  DeepSeek DEEPSEEK_API_KEY  OpenAI-compat No  Perplexity PERPLEXITYAI_API_KEY  OpenAI-compat No  DeepInfra DEEPINFRA_API_TOKEN  OpenAI-compat No  Gemini GEMINI_API_KEY  OpenAI-compat No  Cohere COHERE_API_KEY  OpenAI-compat No  Ollama — OpenAI-compat No  vLLM — OpenAI-compat No  LM Studio — OpenAI-compat No     API Keys (litelm.html#api-keys)     Set the environment variable for your provider: export OPENAI_API_KEY=sk-... export ANTHROPIC_API_KEY=sk-ant-...  Or pass directly: litelm .completion ("openai/gpt-4o" , messages = [...], api_key = "sk-..." ) litelm .completion ("openai/gpt-4o" , messages = [...], api_base = "http://localhost:8000/v1" )  Error Handling (litelm.html#error-handling)     All provider errors are mapped to litelm's exception hierarchy: from litelm import ContextWindowExceededError , RateLimitError , AuthenticationError try : response = litelm .completion ("openai/gpt-4o" , messages = messages ) except ContextWindowExceededError : # prompt too long — truncate and retry pass except RateLimitError : # back off pass except AuthenticationError : # bad API key pass   Tool Calling (litelm.html#tool-calling)     tools = [{"type" : "function" , "function" : { "name" : "get_weather" , "parameters" : {"type" : "object" , "properties" : {"city" : {"type" : "string" }}},
}}] response = litelm .completion ( "openai/gpt-4o" , messages = [{"role" : "user" , "content" : "Weather in Paris?" }], tools = tools , tool_choice = "required" ,
) tool_call = response .choices [0 ].message .tool_calls [0 ] print (tool_call .function .name , tool_call .function .arguments )  Custom / Local Providers (litelm.html#custom--local-providers)     Any OpenAI-compatible server works via api_base : # vLLM litelm .completion ("openai/my-model" , messages = [...], api_base = "http://localhost:8000/v1" ) # Ollama litelm .completion ("ollama/llama3" , messages = [...], api_base = "http://localhost:11434/v1" ) # LM Studio litelm .completion ("openai/local-model" , messages = [...], api_base = "http://localhost:1234/v1" )  Development transparency (litelm.html#development-transparency)     litelm is human-directed, AI-assisted software. Much of the code was written with Claude Code using Claude Opus 4.6/4.7. Code written from 2026-05-14 onward is written through Pi using GPT-5.5. Compatibility claims are based on tests and maintainer review, not AI authorship. Upstream attestation (litelm.html#upstream-attestation)     Maintainer attestation, 2026-09-11: LiteLLM's routing/formatting changes were reviewed from 649eb2d through 9a715df2 . The audit triaged 360 core-path commits, inspected upstream tests for potentially relevant behavior, and fixed the resulting compatibility gaps test-first. Local scoped tests: 262 passed, 55 skipped ; all 45 available-provider live tests and all 10 DSPy smoke tests also passed with the current dependency lock. This attests litelm's declared routing/formatting/DSPy surface only, not full litellm compatibility. Status (litelm.html#status)     Alpha. 262 own tests passing. The current scoped LiteLLM 9a715df2 baseline has 75 passing ported tests and no remaining actionable assertion/runtime failures. (https://github.com/stanfordnlp/dspy) DSPy drop-in verified — all 7 execution paths proven live (Predict, CoT, typed signatures, streaming, embeddings, tool use, multi-output). Tests (litelm.html#tests)     uv run --extra all pytest tests/ -x --ignore=tests/ported --timeout=10 # 262 non-live tests bash scripts/ported_contract.sh # 49 fast upstream contract tests uv run --extra all pytest tests/test_live.py -m live --timeout=30 # 45 live provider tests uv run pytest tests/test_dspy_smoke.py -m live --timeout=60 # 10 DSPy integration tests   Live tests require API keys in .env.test . Skipped by default; run with -m live .          About  litellm without the bloat Resources  (litelm.html#readme-ov-file)   Readme   (litelm.html#MIT-1-ov-file)   MIT license   (https://github.com/kennethwolters/litelm/activity)   Activity   Stars    59 stars  Watchers    0 watching  Forks  (https://github.com/kennethwolters/litelm/forks)   0  forks   (https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fkennethwolters%2Flitelm&report=kennethwolters+%28user%29) Report repository    Releases     Used by    Contributors    Languages                            Footer (https://github.com)    © 2026 GitHub, Inc.   Footer navigation (https://docs.github.com/site-policy/github-terms/github-terms-of-service) Terms  (https://docs.github.com/site-policy/privacy-policies/github-privacy-statement) Privacy  (https://github.com/security) Security  (https://www.githubstatus.com/) Status  (https://github.community/) Community  (https://docs.github.com/) Docs  (https://support.github.com?tags=dotcom-footer) Contact  Manage cookies    Do not share my personal information              You can’t perform that action at this time.