# litellm

LiteLLM is an open-source AI gateway and Python SDK that provides a unified OpenAI-compatible interface for accessing multiple large language models, with routing, retries, authentication, cost tracking, and rate limiting.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## AI gateways: why and how

DevFeed: [AI gateways: why and how](<https://devfeed.tech/articles/ai-gateways-why-and-how-18916.md>)

Original publisher: [Read original article](<https://blog.frankel.ch/ai-gateways/>)

Author: Nicolas Fränkel

Published: 2026-05-31T00:00:00Z

Content type: article

Language: en

Sources: [Nicolas Fränkel](<https://devfeed.tech/sources/nicolas-frankel.md>)

Topics: [Amazon API Gateway](<https://devfeed.tech/topics/amazon-api-gateway.md>), [LLMs](<https://devfeed.tech/topics/llms.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [Security](<https://devfeed.tech/topics/security.md>), [litellm](<https://devfeed.tech/topics/litellm.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Load Balancing](<https://devfeed.tech/topics/load-balancing.md>), [observability](<https://devfeed.tech/topics/observability.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [api-gateway](<https://devfeed.tech/tags/api-gateway.md>), [backend](<https://devfeed.tech/tags/backend.md>), [caching](<https://devfeed.tech/tags/caching.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [coding-assistant](<https://devfeed.tech/tags/coding-assistant.md>), [decoupling](<https://devfeed.tech/tags/decoupling.md>), [devstral](<https://devfeed.tech/tags/devstral.md>), [gateway](<https://devfeed.tech/tags/gateway.md>), [litellm](<https://devfeed.tech/tags/litellm.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llms](<https://devfeed.tech/tags/llms.md>), [load-balancing](<https://devfeed.tech/tags/load-balancing.md>), [mistral](<https://devfeed.tech/tags/mistral.md>), [observability](<https://devfeed.tech/tags/observability.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [routing](<https://devfeed.tech/tags/routing.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [security](<https://devfeed.tech/tags/security.md>), [technical](<https://devfeed.tech/tags/technical.md>)

### AI overview

This article explains how AI gateways apply the API gateway pattern to AI clients and LLM backends. It discusses using a gateway to centralize model and provider management, governance, cost control, routing, caching, failover, load balancing, and observability, and considers routing Claude Code requests to another provider.

### Source excerpt

Before working for 2 years on the Apache APISIX API gateway, I was mainly oblivious to API gateways. It's only by working with them that I understood their value. Decoupling the client and the server unlocks a lot of options: moving authentication to the API Gateway, securing APIs, deduplicating API requests, etc. In this post, I want to describe how the same pattern applies to AI. AI gateways AI gateways work in a similar way.

## Cyber resiliency in practice: Lessons from recent supply chain attacks

DevFeed: [Cyber resiliency in practice: Lessons from recent supply chain attacks](<https://devfeed.tech/articles/cyber-resiliency-in-practice-lessons-from-recent-supply-chain-attacks-13017.md>)

Original publisher: [Read original article](<https://www.chainguard.dev/unchained/cyber-resiliency-in-practice-lessons-from-recent-supply-chain-attacks>)

Published: 2026-05-08T00:00:00Z

Content type: article

Language: en

Sources: [Chainguard: Unchained](<https://devfeed.tech/sources/chainguard-unchained.md>)

Topics: [resiliency](<https://devfeed.tech/topics/resiliency.md>), [supply chain attacks](<https://devfeed.tech/topics/supply-chain-attacks.md>), [supply-chain-security](<https://devfeed.tech/topics/supply-chain-security.md>), [axios](<https://devfeed.tech/topics/axios.md>), [GitHub Actions](<https://devfeed.tech/topics/github-actions.md>), [litellm](<https://devfeed.tech/topics/litellm.md>), [trivy](<https://devfeed.tech/topics/trivy.md>), [npm](<https://devfeed.tech/topics/npm.md>), [PyPI](<https://devfeed.tech/topics/pypi.md>), [Python](<https://devfeed.tech/topics/python.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [axios](<https://devfeed.tech/tags/axios.md>), [chainguard-libraries](<https://devfeed.tech/tags/chainguard-libraries.md>), [cyber-resiliency](<https://devfeed.tech/tags/cyber-resiliency.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [github-actions](<https://devfeed.tech/tags/github-actions.md>), [litellm](<https://devfeed.tech/tags/litellm.md>), [malware](<https://devfeed.tech/tags/malware.md>), [npm](<https://devfeed.tech/tags/npm.md>), [pypi](<https://devfeed.tech/tags/pypi.md>), [python](<https://devfeed.tech/tags/python.md>), [security](<https://devfeed.tech/tags/security.md>), [security-attacks](<https://devfeed.tech/tags/security-attacks.md>), [social-engineering](<https://devfeed.tech/tags/social-engineering.md>), [software-supply-chain-security](<https://devfeed.tech/tags/software-supply-chain-security.md>), [supply-chain-attacks](<https://devfeed.tech/tags/supply-chain-attacks.md>), [trivy](<https://devfeed.tech/tags/trivy.md>), [worm](<https://devfeed.tech/tags/worm.md>)

### AI overview

The article defines cyber resiliency as an integrated ability to anticipate, withstand, recover from, and adapt to attacks across the full Protect, Detect, Respond, and Recover lifecycle. It examines recent supply chain attacks involving Trivy, Axios, and LiteLLM, highlighting risks such as GitHub Actions misconfiguration, long-lived tokens, incomplete credential rotation, mutable Git tags, maintainer-account compromise, and malicious package releases.

### Source excerpt

Learn how modern cyber resiliency helps organizations prevent, detect, and recover from supply chain attacks like Trivy, Axios, and LiteLLM.

## Security Week 2614: атака класса supply chain на библиотеку LiteLLM

DevFeed: [Security Week 2614: атака класса supply chain на библиотеку LiteLLM](<https://devfeed.tech/articles/security-week-2614-supply-chain-litellm-23064.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/kaspersky/articles/1016674/>)

Author: Kaspersky\_Lab ("Лаборатория Касперского")

Published: 2026-03-30T17:00:04Z

Content type: news

Language: ru

Sources: ["Лаборатория Касперского" RU](<https://devfeed.tech/sources/ru-2.md>)

Topics: [litellm](<https://devfeed.tech/topics/litellm.md>), [Security](<https://devfeed.tech/topics/security.md>), [PyPI](<https://devfeed.tech/topics/pypi.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [discord](<https://devfeed.tech/tags/discord.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [litellm](<https://devfeed.tech/tags/litellm.md>), [pypi](<https://devfeed.tech/tags/pypi.md>), [python](<https://devfeed.tech/tags/python.md>), [security](<https://devfeed.tech/tags/security.md>), [slack](<https://devfeed.tech/tags/slack.md>), [ssh](<https://devfeed.tech/tags/ssh.md>), [supply-chain](<https://devfeed.tech/tags/supply-chain.md>), [tag-9fe8963de219](<https://devfeed.tech/tags/tag-9fe8963de219.md>), [terraform](<https://devfeed.tech/tags/terraform.md>), [tls](<https://devfeed.tech/tags/tls.md>)

### AI overview

The article reports a supply-chain compromise affecting LiteLLM versions 1.82.7 and 1.82.8 uploaded to PyPI. The malicious code searched victims' systems for files, credentials, secrets, and cloud infrastructure data, could contact a command server, and included Kubernetes persistence capabilities. Researchers also found similar malware in two Checkmarx extensions; the malicious versions were removed, and affected users were advised to rotate credentials and secrets.

### Source excerpt

Громкой новостью прошлой недели стал взлом библиотеки LiteLLM, используемой в качестве посредника для коммуникации с большим количеством языковых моделей (сообщение от разработчиков, новость на Хабре). Через другое вредоносное приложение на Python была взломана учетная запись мейнтейнера проекта, после чего сразу две версии LiteLLM (1.82.7 и 1.82.8) с вредоносными модулями были загружены в репозиторий PyPI. Отчет с анализом вредоносного кода опубликовали эксперты "Лаборатории Касперского". В версии 1.82.7 вредоносный код был встроен в файл proxy_server.py. В версии 1.82.8 дополнительно появился .pth-файл, благодаря которому вредоносный код выполнялся при каждом запуске интерпретатора, даже если зараженная библиотека не использовалась. После запуска зараженный скрипт начинал рекурсивный обход рабочих директорий в системе жертвы. В каждой директории скрипт просматривал содержимое файлов, которое выводил в буфер stdout и сохранял в файл для последующей отправки на командный сервер злоумышленников. Далее скрипт собирал информацию о системе и также сохранял в файл. После этого он переходил к поиску конфиденциальных данных, включая следующие типы: Читать далее

## The litellm PyPI compromise and how Chainguard Libraries blocked malicious releases

DevFeed: [The litellm PyPI compromise and how Chainguard Libraries blocked malicious releases](<https://devfeed.tech/articles/you-were-one-pip-install-away-from-the-litellm-breach-chainguard-customers-weren-t-13344.md>)

Original publisher: [Read original article](<https://www.chainguard.dev/unchained/you-were-one-pip-install-away-from-a-breach-chainguard-customers-werent>)

Published: 2026-03-24T00:00:00Z

Content type: article

Language: en

Sources: [Chainguard: Unchained](<https://devfeed.tech/sources/chainguard-unchained.md>)

Topics: [litellm](<https://devfeed.tech/topics/litellm.md>), [chainguard libraries](<https://devfeed.tech/topics/chainguard-libraries.md>), [open-source-security](<https://devfeed.tech/topics/open-source-security.md>)

Tags: [chainguard-libraries](<https://devfeed.tech/tags/chainguard-libraries.md>), [chainguard-libraries-for-python](<https://devfeed.tech/tags/chainguard-libraries-for-python.md>), [litellm](<https://devfeed.tech/tags/litellm.md>), [litellm-attack](<https://devfeed.tech/tags/litellm-attack.md>), [litellm-package](<https://devfeed.tech/tags/litellm-package.md>), [litellm-supply-chain-attack](<https://devfeed.tech/tags/litellm-supply-chain-attack.md>), [open-source-security](<https://devfeed.tech/tags/open-source-security.md>), [pypi](<https://devfeed.tech/tags/pypi.md>), [secure-packages](<https://devfeed.tech/tags/secure-packages.md>), [security](<https://devfeed.tech/tags/security.md>), [supply-chain-attacks](<https://devfeed.tech/tags/supply-chain-attacks.md>)

### AI overview

The article describes a litellm compromise on PyPI in which malicious releases were used to steal secrets. It states that Chainguard Libraries prevented exposure by rebuilding only verified source and blocking the malicious releases.

### Source excerpt

Hackers compromised litellm on PyPI to steal secrets. Chainguard Libraries prevented exposure by rebuilding only verified source, blocking malicious releases.

## Introducing the DigitalOcean AI Ecosystem

DevFeed: [Introducing the DigitalOcean AI Ecosystem](<https://devfeed.tech/articles/introducing-the-digitalocean-ai-ecosystem-19896.md>)

Original publisher: [Read original article](<https://www.digitalocean.com/blog/introducing-the-digitalocean-ai-ecosystem>)

Author: Meghan Grady

Published: 2025-10-06T20:07:17Z

Content type: release

Language: en

Sources: [DigitalOcean](<https://devfeed.tech/sources/digitalocean.md>)

Topics: [Digital Ocean](<https://devfeed.tech/topics/digital-ocean.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [litellm](<https://devfeed.tech/topics/litellm.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amd](<https://devfeed.tech/tags/amd.md>), [build](<https://devfeed.tech/tags/build.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [dev-tools](<https://devfeed.tech/tags/dev-tools.md>), [digitalocean](<https://devfeed.tech/tags/digitalocean.md>), [gradient-platform](<https://devfeed.tech/tags/gradient-platform.md>), [integrations](<https://devfeed.tech/tags/integrations.md>), [meta](<https://devfeed.tech/tags/meta.md>), [models](<https://devfeed.tech/tags/models.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [openai](<https://devfeed.tech/tags/openai.md>), [partner](<https://devfeed.tech/tags/partner.md>)

### AI overview

DigitalOcean announced an expansion of its AI Ecosystem and introduced the DigitalOcean AI Partner Program. Through the Gradient AI Agent Cloud, the ecosystem brings together infrastructure, AI models, development tools, integration frameworks, and specialist partners for building AI applications.

### Source excerpt

Last week at Deploy London, we announced a significant expansion of our offerings within the DigitalOcean AI Ecosystem and introduced the DigitalOcean AI Partner Program. A platform is only as strong as its ecosystem, and these initiatives are designed to create a comprehensive, flexible, and powerful environment for startups, builders, and developers to create the next generation of AI applications. Explore What's Possible with the DigitalOcean AI Ecosystem We're collaborating with industry leaders and innovative startups to provide access to all of the AI products and services you need through the Gradient AI Agent Cloud. DigitalOcean's comprehensive AI Ecosystem empowers startups and enterprises to build next-gen AI applications, offering choice and flexibility through embedded partner integrations and workflows. DigitalOcean's AI Ecosystem provides access to: Powerful Infrastructure: Efficient AMD and NVIDIA GPUs to power your applications. Advanced Models: Access to leading models from companies like OpenAI, DeepSeek, Meta, and Mistral. Applications & Frameworks: Popular AI dev tools and integration frameworks such as LangChain, LiteLLM, and dStack. Integrators: A network of AI specialists to help you migrate workflows and build robust new AI implementations. The DigitalAI Ecosystem "At the heart of AI's progress are the developers who are turning ideas into reality. The Gradient AI Ecosystem is a powerful force multiplier for them, proving that the future isn't just about silicon--it's about software and the collaborative community built on top of it," said Anush Elangovan, VP of AI Software at AMD. "By providing high-performance AMD GPUs through DigitalOcean's Gradient AI Agentic Cloud, we ensure the ecosystem is powered by world-class, open-standard hardware. We're not just providing infrastructure; together we're powering the software and the community that will invent tomorrow's AI." Through the dynamic Gradient AI Ecosystem, AI startups and digital native