litellm

LiteLLM is an open-source AI Gateway designed to provide a unified interface for interacting with over 100 LLM providers, including OpenAI and Anthropic, using the OpenAI format. It can be utilized as a Python SDK for direct integration or deployed as a centralized proxy server for organizational use, streamlining the management of LLM calls by standardizing API interactions across diverse service providers. Notable features include a simplified API, support for multiple deployment options, and enterprise readiness.