Open LLM Proxy

View Source on GitHub

alankyshum/open-llm-proxy

open-llm-proxy is a LiteLLM-based Router proxy with an open-llm-proxy CLI for serving, setup, configuration, model discovery, and the Admin UI.

TypeScriptLLMCloudflareRouting

Open LLM Proxy

Open LLM Proxy provides provider-based routing across LLM providers, so requests land on whichever backend fits the job.

The project is a lightweight LiteLLM Router proxy with a command-line interface.