llm-proxy

The smart edge and AI gateway for agents. Arch is a high-performance proxy server that handles the low-level work in building agents: like applying guardrails, routing prompts to the right agent, and unifying access to LLMs, etc. Natively designed to process prompts, it's framework-agnostic and helps you build agents faster.

Lightweight & fast AI inference proxy for self-hosted LLMs backends like Ollama, LM Studio and others. Designed for speed, simplicity and local-first deployments.

Open Source LLM proxy that transparently captures and logs all interactions with LLM API

Customize and Extend Claude Code with ccproxy: Route to OpenAI, Gemini, Qwen, OpenRouter, and Ollama. Gain full control of your Claude Max/Pro Subscription with your own router.

This is a robust and configurable LLM proxy server built with Node.js, Express, and PostgreSQL. It acts as an intermediary between your applications and various Large Language Model (LLM) providers

A personal LLM gateway with fault-tolerant capabilities for calls to LLM models from any provider with OpenAI-compatible APIs. Advanced features like retry, model sequencing, and body parameter injection are also available. Especially useful to work with AI coders like Cline and RooCode and providers like OpenRouter.

Allows any BYOK AI editor or extension, such as Cursor or Continue, to connect to any openai-compatible LLM by aliasing it as a different model

Proxy for many LLM-provider with OpenAI like request

Store your knowledge (privately), lead LLMs with it and cure hallucinations.

Configurable, interactive proxy server for all LLM hackers. Features API key rotation, protocol conversion, and piping API traffic through locally installed CLI apps like gemini-cli. Route any app to any remote LLM model or backend, override hardcoded models

A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics

[WIP] Sorai is a lightweight, high-performance, and open-source LLM proxy gateway.

A TypeScript wrapper to seamlessly route multiple Vercel AI providers by model name, offering unparalleled flexibility and extensibility for managing diverse AI services—inspired by the provider-routing architecture of litellm but optimized for TypeScript/Vercel workflows