Repository navigation

llm-routing

Website
Wikipedia

The AI-native proxy server for agents. Arch handles the pesky heavy lifting in building agentic apps - routing prompts to agents or specific tools, clarifying input, unifying access and observability to any LLM - so you can build smarter and ship faster.

gateway generative-ai llm-inference llms prompt proxy proxy-server llmops openai Routing (disambiguation)ai-gateway llm-gateway llm-routing envoy envoyproxy

Rust

2403

130

3 天前

valaises / llm-proxy

Unified interface server for various LLM providers with OpenAI API format

FastAPI llm-routing llms

Python

1 个月前