Repository navigation

#

inference-platform

Website
Wikipedia

bentoml/BentoML

bentoml / BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

model-serving mlops llmops generative-ai llm-inference model-inference-service inference-platform 深度学习 llm-serving 机器学习 Python multimodal ml-engineering 大语言模型 ai-inference

Python

7996

869

2 天前

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

Kubernetes 大语言模型 llamacpp sglang vllm huggingface modelscope ollama inference inference-platform

Go

239

37

2 天前