vllm-operator

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

This Repository contains terraform configuration for vllm production-stack in the cloud managed K8s