Repository navigation

heterogeneous-cluster

Website
Wikipedia

Simple, scalable AI model deployment on GPU clusters

ascend CUDA deepseek distributed-inference genai inference llama llamacpp 大语言模型 maas metal openai qwen rocm vllm mindie llm-inference llm-serving local-ai heterogeneous-cluster

Python

3800

383

7 天前

Fahadfk / AI_deployment

Comprehensive guide to FastAPI, Pydantic, and SQLAlchemy for AI engineers. Learn API design, validation, and ORM workflows with practical examples and setup 🐙

ai-agent ChatGPT creative generative-ai heterogeneous-cluster hpc huggingface llama3 大语言模型 llm-inference local-ai maas 机器学习 metal openai Python rag

2 天前