Repository navigation

#

on-device-llms

Lizonghang / prima.cpp 

prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters

distributed-aillm-inferenceon-device-llmsllama-cppdistributed-inference
C++
473
4 天前
Mehdi-Letafati / multi-agent-workflows-from-scratch 

Multi-agent workflows with Llama3: A private on-device multi-agent framework

agentic-frameworkagentic-workflowgenerative-ailarge-language-modelsllama3Pythonon-device-llms
Python
3
1 年前