Repository navigation

#

4-bits

intel / intel-extension-for-transformers 

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

大语言模型聊天机器人4-bitsllm-inferencellm-cpuchatpdfstreamingllmintel-optimized-llamacppspeculative-decodinghabanaragretrieval
Python
2165
1 年前