Repository navigation

#

4-bits

intel / intel-extension-for-transformers 

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

large-language-model聊天机器人4-bitsllm-inferencellm-cpuchatpdfstreamingllmintel-optimized-llamacppspeculative-decodinghabanaragretrieval
Python
2169
6 个月前