Repository navigation

#

qwq

johnbean393/Sidekick

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

Swift
2771
6 小时前

Ollama负载均衡服务器 | 一款高性能、易配置的开源负载均衡服务器,优化Ollama负载。它能够帮助您提高应用程序的可用性和响应速度,同时确保系统资源的有效利用。

134
1 个月前

Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

Python
130
2 天前

Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache

Python
83
1 天前

A user-friendly Command-line/SDK tool that makes it quickly and easier to deploy open-source LLMs on AWS

Python
34
2 天前

🔥🔥🔥Breaking long thought processes of o1-like LLMs, such as DeepSeek-R1, QwQ

Python
28
1 个月前

多文件多密钥加密成一个大文件. 给一个正确的密钥,可以提取对应文件. 用于在受到胁迫的情况下隐藏文件.

C++
13
3 年前

A modern, silky-smooth UI framwork built on RsPack.

TypeScript
7
1 个月前

Support deepseek online and local model interaction.

Go
6
1 个月前

大文件分卷混淆为小图片

Python
1
4 年前

一个key/文件生成n个keyfile,获取其中任意m个即可还原key/解密原文件.

Python
0
3 年前

i created better operating system, except it doesn't work...

HTML
0
2 个月前

简单的混淆,可用于网盘文件防封。

C++
0
2 年前

只能压ASCII数据...

C++
0
4 年前

Breaking long thought processes of o1-like LLMs, such as DeepSeek-R1, QwQ

Python
0
1 个月前