localllama

✨ Kubectl plugin to create manifests with LLMs

The easiest way to use the Ollama API in .NET

Model swapping for llama.cpp (or any local OpenAPI compatible server)

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

Social and customizable AI writing assistant! ✍️

A local and uncensored AI entity.

LLM RAG Application with Cross-Encoders Re-ranking for YouTube video 🎥

Full featured demo application for OllamaSharp

Run gguf LLM models in Latest Version TextGen-webui

Use your open source local model from the terminal

Copilot hack for running local copilot without auth and proxying

A chat interface in Streamlit for LLMs using Ollama.

Local AI Search assistant web or CLI for ollama and llama.cpp. Lightweight and easy to run, providing a Perplexity-like experience.

This project allows you to run your own local Large Language Model (LLM) chatbot using an API like Ollama.

Summarize emails received by Thunderbird mail client extension via locally run LLM. Early development.

A powerful shell that's powered by a locally running LLM (ideally Llama 3.x or Qwen 2.5)