Repository navigation

#

memory-optimization

MemoRizz: A Python library serving as a memory layer for AI applications. Leverages popular databases and storage solutions to optimize memory usage. Provides utility classes and methods for efficient data management, including MongoDB integration and OpenAI embeddings for semantic search capabilities.

Python
533
2 天前

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.

Python
356
3 个月前

A fast and memory-optimized string library for heavy-text manipulation in Python

Python
250
5 年前

Contains materials about memory optimization and zero-allocation samples.

C#
127
2 年前

This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.

Python
92
2 年前

A performant and memory efficient storage for immutable strings with C++17. Supports all standard char types: char, wchar_t, char16_t, char32_t and C++20's char8_t.

C++
56
3 年前

A curated list of awesome optimizations that you can do to improve your redis deployment (both client side and server side).

32
4 年前

🚀 Zero-config automatic memory allocator for Rust - just add one line and get up to 1.6x faster allocation performance across all platforms

Rust
24
2 个月前

An extension of micro mouse on WEBOTS using the flood filled algorithm, A star, Dijkstra’s and Breadth first search algorithm for moving the E-puck robot from start to goal in an NxM sized maze whose map was unknown to the robot (mapping and path planning). Further, leveraged Error Correction for accurate turning and recursive Backtracking algorithm for Maze Generation

C++
22
4 年前

Implementation of DAC'22 paper: Hierarchical Memory-Constrained Operator Scheduling of Neural Architecture Search Networks.

C++
10
3 年前

"Ultimate Windows Booster" is a tool designed to optimize your Windows operating system by cleaning junk files, managing startup programs, and improving resource usage for better performance.

C#
7
8 个月前

Rapid In-Memory Redis Interface or RiRi is a real time key-value data engine, providing rapid access/inserts to/on memory. You're Welcome :)

C++
6
8 天前

Portable RAM optimizer that clears unused memory. No installation, no UI — just a tray icon

C#
5
11 小时前

Automatically reduce the memory size of any pandas dataframe based on downcasting bit types efficiently

Python
4
6 年前

FIDE & Google Efficient Chess AI Challenge - Create agents to play chess with resource constraints

C
3
5 个月前