Repository navigation

#

high-throughput

Running large language models on a single GPU for throughput-oriented scenarios.

Python
9357
10 个月前

A thread-safe queue faster and more resource efficient than golang's native channels

Go
684
1 年前
Java
506
4 年前

Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)

Python
488
4 个月前

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

Python
466
1 年前

atomate2 is a library of computational materials science workflows

Python
236
1 天前

[ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

Python
232
4 个月前

Realtime distributed messaging platform built using Go and React (Fullstack) ❤️

Go
223
6 个月前

quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.

Python
220
4 小时前

A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.

C++
72
2 年前

An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.

Java
58
1 天前

🔬🖥 Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes

Python
51
1 年前

A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs

Go
47
8 个月前

Full automation of relative protein-ligand binding free energy calculations in GROMACS

Python
45
4 年前
Java
40
3 年前

A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models

Python
35
15 天前

High-throughput molecular docking with multiple targets and ligands using Vina series engines

Python
32
5 年前