Repository navigation

#

high-throughput

Running large language models on a single GPU for throughput-oriented scenarios.

Python
9305
6 个月前

A thread-safe queue faster and more resource efficient than golang's native channels

Go
674
1 年前
Java
506
3 年前

Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)

Python
482
9 个月前

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

Python
438
9 个月前

quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.

Python
212
3 天前

atomate2 is a library of computational materials science workflows

Python
206
5 天前

Realtime distributed messaging platform built using Go and React (Fullstack) ❤️

Go
205
2 个月前

ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

Python
157
6 个月前

A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.

C++
71
1 年前

An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.

Java
56
2 天前

🔬🖥 Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes

Python
47
10 个月前

A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs

Go
47
4 个月前

Full automation of relative protein-ligand binding free energy calculations in GROMACS

Python
44
4 年前
Java
38
2 年前

High-throughput molecular docking with multiple targets and ligands using Vina series engines

Python
31
5 年前

MatID is a python package for identifying and analyzing atomistic systems based on their structure. MatID is designed to help researchers in the automated analysis and labeling of atomistic datasets.

Python
23
1 年前