triton

Efficient Triton Kernels for LLM Training

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

A service for autodiscovery and configuration of applications running in containers

Playing with the Tigress software protection. Break some of its protections and solve their reverse engineering challenges. Automatic deobfuscation using symbolic execution, taint analysis and LLVM.

🚀🚀🚀A collection of some wesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

FlagGems is an operator library for large language models implemented in Triton Language.

Linux kernel module to support Turbo mode and RGB Keyboard for Acer Predator notebook series

A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.

Automatic ROPChain Generation

🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.

LLVM based static binary analysis framework

OpenDILab RL HPC OP Lib, including CUDA and Triton kernel

SymGDB - symbolic execution plugin for gdb

A performance library for machine learning applications.

Ozoz dotfiles for bspwm, i3WM

ClearML - Model-Serving Orchestration and Repository Solution

NVIDIA-accelerated, deep learned model support for image space object detection

(WIP)The deployment framework aims to provide a simple, lightweight, fast integrated, pipelined deployment framework for algorithm service that ensures reliability, high concurrency and scalability of services.