gemm

Fast inference engine for Transformer models

Tuned OpenCL BLAS

BLISlab: A Sandbox for Optimizing GEMM

Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

Optimizing SGEMM kernel functions on NVIDIA GPUs to a close-to-cuBLAS performance.

Multi-Threaded FP32 Matrix Multiplication on x86 CPUs

🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.

The HPC toolbox: fused matrix multiplication, convolution, data-parallel strided tensor primitives, OpenMP facilities, SIMD, JIT Assembler, CPU detection, state-of-the-art vectorized BLAS for floats and integers

[DEPRECATED] Moved to ROCm/rocm-libraries repo

Stepwise optimizations of DGEMM on CPU, reaching performance faster than Intel MKL eventually, even under multithreading.

DBCSR: Distributed Block Compressed Sparse Row matrix library

Single file libraries for C/C++

[DEPRECATED] Moved to ROCm/rocm-libraries repo

A Flexible and Energy Efficient Accelerator For Sparse Convolution Neural Network

FP64 equivalent GEMM via Int8 Tensor Cores using the Ozaki scheme

PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu

Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.

Serial and parallel implementations of matrix multiplication

The simplest but fast implementation of matrix multiplication in CUDA.