Repository navigation

#

linformer

Website
Wikipedia

Separius / awesome-fast-attention

list of efficient attention modules

transformer attention Awesome Lists reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network

Python

999

108

4 年前

tatp22 / linformer-pytorch

My take on a practical implementation of Linformer for Pytorch.

人工智能深度学习 attention-mechanism PyTorch 机器学习 linformer Bukkit

Python

413

37

3 年前

kuixu / Linear-Multihead-Attention

Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)

linformer detr transformer attention-mechanism

Python

76

14

5 年前

pranavphoenix / VisionXformer

Vision Xformers

attention-mechanism 深度学习 transformer efficient gpu-computing linformer Image classification vision

Python

21

7

2 年前

MaxLSB / linformer

linformer implementation and comparison with vanilla transformers

attention-mechanism linformer 机器学习自然语言处理 Python PyTorch

Jupyter Notebook

2

0

3 个月前

anto18671 / lumenspark

Lumenspark is a lightweight Linformer-based Language Model Trained from Scratch

linformer 大语言模型 text-classification text-generation training transformer pretraining runpod

Python

1

0

6 个月前