Repository navigation

#

self-attention

Website
Wikipedia

datawhalechina / leedl-tutorial

《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

机器学习深度学习 leedl-tutorial cnn reinforcement-learning transformer rnn Generative Adversarial Network pruning self-attention ChatGPT 教程 diffusion transfer-learning bert

Jupyter Notebook

15821

3067

4 个月前

zhouhaoyi / Informer2020

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

深度学习 self-attention time-series PyTorch forecasting transformer

Python

6216

1268

3 个月前

cmhungsteve / Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

transformer attention-mechanism vision-transformer 深度学习 Awesome Lists transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer 机器视觉 papers attention-mechanisms self-attention vit detr transformers

4929

496

1 年前

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention Tensorflow neural-networks Python

Python

3425

671

3 年前

Diego999 / pyGAT

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention PyTorch neural-networks Python

Python

3067

706

2 年前

gordicaleksa/pytorch-GAT

gordicaleksa / pytorch-GAT

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

gat graph-attention-networks attention-mechanism self-attention PyTorch Python attention pytorch-gat gat-tutorial 深度学习 pytorch-implementation Jupyter Notebook

Jupyter Notebook

2599

347

3 年前

github / CodeSearchNet

Datasets, tools, and benchmarks for representation learning of code.

深度学习自然语言处理 programming-language-theory 机器学习 Tensorflow datasets 数据科学 machine-learning-on-source-code representation-learning neural-networks Python Open Data data cnn rnn self-attention bert

Jupyter Notebook

2375

408

4 年前

microsoft / DeBERTa

The implementation of DeBERTa

bert 深度学习 representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder

Python

2154

236

2 年前

NVlabs / MambaVision

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

深度学习 foundation-models image-classification mamba self-attention vision-transformer visual-recognition huggingface-transformers transformers instance-segmentation object-detection semantic-segmentation

Python

1771

100

2 个月前

speedinghzl / CCNet

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

cityscape semantic-segmentation self-attention PyTorch scene-parsing segmentation

Python

1474

277

5 年前

DirtyHarryLYL / Transformer-in-Vision

Recent Transformer-based CV and related works.

transformer vision-transformers 机器视觉 self-attention multi-modal 深度学习 Bukkit

1334

141

2 年前

The-AI-Summer/self-attention-cv

The-AI-Summer / self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

深度学习 transformer transformers self-attention attention-mechanism attention 机器学习人工智能

Python

1211

155

4 年前

Separius/awesome-fast-attention

Separius / awesome-fast-attention

list of efficient attention modules

transformer attention Awesome Lists reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network

Python

1012

106

4 年前

brightmart / bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning 自然语言处理 question-answering textcnn fasttext

Python

965

211

7 年前

NVlabs / FasterViT

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

ade20k Backbone.js 深度学习 pre-trained-model self-attention vision-transformer visual-recognition coco object-detection semantic-segmentation foundation-models image-classification

Python

882

66

2 个月前

xxxnell / how-do-vits-work

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

vision-transformer transformer self-attention PyTorch

Python

820

79

3 年前

prakashpandey9 / Text-Classification-Pytorch

Text classification using deep learning models in Pytorch

PyTorch text-classification sentiment-classification attention-model self-attention rnn-model glove

Python

815

235

7 年前

kaituoxu / Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

asr transformer end-to-end attention self-attention attention-is-all-you-need PyTorch

Python

804

197

2 年前

daiquocnguyen / Graph-Transformer

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

graph-representation-learning graph-neural-networks graph-embeddings self-attention transformer text-classification transformer-models graph-deep-learning

Python

676

76

3 年前

jayparks / transformer

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

self-attention attention-mechanism attention-is-all-you-need machine-translation

Python

563

123

5 年前