Repository navigation

#

self-attention

Website
Wikipedia

datawhalechina / leedl-tutorial

《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

机器学习深度学习 leedl-tutorial cnn reinforcement-learning transformer rnn Generative Adversarial Network pruning self-attention ChatGPT 教程 diffusion transfer-learning bert

Jupyter Notebook

14978

3011

16 天前

zhouhaoyi / Informer2020

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

深度学习 self-attention time-series PyTorch forecasting transformer

Python

5839

1208

16 天前

cmhungsteve / Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

transformer attention-mechanism vision-transformer 深度学习 Awesome Lists transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer 机器视觉 papers attention-mechanisms self-attention vit detr transformers

4836

492

9 个月前

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention Tensorflow neural-networks Python

Python

3339

661

3 年前

Diego999 / pyGAT

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention PyTorch neural-networks Python

Python

3020

696

2 年前

gordicaleksa/pytorch-GAT

gordicaleksa / pytorch-GAT

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

gat graph-attention-networks attention-mechanism self-attention PyTorch Python attention pytorch-gat gat-tutorial 深度学习 pytorch-implementation Jupyter Notebook

Jupyter Notebook

2530

333

2 年前

github / CodeSearchNet

Datasets, tools, and benchmarks for representation learning of code.

深度学习自然语言处理 programming-language-theory 机器学习 Tensorflow datasets 数据科学 machine-learning-on-source-code representation-learning neural-networks Python Open Data data cnn rnn self-attention bert

Jupyter Notebook

2287

399

3 年前

microsoft / DeBERTa

The implementation of DeBERTa

bert 深度学习 representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder

Python

2075

234

2 年前

speedinghzl / CCNet

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

cityscape semantic-segmentation self-attention PyTorch scene-parsing segmentation

Python

1457

279

4 年前

DirtyHarryLYL / Transformer-in-Vision

Recent Transformer-based CV and related works.

transformer vision-transformers 机器视觉 self-attention multi-modal 深度学习 Bukkit

1332

142

2 年前

NVlabs / MambaVision

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

深度学习 foundation-models image-classification mamba self-attention vision-transformer visual-recognition huggingface-transformers transformers instance-segmentation object-detection semantic-segmentation

Python

1302

68

21 天前

The-AI-Summer/self-attention-cv

The-AI-Summer / self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

深度学习 transformer transformers self-attention attention-mechanism attention 机器学习人工智能

Python

1200

154

4 年前

Separius / awesome-fast-attention

list of efficient attention modules

transformer attention Awesome Lists reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network

Python

999

108

4 年前

brightmart / bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning 自然语言处理 question-answering textcnn fasttext

Python

964

211

6 年前

NVlabs / FasterViT

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

ade20k Backbone.js 深度学习 pre-trained-model self-attention vision-transformer visual-recognition coco object-detection semantic-segmentation foundation-models image-classification

Python

844

68

1 个月前

xxxnell / how-do-vits-work

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

vision-transformer transformer self-attention PyTorch

Python

813

79

3 年前

prakashpandey9 / Text-Classification-Pytorch

Text classification using deep learning models in Pytorch

PyTorch text-classification sentiment-classification attention-model self-attention rnn-model glove

Python

811

240

6 年前

kaituoxu / Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

asr transformer end-to-end attention self-attention attention-is-all-you-need PyTorch

Python

786

196

2 年前

daiquocnguyen / Graph-Transformer

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

graph-representation-learning graph-neural-networks graph-embeddings self-attention transformer text-classification transformer-models graph-deep-learning

Python

666

77

3 年前

jayparks / transformer

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

self-attention attention-mechanism attention-is-all-you-need machine-translation

Python

556

122

5 年前