transformer-architecture

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Inference Llama 2 in one file of pure 🔥

Self-contained Machine Learning and Natural Language Processing library in Go

Code for CRATE (Coding RAte reduction TransformEr).

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

Implementation of the Swin Transformer in PyTorch.

Minimalist NMT for educational purposes

🌕 [BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

[ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...

The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

This repo contains the updated version of all the assignments/labs (done by me) of Deep Learning Specialization on Coursera by Andrew Ng. It includes building various deep learning models from scratch and implementing them for object detection, facial recognition, autonomous driving, neural machine translation, trigger word detection, etc.

SeqFormer: Sequential Transformer for Video Instance Segmentation (ECCV 2022 Oral)

PyContinual (An Easy and Extendible Framework for Continual Learning)

Attention Is All You Need | a PyTorch Tutorial to Transformers

IEEE TNNLS 2021, transformer, multi-graph transformer, graph, graph classification, sketch recognition, sketch classification, free-hand sketch, official code of the paper "Multi-Graph Transformer for Free-Hand Sketch Recognition"