transformer-xl

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

End-to-end ASR/LM implementation with PyTorch

An implementation of Google Brain's 2019 XLNet in PyTorch

Clean baseline implementation of PPO using an episodic TransformerXL memory

XLNet for generating language.

Challenging Memory-based Deep Reinforcement Learning Agents

Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transformer technology (Google XLNet/Transformer-XL)

Transformer-XL with checkpoint loader

custom cuda kernel for {2, 3}d relative attention with pytorch wrapper

A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)

Music and text generation with Transformer-XL.

[ACL‘20] Highway Transformer: A Gated Transformer.

2020 阿里云天池大数据竞赛-中医药文献问题生成挑战赛

Symbolic music generation taking inspiration from NLP and human composition process

Fair quantitative comparison of NLP embeddings from GloVe to RoBERTa with Sequential Bayesian Optimization fine-tuning using Flair and SentEval. Extension of HyperOpt library to log_b priors.

YAI 11 x @POZAlabs : Improving & Evaluating Music Generation with ComMU

A refactored version of kimiyoung / transformer-xl/tf

Google Colab based on a fork of REMI repo. Try this incredible REMI Pop Music Transformer easily and quickly :)

Absolutely fantastic and fully working SOTA Transformer-XL Music AI implementation MahlerNet by Elias Lousseief