gpt2

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

中文nlp解决方案(大模型、数据、模型、训练、推理)

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

RoBERTa中文预训练模型: RoBERTa for Chinese

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLOOM，GPT2，Seq2Seq，BART，T5，UDA等模型的训练和预测，开箱即用。

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Pre-trained Transformers for Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic ELECTRA)

A PyTorch implementation of "Graph Wavelet Neural Network" (ICLR 2019)

Code for producing Japanese pretrained models provided by rinna Co., Ltd.

Easy-to-use CPM for Chinese text generation（基于CPM的中文文本生成）

NLP 领域常见任务的实现，包括新词发现、以及基于pytorch的词向量、中文文本分类、实体识别、摘要文本生成、句子相似度判断、三元组抽取、预训练模型等。

MindSpore online courses: Step into LLM

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

1. Use BERT, ALBERT and GPT2 as tensorflow2.0's layer. 2. Implement GCN, GAN, GIN and GraphSAGE based on message passing.

PyTorch Implementation of OpenAI GPT-2