Repository navigation

#

gpt-neo

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

Python
437
2 年前

SkyCode是一个多语言开源编程大模型,采用GPT3模型结构,支持Java, JavaScript, C, C++, Python, Go, shell等多种主流编程语言,并能理解中文注释。模型可以对代码进行补全,拥有强大解题能力,使您从编程中解放出来,专心于解决更重要的问题。| SkyCode is an open source programming model, which adopts the GPT3 model structure. It supports Java, JavaScript, C, C++, Python, Go, shell and other languages, and can understand Chinese comments.

394
2 年前

Salesforce codegen with web server

Python
193
4 个月前

QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.

Python
163
6 个月前

A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.

Jupyter Notebook
115
3 年前

Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression

Jupyter Notebook
66
3 年前

Colab notebooks to run a basic AI Dungeon clone using gpt-neo-2.7B

Jupyter Notebook
64
4 年前

A basic ui for running gpt neo 2.7B on low vram (3 gb Vram minimum)

Jupyter Notebook
36
4 年前

Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance

Python
28
2 年前

Hebrew text generation models based on EleutherAI's gpt-neo. Each was trained on a TPUv3-8 made avilable via TPU Research Cloud Program.

Jupyter Notebook
22
3 年前

Auto-generate an entire paper from a prompt or abstract using NLP

Jupyter Notebook
20
2 年前

Few Shot Learning using EleutherAI's GPT-Neo an Open-source version of GPT-3

Jupyter Notebook
18
4 年前

📝 Amazon product description generator using GPT-Neo for Texta.ai

Jupyter Notebook
15
3 年前

A notebook that runs GPT-Neo with low vram (6 gb) and cuda acceleration by loading it into gpu memory in smaller parts.

Jupyter Notebook
14
4 年前

Codebase for Linguistic Collapse: Neural Collapse in (Large) Language Models [NeurIPS 2024] [arXiv:2405.17767]

Python
11
6 天前

I am using this to load gpt-j-6b to prevent excessive ram usage

Jupyter Notebook
8
4 年前

AI Text Generator : Friedrich Nietzsche

CSS
4
2 年前

Automate GPT3 website-login.

Python
4
2 年前

Automated Debate Scoring

Jupyter Notebook
3
3 年前