WilburLe / gpt-neo

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

Home Page:https://www.eleuther.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This repository is not active

About

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

https://www.eleuther.ai

License:MIT License


Languages

Language:Python 53.9%Language:Jupyter Notebook 45.9%Language:Dockerfile 0.2%