Giters

opentensor / mem-pytorch

incredibly efficient GPT

Repository from Github https://github.comopentensor/mem-pytorchRepository from Github https://github.comopentensor/mem-pytorch

MEM-Pytorch

⚠️ This repo is under active development. ⚠️

This repo is experiments in reproducing a GPT flash attention model.

About

incredibly efficient GPT

License:MIT License

Languages

Language:Python 55.1%Language:Cuda 42.3%Language:C++ 2.6%