pytorch-labs / gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

About benchmark results

1787648106 opened this issue · comments

Amaizing work! How was the benchmark results obtained? Is it just the generation speed measured when the GPU power limited 330W?

Yes. GPU power limit is an unfortunate limitation of the particular hardware setup I'm using - it's not required.