stellaraccident / transformer-benchmarks

benchmarking some transformer deployments

transformer-benchmarks

benchmarking some transformers

Quickstart

git clone https://github.com/powderluv/transformer-benchmarks

cd transformer-benchmarks

python -m venv myenv

source myenv/bin/activate

./run_benchmark.sh. #change the variables to run on cpu / gpu and which backends to use org, torchscript, tf, mlir