thevasudevgupta / biobigbird

BigBird for bio-medical domain

BioBigBird

BigBird for bio-medical domain

Installation

# clone the repository and run following from the root
pip3 install -e .
pip install "jax[tpu]>=0.2.16" -f https://storage.googleapis.com/jax-releases/libtpu_releases.html