expz / annotated-hyena

An annotated implementation of the Hyena Hierarchy paper

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

The Annotated Hyena

Code for the Annotated Hyena blog post:

https://medium.com/@jskowera/the-annotated-hyena-3e50e0aa372a

Open In Colab

Dependencies

From the root directory of this repository, run:

# Create a virtual environment
virtualenv venv

# Activate the virtual environment
source venv/bin/activate

# Install the dependencies
pip install -r requirements.txt

Run the notebook

Start the Jupyter notebook server by running from the root directory of this repository:

jupyter notebook

Then open the link pasted in the output of the command in a browser. It will be of the form http://localhost:8888/tree?token=.... You may need to click past a warning about the website being insecure.

About

An annotated implementation of the Hyena Hierarchy paper

License:MIT License


Languages

Language:Jupyter Notebook 100.0%