pbonazzi / retina

[CVPR Workshop 2024] Retina is an eye tracking method suitable for deployment on a neuromorphic system on chip.

👀 Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware 👀

💻 Blog |📜 Paper | 🗂️ Data

Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware
🧑🏻‍🚀 Pietro Bonazzi ¹, Sizhen Bian ¹, Giovanni Lippolis ², Yawei Li¹, Sadique Sheik ², Michele Magno¹

¹ ETH Zurich, Switzerland
² SynSense AG, Switzerland

✉️ Citation ❤️

Leave a star to support our open source initiative!⭐️

@InProceedings{Bonazzi_2024_CVPR,
    author    = {Bonazzi, Pietro and Bian, Sizhen and Lippolis, Giovanni and Li, Yawei and Sheik, Sadique and Magno, Michele},
    title     = {Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
    month     = {June},
    year      = {2024},
    pages     = {5684-5692}
}

🚀 TL;DR quickstart 🚀

Clone the repo

git clone https://gitlab.ethz.ch/pbonazzi/retina.git
cd retina

Create the environment

First, make sure your cmake is up to date and install dv_processing dependencies https://gitlab.com/inivation/dv/dv-processing

Then, create the environment:

conda create -n retina python=3.10
conda activate retina
pip install -r requirements.txt

Get the dataset

Please fill up this form to download the dataset https://pietrobonazzi.com/projects/retina

Verify the structure:

.
├── name
│   ├── annotations.csv
│   └── events.aedat4
├── ...
├── silver.csv

Training

--args : See the list of arguments in the launch_fire function

python train.py --args