darrylcauldwell / project

Roadmaps towards decoding non-human languages.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Earth Species Project

The Earth Species Project (ESP) is an open-source collaborative and nonprofit dedicated to decoding and translating animal communication. For more information on ESP, you can visit our website.

We've been doing a lot of exploratory work in our Github, much of it in tutorial form. We've been gaining intuition about how to work with animal vocalizations with the tools of deep learning, as well as think about how to make exploration as a whole faster and more efficient. An example of this is the Acoustic Representation Toolkit, where we implement a toolkit that allows a wide range of acoustic representations—from spectrograms, to the HHT, to deep learned—that is well documented, tested, and integrate easily with PyTorch pipelines.

Next up, we are working on more specifically on two prongs of research:

  1. The Cocktail Party Problem
  2. Extending Unsupervised Human Audio Translation

At the same time, we are working on:

  • Building the ESP Library, with data sets accompanied by sets of tasks, creating MNIST-like benchmarks for the animal domain.

Get Started

  • First thing to do is to introduce yourself.
  • You can also jump into our discussions. We work in the open, so if using deep learning to decode and translate animal communication interests you, hop in!

Contributors

We recognize all types of contributions. This project follows the all-contributors specification. Instructions to add yourself or add contribution emojis to your name are here. You can also post an issue or comment with the text: @all-contributors please add @YOUR-USERNAME for THING(S) and our nice robot will add you.

To follow

About

Roadmaps towards decoding non-human languages.