This repo contains the pip install package for ReSpeaker 4-Mic Array on PYNQ. It uses the PI interface of PYNQ Z2 board. There are 2 noetbooks in the design. DOA.ipynb demostrates how to calculate DOA (Direction Of Arrival) of the sound. STT.ipynb demostrates how to do STT (Speech To Text) with APIs provided by Baidu (can easily switch to AWS).
To install this overlay on your PYNQ board, Open a terminal on your PYNQ board and run:
# (on PYNQ v2.3 or v2.4 only)
sudo pip3 install git+https://github.com/xupsh/pynq-respeaker.git
# (on PYNQ v2.3 or v2.4 only)
sudo python setup.py install
Note: This command must be run as root.
After the installation, a folder pynq-respeaker shuold be seen in /home/xilinx/jupyter_notebooks
.There are 2 notebooks in it and you can run them.
ReSpeaker is a 4-mic array with an AC108 4-channel ADC as a converter. More information about ReSpeaker, please click here.
windows: Open vivado 2018.3 and type these command lines in the tcl console:
cd <PATH_TO_PROJECT>/boards/Pynq-Z2/notebooks/bitstream
source respeaker_wifi.tcl
linux: Use these command lines:
source <PATH_TO_VIVADO>/2018.3/settings64.sh
cd <PATH_TO_PROJECT>/boards/Pynq-Z2/notebooks/bitstream
make
AC108 support I2S interface, here is the Vivado Block Design diagram.
The customized respeaker IP converts I2S signal and stored results in it. PS accesses those data via AXI_lite bus (MMIO in PYNQ ).
PYNQ License : BSD 3-Clause License