Smart Mirror Mark II
Smart Mirror Mark II is the second generation of my personal project. Note: the main language of the widgets is Russian.
Available widgets:
- Clock;
- Calendar;
- Weather (based on Yandex Weather API);
- Stocks (exchange rates and oil prices);
- Youtube (based on Python VLC bindings);
- Ticker (a moving string of the latest news);
- COVID-19 (global and local Russian figures);
- Statusbar (CPU temperature and assigned IP address).
Features:
- Gesture control. A web camera can be used to recognize static hand gestures in order to increase or decrease the audio volume of the playback. A CNN with a combination of background substraction is used to achieve the goal. An open palm is the gesture that initiates the voice control feature.
- Voice control. The main purpose of the voice control is to search videos on Youtube as well as to conceal and show the widgets. Youtube fullscreen mode is also activated via the voice control.
- Web interface. Based on Django, a user-friendly web interface can be used to move the widgets across the screen and resize them. There is a special page to choose and connect to a particular WiFi hotspot.
Installation:
At the moment, installation is available from the repository:
$ git clone https://github.com/Auskas/smartmirror2.git
Requirements:
OS: Tested on Raspberry Pi OS 10 (Buster); also tested on Ubuntu 18.04 and 20.04. Language: Python 3.6 and higher
Look at environment.txt to set the required environment variables.
Dependencies:
All the dependencies are listed in requirements.txt. To install them all run:
$ pip install -r requirements.txt
Hardware:
To test the script a simple PC is suitable. A web camera is needed to use the gestures recognition capability. To be able to execute voice commands a microphone must be on board. The script is fully tested on Raspberry Pi 3 model B+. Raspberry Pi preparation steps are listed in rpi_config.txt
Execution:
To run the script execute the following command:
$ python3 smartmirror2/smartmirror2/main.py
The web server starts along with the main script.
Examples:
