Project for what-the-data hackathlon.
Vagrant 1.8.5 is unable to create new Linux boxes due to Vagrant bug #7610. Use Vagrant 1.8.4 until version 1.8.6 is released. https://releases.hashicorp.com/vagrant/1.8.4/
Install Virtualbox 5.0.24. The newer versions don't play nicely with Vagrant. https://www.virtualbox.org/wiki/Download_Old_Builds_5_0
The environment variable that was automatically created for me had a keyname of "VBOX_MSI_INSTALL_PATH." However, the "base.rb" file inside one of the many subfolders of the Vagrant directory looks for the environment variable keyname "VBOX_INSTALL_PATH." So all I did was right-click on "My Computer"-->Properties-->Advanced System Settings-->Environment Variables. Here I scrolled down to find "VBOX_MSI_INSTALL_PATH" and I changed it to "VBOX_INSTALL_PATH."
Adapt VirtualBox virtual machine path to your liking by starting VirtualBox and going to settings.
After having installed the virtual machine with ´vagrant up´ Enable CD-ROM by virtual box gui. Add guest additions from menu.
mount /dev/sr0 /mnt
run guest additions .sh file.
Set github username and email in .gitconfig
Add the following alias to the config file in .git/-directory:
[alias] lg1 = log --graph --abbrev-commit --decorate --format=format:'%C(bold blue)%h%C(reset) - %C(bold green)(%ar)%C(reset) %C(white)%s%C(reset) %C(dim white)- %an%C(reset)%C(bold yellow)%d%C(reset)' --all lg = !"git lg1"
git add <file>
git commit -a -m "Blah Blah Blah"
git push origin master
You need 0.1 kWh for bringing 1l water from 15°C to 100°C (without boiling).
According to http://www.bmw.com/com/de/newvehicles/i/i3/2015/showroom/range_charging.html#comparison_calculator_charging_time it takes three hours at a maximum of 7.4kW to charge the i3 back to 80%. According to some articles, te charging process is artificially slowed down above 80% to save the battery.
See: https://de.wikipedia.org/wiki/Watt_Peak for definition of kWp.
According to Wikipedia, the following useful heat values apply(approx.):
| Fuel | Useful heat in kWh/m3 |
|---|---|
| Petroleum gas | 12kWh/m3 |
| Hydrogen | 3.3 |
| Methane | 11 |
According to the values from the website this means:
| Fuel | Production rate under full force | Production |
|---|---|---|
| Hydrogen | 2.92m3/h | 9.5kWh/h |
| Methan | 0.2m3/h | 2.2kWh/h |
MQTT (Mesage Queue Telemetry Transport) is a transport protocoll for unreliable networks.
A broker (Mosquitto, see https://mosquitto.org/) can be installed with:
sudo apt-get install -y mosquitto
Once installed, the mosquitto service is automatically started.
The subfolder mqtt contains two examples of how a sensor (sensor.py) and and actor (actor.py) works. In the course of this project, we are focussing on the actor part. The sensor data should come from the different devices.
python3 sensor.py
python3 actor.py
Subscriptions use a topic filter. Topic levels are separated by "/". There are two wildcards:
- #: This level and all below. If used, has to be the last character in a topic filter.
- +: This level with all direct children. Something like "first/+/temperature" is possible.
- 0: At most once
- 1: At least once
- 2: Exactly once
Although the mqtt specification is payload agnostic, the paho implementation for python insists on the following data types:
- string
- bytearray
- int
- float
- None
Start the programm staubsauger.py. It will read the config file staubsauger_config.txt every minute and updates the mqttt-clients.
The config file expects a name (will be he file name for the results), a topic, the host url of the broker and a port. Invalid configuration will be skipped.
The data is retrieved via mqqt and saved in the folder data with a file name corresponding to the given name in the config.
Data is appended to the file
- Start the mqtt/sensor.py
- Start the mqtt/staubsauger.py
- Change the config file
- Watch the changes
According to the website, the data format is json. You can convert the retrieved data to csv via:
incsv -f json mqtt/data/.raw
The staubsauger config can be automatically derived from the website. There is a small python script, which will analyse the website.
cd websiteanalysis wget http://www.what-the-data.com/die-technik python3 analysis.py
It creates the file staubsauger_config.txt, which can be used to start the staubsauger process for getting the data.
The data is fetched as is and written to /vagrant/data.
Example:
b'{"value":-7121.083,"timestamp":1474716382489}' b'{"value":-7126.776,"timestamp":1474716383459}' b'{"value":-7127.814,"timestamp":1474716384479}'
Data for photovoltaic is mainly unavailable due to hardware failure. The available data is coming from the network interface of the pv.