SIMoN
System Integration with Multiscale Networks
Copyright 2020 The Johns Hopkins University Applied Physics Laboratory
Licensed under the MIT License
Copyrights for Third Party Software
Contact: simon@jhuapl.edu
Description
With the rise of globalization, climate change, population growth, and resource constraints, new modeling techniques are needed to assess the sustainability of our future resources. These methods must adapt to highly coupled domains, accommodate new models and data as they emerge, facilitate validation through model comparison, and handle the patchwork of data and models available with different units, definitions, and geo-temporal scales.
To address this challenge, the SIMoN modeling framework integrates independently-designed predictive models into a cohesive system, in order to produce a unified model. While many useful models are limited to predicting only a single isolated component of a larger system, SIMoN is able to connect models together so that collectively they can provide a more complete representation of the global system and its dynamics.
Requirements
Supported operating systems:
- Linux and macOS
- install Docker and Docker Compose
- Windows 10
- install Docker Desktop for Windows (includes Compose)
Setup
To run SIMoN, first install Docker and Compose for your operating system. Additionally, install make
, so that the shell commands that operate SIMoN can be executed more easily using the Makefile.
The Docker commands in the provided scripts assume that you are a privileged user. To add your user to the docker
group and use Docker as a non-root user (in Linux or macOS):
sudo usermod -aG docker <your_username>
You may need to log out and back in for this to take effect.
Usage
- To start SIMoN:
make all
- Use
docker logs broker -f
to track output from the broker container. The increment step "incstep" should increase over time as models publish their data, and the mongodb container should populate with documents (database:broker
; collection:sub
). - Use
docker logs simon_your_model_name_1 -f
to track output from the model namedyour_model_name
.
- To shut down SIMoN:
make stop
to stop all the SIMoN containers.make clean
to stop and remove all the SIMoN containers.make purge
to stop and remove all the SIMoN containers, and also remove their images.
Visualization
Use the scripts in the viz
directory to create a choropleth map visualization of the model data.
cd viz/
./export.sh <model_name> <year> <doc_name>.json
pip install -r requirements.txt
python plot.py --data <doc_name>.json
A new HTML file will be created. Open this file in a web browser to display the Bokeh visualization.
Architecture
SIMoN is written in Python, and uses Docker to manage its models and their integration. Each model runs in its own Docker container. An additional container hosts the system's centralized broker, which orchestrates model runs and shares data among models using a ZeroMQ publish-subscribe messaging pattern.
The Docker containers used for the broker and the models are built from the Ubuntu 18.04 image, with the Python 3.6 package layered on top. The container used for the database is built from a MongoDB image.