zeta1999 / osm-finder

A "line-network" geolocation tool created for Bellingcat's September 2022 Hackathon: https://www.bellingcat.com/resources/2022/10/06/automated-map-searches-scam-busting-tools-and-twitter-search-translations-here-are-the-results-of-bellingcats-second-hackathon/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

osm-finder

The UI is now accessible from anywhere on Heroku: https://osm-finder.herokuapp.com/

Tool Description

One of the most prominent tools that assists in geolocating images using openstreetmap data is Overpass Turbo. This requires learning and using the Overpass Query Language and restricts your geolocation abilities to only what's permitted by the query language.

This tool attempts to make it easier for researchers to find locations with a simple click-and-drag interface. No need to learn a new query language. It also adds capabilities not present in existing tools, like the ability to search by the angle between roads, power lines, and railways.

This tool currently supports all highway, railway, and a couple power line (namely, 'line' and 'minor_line') types.

When in doubt, it's always safer to enter larger/wider parameters than you think is needed (e.g., enter an angle of 25 +/- 20 instead of 25 +/- 5).

Works best on images with unique intersections. If there are any tags you can enter (e.g. bridge=yes, tunnel=yes), you'll decrease the size of the results significantly.

Tested on Ubuntu 22.04.1 LTS.

Installation

Instructions below are for Linux.

I. Install and Configure Postgres Backend

  1. Ensure you have PostGIS installed, and then install osm2pgsql version 1.7.0 or higher. Note: On Ubuntu and Fedora, this requires building from source (as of Sep 25).

  2. Download openstreetmap data for your area of interest. To follow along with the demo, download the data for Massachusetts at https://download.geofabrik.de/north-america/us.html. Click on the .osm.bz2 download.

  3. Download flex.lua and run the following commands (in Linux):

    • Note: you may need to move files around and change directory/file permissions appropriately to ensure that the postgres user can access massachusetts-latest.osm.bz2 and flex.lua.
    sudo -u postgres createuser osmuser; 
    sudo -u postgres createdb --encoding=UTF8 --owner=osmuser osm; 
    sudo -u postgres psql osm --command='CREATE EXTENSION postgis;'; 
    sudo -u postgres psql osm --command='CREATE EXTENSION hstore;'; 
    sudo -u postgres osm2pgsql -d osm -c massachusetts-latest.osm.bz2 -S flex.lua -O flex; 
  1. Configure your (Linux) terminal using the following commands:
    • Note: The interactive query terminal that opens when you run psql is what you'll use to run the PostgreSQL queries that the front-end generates.
    • You can confirm your database was set up correctly by running \dt. You should see four tables: closed_shapes, linestrings, points, and spatial_ref_sys.
    sudo su postgres
    psql
    \c osm

II. Install Frontend

  1. Download this project repository.
    git clone git@github.com:Xetnus/osm-finder.git

  2. Install requirements.txt (you might want to create a venv first): pip install -r requirements.txt

  3. Install paper.js: npm install paper

  4. Run gunicorn app:app in project directory to start the app. Copy the URL that the command outputs and paste it into a web browser window.

Usage

Buttons:

  • Upload Photo: upload any photo you want to geolocate
  • Add Linestring: Click and drag to annotate a line in the image (e.g. highway, railway, power line)
  • Next Step: Continue through the next steps, entering the properties for the linestrings and entering any distance or angle parameters between the linestrings.

Next Steps

  • Start from scratch. Because this was created during a hackathon, little emphasis was put on code quality and future maintenance. No standard JavaScript libraries were used and most of the code is inefficient in one way or another. Now that I have a better idea for how this tool can be architected, reconstructing it should be easier.
  • Add support for nodes. Towers, buildings, and nodes of all types should be supported.
  • Add support for shapes. Many roads, buildings, structures, etc. have unique shapes that should be queryable using carefully crafted PostgreSQL queries.
  • Host a public website. Depending on cost, I aim to integrate and host both the frontend (UI) and backend (PostgreSQL) on a public-facing website.

About

A "line-network" geolocation tool created for Bellingcat's September 2022 Hackathon: https://www.bellingcat.com/resources/2022/10/06/automated-map-searches-scam-busting-tools-and-twitter-search-translations-here-are-the-results-of-bellingcats-second-hackathon/

License:MIT License


Languages

Language:JavaScript 84.0%Language:Lua 10.6%Language:CSS 3.6%Language:HTML 1.4%Language:Python 0.4%Language:Procfile 0.0%