Giters

damakes / scrapy-emergency-data-finland

end-to-end emergency data scrapy project with geographical data visualizetion.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

folium-mapspipelinespythonscrapyspideruser-agents

scrapy-emergency-data-finland

Scrapy spider project for emergency & incident data collection of Finland.

Visit the interactive map: Scrapy Emergency Data Finland 🖱️

Project Features

  1. Scraping: crawl and scrape emergency and incident data from website.
    1. Tracking & blocking prevention: Integrated with ScrapeOps API for user-agent & headers creation.
  2. Cleaning: Scrapy Items and Item Pipelines to clean and structure the data.
  3. Storage: Save the cleaned data into CSV files for further analysis.
  4. Visualization: Geographical distribution of incidents using Folium maps.

About

end-to-end emergency data scrapy project with geographical data visualizetion.

folium-mapspipelinespythonscrapyspideruser-agents

Languages

Language:Python 95.9%Language:C 1.5%Language:Cython 1.3%Language:HTML 0.7%Language:C++ 0.3%Language:XSLT 0.2%Language:Fortran 0.0%Language:PowerShell 0.0%Language:GAP 0.0%Language:Smarty 0.0%Language:JavaScript 0.0%Language:Batchfile 0.0%Language:Forth 0.0%Language:Meson 0.0%Language:Classic ASP 0.0%Language:Roff 0.0%Language:Shell 0.0%Language:VBScript 0.0%