mistwire / meetup-scraper

Collect meetup data with web scraping

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Meetup Scraper

This code provides a template to web scrape data from Meetup using python and Beautiful Soup.

To run

Simply run, the following to start the script.

pip install -r requirements.txt
python collect_meetup_data.py

Notes

Line 260 has a hardcoded URL for a meetup group, you are free to modify this input mechanism to collect data on whatever group you are looking for.

Also line 86 invokes the get_location_data function which leverages AWS Location Service and a place index. Feel free to remove this if you don't need location data.

The output of the script is a CSV with the following fields.

state,meetup_link,meetup_name,meetup_location,meetup_members,num_past_events,last_event_time,last_event_timestamp,is_meetup_active_3_months,is_meetup_active_6_months,is_meetup_active_12_months,longitude,latitude

About

Collect meetup data with web scraping

License:MIT License


Languages

Language:Python 100.0%