Jorgelig / marketplace-puppet

Scrape Facebook marketplace with puppeteer.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Marketplace Scraper

Setup email alerts for new items on Facebook Marketplace. Expensive to run due to the proxies required.

Accounts

Setup the following accounts:

ScrapingBee - Proxy API

Test with free trial credits. For production upgrade to the 'Startup' Plan at $100/month for ~35 search terms scraped every 15 minutes. For a cheaper alternative, maintain your own proxies.

SendGrid - Email API

Free account supports 100 emails / day which is plenty.

Setup

Create .env file with the following format.

scrapingbee_api_key = 
sendgrid_api_key = 
sendgrid_template_id = 
sender = 
recipient = 

Configure searches in default.json. Location must be copied from Marketplace URL (facebook.com/marketplace/COPY_LOCATION/search?query=bicycle).

{
    "term": "bicycle",
    "location": "nyc"
},

About

Scrape Facebook marketplace with puppeteer.


Languages

Language:JavaScript 67.6%Language:HTML 32.4%