This supplements a more efficient Rust-based static Web scraper (smart_scraper) for pages that require a headless browser that can accept cookies and render content via Javascript.
Basic puppeteer scraping tool to supplement "smart scraper" (textsurfer) to capture rendered HTML from pages that require cookies and javascript to be enabled.
This supplements a more efficient Rust-based static Web scraper (smart_scraper) for pages that require a headless browser that can accept cookies and render content via Javascript.
Basic puppeteer scraping tool to supplement "smart scraper" (textsurfer) to capture rendered HTML from pages that require cookies and javascript to be enabled.