ScrapeGraphAI / Scrapegraph-ai

Python scraper based on AI

Home Page:https://scrapegraphai.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support for SPA's that has deferred content loading

ja-wxu opened this issue · comments

Is your feature request related to a problem? Please describe.
Single page web apps that load content post initial page load does it work right now. It returns an error suggesting the page is empty.

Describe the solution you'd like
Add an additional playwright config to wait or to execute some locator function.

Describe alternatives you've considered
Let LLM decide whether to wait

Additional context

hi @VinciGit00,

That link doesn't work. The examples under https://scrapegraph-doc.onrender.com/docs/Examples/ don't seem to have anything that'd look like a slow_mo_...