Scraping dynamic content
JackyZhang1219 opened this issue · comments
Is your feature request related to a problem? Please describe.
Is it possible to get all the dynamically loaded content from a url? E.g. getting all the reviews from IMDB requires clicking "load more" over and over again, and Scrapegraph-ai currently only gets the reviews loaded first
not yet
Hey @JackyZhang1219 thanks we'll look into It! if you have some suggestions write them in the Discord channel
This is a great feature request. or example, get a 'next page' button to jump to the next list page, like scrapy-slash?