TannerGilbert / Tutorials

Code for some of my articles

Home Page:https://gilberttanner.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Scraping comments for each post together

Vibhuarvind opened this issue · comments

what if I want to scrape posts along with the comment on each post into csv? How do i do it?

This depends on if the website is static or dynamic. If it's static, you can scrape it with BeautifulSoup and save the results into a CSV. If the website is dynamic, you'll need a tool that allows you to render the browser like Selenium. For more information, check out 'Python Web Scraping - Dynamic Websites'.

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days