Joanna Cai's repositories
Medium-Crawler
This is an attempt to crawl medium posts using selenium.
Language:Python000
spiderPY-medium
Python Web Crawler that crawls https://meduim.com and grabs all the urls. It will also loop through those urls for the urls on those pages as well up to the number of specified times in the command line. It saves those links in four differnt files depending on the link type: links (for all links), stories (for all the stories links), offSite (for all the links that go offSite), mediumLinks (for all links that are stay on the medium site)
Language:Python000
Web-Scrapping-for-Educational-Contents-with-Beautiful-Soup-
It is a continuation of work done by https://medium.com/@adamaulia/python-simple-crawling-using-beautifulsoup-8247657c2de5 , We scrapped through educational contents from Harvard's Online Courses , to get description and syllabus of each course .
Language:Python000