molaeiali / village

Sample Scraping scripts of divar, maktabkhooneh, ... for learning purposes - Step one : Village (village, town, skyscraper)

Web Scraping in python

topics

web page components

• html
• css
• js static?(files, images)

HTML:

• tags
  • child
  • parent
  • subling

Libraries:

• BeautifulSoup ?!
• requests

requests

• http requests
  • status codes 2**,3**, 4**,5**
• content

bs4

• Soup()
• Object types:
  • Tag
  • DocType
  • NavigableString
• prettify
• find_all, find
• select

css selectors