forthing / gc-python-spider

Use three ways to gain data

gc-python-spider

Use three ways to gain data

• requests, urllib
• selenium
• scarpy

1. requests, urllib

2. selenium

For those websites which use AJAX (asynchronous JavaScript), we cannot use request. However, Selenium + FireFox/Chrome/PhantomJS will be a good solution.

3. scarpy