llmondo / Crawlers

Some crawlers for my own use

Crawlers

• Crawler for several social media platforms such as Twitter, Reddit etc.

Crawler for Twitter

• twitter.py is used for old Twitter websites which is of no use now;
• twint爬虫.ipynb uses the twint module which is very helpful;

Crawler for coinmarketcap

• Coinmarketcap.ipynb can be used to crawl historical coin value information in the coinmarketcap platform

东方财富网爬虫

• 爬取对象：
  • 资产负债表；
  • 现金流量表；
  • 利润表；
• 每调用一次可获得6个季度的季报财务数据，通过设置合适时间窗口可获得所需数据；
• 爬取后所有指标均为英文名，可根据Excel表格进行对应中文名称筛选、使用；