metacritic-analysis
Scraping and basic exploratory analysis of game data from metacritic.com
Project structure:
- Scraping - Getting and cleaning data from metacritic website. Currently only focused on "PC games" section. Python code based on Scrapy framework.
- Data - Datasets that result from previous step. The same dataset is available in xls (Excel) and csv formats. Also there is a log file generated by the spider.
- Analysis - Exploratory analysis of the dataset. Main objectives are to explore difference between user scores and critic scores, see how scores differ across years, search for potential sources of bias. Done using R language.
Examples of usage:
- to scrape data yourself - run
scrapy crawl metacriticfrom within /scraping/metacriticbot. See Scrapy documentation here. Some of the scraped fields: - to get already scraped dataset - http://is.gd/metacritic_xls
- to see results of an analysis - raw | report (russian) | conference slides (russian)
Requirements to run code:
Python
- Scrapy
- xlwt
R