There is no shortage of housed data, data repositories online, and lists of data repositories. At the risk of creating a dataset of datasets, here are a few places to go:
- Repositories / Search
- AWS Datasets
- Buzzfeed Datasets
- Common Crawl
- Data is Plural
- Data World
- DataUSA
- DBPedia
- Enigma Public
- FiveThirtyEight
- Github Awesome Public Datasets
- Google Cloud Datasets
- Google Dataset Search
- Harvard Dataverse
- Humanitarian Data Exchange (HDX)
- OpenICPSR
- Inter-university Consortium for Political and Social Research (ICPSR)
- Kaggle Data Sets. Please note that Kaggle datasets can sometimes be unreliable. It's often helpful to search for the underlying source of the data.
- KD Nuggets List
- MSFT Research Open Data sets
- Open Data Certificate
- Open Data Network
- Open Data Science I
- Open Data Science II
- Socioeconomic Data and Appliations Center (SEDAC)
- Stanford Large Network Dataset Collection
- UCI Repository
- Datasets
- Amazon Product Data
- Archive's Face-o-Matic
- Carbon datasets: World Carbon Pricing Database and Voluntary Registry Offsets Database
- Emergency Events Database and associated geocoding data from SEDAC
- Free Music Archive (FMA) Music Analysis Dataset
- GDELT global news dataset
- Lahman Baseball Database
- Internet shutdowns
- Instacart Orders
- Reddit Comments
- Wine data from the International Organization of Vine and Wine and The University of Adelaide's Wine Economics Research Centre.
- Social discussions
- UK data
- London Datastore
- UK Government
- UK Office of National Statistics
- UK Data Archive
- UK Department for Transportation
- European data
- European Data Portal
- European Union Open Data Portal
- Eurostat
- OECD Data
- StatBel, Belgian statistical office
- US data
- Analyze Boston
- Artifical Intelligence Patent Dataset
- House of Representatives and Senate Stock Trades
- OpenStates
- Department of Labor Foreign Labor Applications
- data.gov
- Princeton Corpus of Political Emails
- US Department of Labor Establishment Specific Injury and Illness Data
- US Treasury FiscalData
- China
- Rest of World / International Data
- Africa Open Buildings
- Global Nighttime Light Dataset 1992-2018 (See accompanying Nature article)
- Global Wind Atlas
- Government Revenue Dataset
- Observatory of Economic Complexity
- Our World in Data
- RegData provides text-based measures of regulations for several countries and industries
- Social Capital Atlas
- SustainBench
- World Bank
- United Nations
- Universal Postal Union Postal Statistics
For those of you who are UCL students, the UCL Library has a wealth of databases that you have access to as well. You will need to visit the repository to view all that is avaiable, but I will point out a few here. Note a UCL login will be required to access all these datasets.
- Cross-National Time-Series Data Archive (CNTS) has almost 200 variables for over 200 countries, spanning most of the last century.
- Proquest Central for news articles
- Wharton Research Data Services (WRDS) has a number of datasets on companies, financials, markets, and more.
- Statista