git-scraping

There are 124 repositories under git-scraping topic.

• jstrieb / github-stats

  Better GitHub statistics images for your profile, with stats from private repos too

  github-statsstatisticsprofilevisualizationsgithubgithub-apigithub-actionsgit-scrapingstatistics-imagesstats-imagespythonpython3asyncasyncioreadme-templatereadme-md
  Language:Python 3268

• alex / nyt-2020-election-scraper

  git-scraping
  Language:HTML 1761

• factbook / factbook.json

  World Factbook Country Profiles in JSON - Free Open Public Domain Data - No API Key Required ;-)

  factbookopendataworldcountriespublicdomainjsoneuropeafricaasiaamericaoceaniaeconomygovernmentpeoplereligiongit-scraping
  1047

• mackorone / spotify-playlist-archive

  Daily snapshots of public Spotify playlists

  spotifyplaylistarchivesnapshotversionshistoryhacktoberfestspotify-playlistsgit-scraping
  459

• femueller / cloud-ip-ranges

  An up-to-date export of cloud provider IP address ranges

  awsgclouddigitaloceancloudflareipiprangeiprangesoracle-cloudoraclecloud-ip-rangesgit-scrapingakamaiazuregithub-ipaddresslinodemicrosoft-azure
  345

• simonw / csv-diff

  Python CLI tool and library for diffing CSV and JSON files

  csvclickdiffgit-scrapingdatasette-iodatasette-toolcsv-difftsv-diff
  Language:Python 326
• conrad

  vinayak-mehta / conrad

  Track conferences and meetups on your terminal.

  git-scraping
  Language:Python 255

• swyxio / gh-action-data-scraping

  this shows how to use github actions to do periodic data scraping

  git-scrapinggh-actionscron
  Language:JavaScript 235

• simonw / ca-fires-history

  Tracking fire data from www.fire.ca.gov

  git-scrapingfiresdisasters
  212

• endoflife-date / release-data

  Common Release Data for various projects in a consumable format, automatically updated.

  hacktoberfestgit-scraping
  Language:Python 184

• mary-ext / atproto-scraping

  Git scraping of AT Protocol/Bluesky instances

  atprotoblueskygit-scrapingatcute
  Language:TypeScript 154

• simonw / git-scraper-template

  Template repository for setting up a new git scraper

  git-scraping
  Language:Shell 118

• tobilg / public-cloud-provider-ip-ranges

  Unified datasets for public cloud provider IP ranges. Providers include AWS, Azure, CloudFlare, DigitalOcean, Fastly, Google Cloud and Oracle Cloud.

  awsazurecloudgcpgit-scrapingipv4
  Language:Shell 91

• vitorbaptista / google-covid19-mobility-reports

  Data extraction of Google's COVID-19 Mobility Reports

  covid-19datasetscrapinggit-scraping
  Language:HTML 80

• mary-ext / bluesky-labeler-scraping

  Git scraping of Bluesky labelers/label providers

  blueskygit-scrapingatcute
  Language:TypeScript 68

• simonw / scrape-hacker-news-by-domain

  Scrape HN to track links from specific domains

  git-scraping
  Language:JavaScript 67

• tobilg / aws-iam-data

  This repository contains the full dataset of AWS IAM data (services, actions, resource types and conditions keys). It's updated on a daily basis at 4AM UTC.

  awsdataiamgit-scraping
  Language:TypeScript 65

• datadesk / california-coronavirus-scrapers

  The open-source web scrapers that feed the Los Angeles Times California coronavirus tracker.

  pythonscraperjupyter-notebookjournalismdata-journalismnewscoronavirusgit-scrapingcovid-19california
  Language:Jupyter Notebook 59

• simonw / pge-outages-pre-2024

  Tracking PG&E outages

  scrapingpowerpge-outagesgit-scraping
  Language:Python 56

• pl4nty / intune-change-tracking

  Track changes to Microsoft Intune with git and RSS

  git-scraping
  Language:Python 51

• simonw / scrape-doge-gov

  Track changes to doge.gov

  git-scraping
  Language:Python 51

• simonw / disaster-scrapers

  Scrapers for disaster data - writes to https://github.com/simonw/disaster-data

  git-scraping
  Language:Python 50

• simonw / help-scraper

  Record a history of --help for various commands

  git-scraping
  Language:Python 48

• simonw / sf-tree-history

  Tracking the history of trees in San Francisco

  san-franciscotreescirclecigit-scraping
  46

• captn3m0 / india-isin-data

  International Securities Identification Numbers for various Indian Securities

  csvdatasetfundsgit-scrapingindiaisinnsdlsecurities
  Language:Shell 44

• pkmn / randbats

  Pokémon Showdown's Random Battle sets

  pokemon-showdowngit-scrapingdatapokemon
  Language:JavaScript 42

• captn3m0 / mf.captnemo.in

  Get information about Indian Mutual Funds from their ISIN numbers.

  git-scrapingmutual-fundspublic-apipublic-apis
  Language:JavaScript 39

• tigger0jk / ark-invest-scraper

  Pulling a history of the holdings for ark invest funds https://ark-funds.com/

  git-scraping
  Language:Python 39
• smogon

  pkmn / smogon

  Wrapper around Smogon's analyses and usage statistics

  pokemonsmogondatagit-scraping
  Language:TypeScript 37

• simonw / disaster-data

  Data scraped by https://github.com/simonw/disaster-scrapers

  data-scrapingirma-responsejsongit-scraping
  37

• simonw / scrape-open-data

  Scrape various open data directories to create an index of what's available out there

  git-scrapingsocrata
  Language:Python 37

• jandinter / gesetze-im-internet

  Archive of German legal acts (weekly archive of gesetze-im-internet.de)

  git-scraping
  Language:Ruby 36

• mikepqr / real-estate-scrape-eg

  A repository demonstrating the use of real-estate-scrape to store the estimated value of a property on Redfin and Zillow every night using Github Actions.

  git-scraping
  36

• ifoukarakis / jobscrapper

  An automated job scrapper

  git-scrapingscrapy
  Language:Python 34

• captn3m0 / historical-mf-data

  Historical Mutual Funds data

  git-scrapingindian-financemutual-fundsopen-datasetspricing-informationsqlite-dataset
  Language:Python 33

• AyrtonB / EveryNoise-Watch

  Spotify genre attributes from EveryNoise

  energynoisespotifygenresmusicfrictionless-datagit-scraping
  Language:Jupyter Notebook 31