git-scraping

There are 96 repositories under git-scraping topic.

• jstrieb / github-stats

  Better GitHub statistics images for your profile, with stats from private repos too

  asyncasynciogit-scrapinggithubgithub-actionsgithub-apigithub-statsprofilepythonpython3readme-mdreadme-templatestatisticsstatistics-imagesstats-imagesvisualizations
  Language:Python 2829

• alex / nyt-2020-election-scraper

  git-scraping
  Language:HTML 1762

• factbook / factbook.json

  World Factbook Country Profiles in JSON - Free Open Public Domain Data - No API Key Required ;-)

  africaamericaasiacountrieseconomyeuropefactbookgit-scrapinggovernmentjsonoceaniaopendatapeoplepublicdomainreligionworld
  983

• mackorone / spotify-playlist-archive

  Daily snapshots of public Spotify playlists

  spotifyplaylistarchivesnapshotversionshistoryhacktoberfestspotify-playlistsgit-scraping
  390

• simonw / csv-diff

  Python CLI tool and library for diffing CSV and JSON files

  csvclickdiffgit-scrapingdatasette-iodatasette-toolcsv-difftsv-diff
  Language:Python 281
• conrad

  vinayak-mehta / conrad

  Track conferences and meetups on your terminal.

  git-scraping
  Language:Python 241

• swyxio / gh-action-data-scraping

  this shows how to use github actions to do periodic data scraping

  git-scrapinggh-actionscron
  Language:JavaScript 219

• simonw / ca-fires-history

  Tracking fire data from www.fire.ca.gov

  disastersfiresgit-scraping
  198

• femueller / cloud-ip-ranges

  An up-to-date export of cloud provider IP address ranges

  awsgclouddigitaloceancloudflareipiprangeiprangesoracle-cloudoraclecloud-ip-rangesgit-scrapingakamaiazuregithub-ipaddresslinodemicrosoft-azure
  143

• endoflife-date / release-data

  Common Release Data for various projects in a consumable format, automatically updated.

  git-scrapinghacktoberfest
  Language:Python 102

• vitorbaptista / google-covid19-mobility-reports

  Data extraction of Google's COVID-19 Mobility Reports

  covid-19datasetgit-scrapingscraping
  Language:HTML 81

• datadesk / california-coronavirus-scrapers

  The open-source web scrapers that feed the Los Angeles Times California coronavirus tracker.

  pythonscraperjupyter-notebookjournalismdata-journalismnewscoronavirusgit-scrapingcovid-19california
  Language:Jupyter Notebook 56

• simonw / pge-outages-pre-2024

  Tracking PG&E outages

  scrapingpowerpge-outagesgit-scraping
  Language:Python 53

• simonw / disaster-scrapers

  Scrapers for disaster data - writes to https://github.com/simonw/disaster-data

  git-scraping
  Language:Python 49

• simonw / help-scraper

  Record a history of --help for various commands

  git-scraping
  Language:Python 44

• simonw / sf-tree-history

  Tracking the history of trees in San Francisco

  san-franciscotreescirclecigit-scraping
  42

• tigger0jk / ark-invest-scraper

  Pulling a history of the holdings for ark invest funds https://ark-funds.com/

  git-scraping
  Language:Python 39

• simonw / scrape-hacker-news-by-domain

  Scrape HN to track links from specific domains

  git-scraping
  Language:JavaScript 37

• simonw / disaster-data

  Data scraped by https://github.com/simonw/disaster-scrapers

  data-scrapingirma-responsejsongit-scraping
  36

• ifoukarakis / jobscrapper

  An automated job scrapper

  git-scrapingscrapy
  Language:Python 32

• fedora-python / portingdb

  Database & tools to track Python 2 removal from Fedora

  fedoragit-scrapingpython2-python3
  Language:Python 31

• captn3m0 / india-isin-data

  International Securities Identification Numbers for various Indian Securities

  isinfundssecuritiesindiansdldatasetcsvgit-scraping
  Language:Shell 29

• mikepqr / real-estate-scrape-eg

  A repository demonstrating the use of real-estate-scrape to store the estimated value of a property on Redfin and Zillow every night using Github Actions.

  git-scraping
  28

• pkmn / randbats

  Pokémon Showdown's Random Battle sets

  pokemon-showdowngit-scrapingdatapokemon
  Language:JavaScript 28
• nepstonks

  sarojbelbase / nepstonks

  An automated bot that scrapes the latest upcoming issues, news, and investment opportunities that are announced inside Nepal and sends them to a telegram channel.

  nepsestock-marketipofporight-sharetelegram-botmade-in-nepalshare-marketnepali-appnepalmerosharesharesansartelegram-channelinvestment-opportunitiesdebenturemutual-fundsgit-scrapingbotnewshacktoberfest
  Language:Python 27
• smogon

  pkmn / smogon

  Wrapper around Smogon's analyses and usage statistics

  pokemonsmogondatagit-scraping
  Language:TypeScript 25

• ahmedshahriar / depression-tweets-scraper

  A Scraper that scrapes '#depression' tweets daily powered by GitHub action and snscrape (stopped at June 30,2023)

  depressiongit-automationgit-scrapingtwittertwitter-scraperweb-scrapingautomationdatasetsnscrapesocial-mediagithub-actiongit-scraper
  Language:Python 24

• AyrtonB / EveryNoise-Watch

  Spotify genre attributes from EveryNoise

  energynoisespotifygenresmusicfrictionless-datagit-scraping
  Language:Jupyter Notebook 24

• simonw / cdc-vaccination-history

  A git scraper recording the CDC's Covid Data Tracker numbers on number of vaccinations per state.

  git-scraping
  Language:Python 24

• bobek / masscan_as_a_service

  masscan as a service

  cloudsecuritysecurity-scannersecurity-toolscontainersbare-metalsremasscanphabricatorauditgit-scraping
  Language:Python 23

• iandees / usps-collection-boxes

  US Postal Service collection box locations.

  git-scrapingusps
  Language:Python 23

• simonw / scrape-open-data

  Scrape various open data directories to create an index of what's available out there

  git-scrapingsocrata
  Language:Python 23

• simonw / graphql-scraper

  Track changes to GraphQL APIs by git scraping their schemas

  git-scrapinggraphql
  21

• captn3m0 / mf.captnemo.in

  Get information about Indian Mutual Funds from their ISIN numbers.

  git-scrapingmutual-fundspublic-apipublic-apis
  Language:Ruby 20

• beatrizmilz / mananciais

  Base de dados sobre volume operacional em mananciais de abastecimento público na Região Metropolitana de São Paulo (SP - Brasil).

  git-scraping
  Language:R 19
• berlin_corona_cases

  knudmoeller / berlin_corona_cases

  Scraper for the official dashboard with current Corona case numbers, traffic light indicators ("Corona-Ampel") and vaccination situation for Berlin.

  berlincoronacovid19datasetgit-scrapingnokogiriopendatarubyscrapervaccination
  Language:Ruby 19