data-gathering

There are 3 repositories under data-gathering topic.

• news-please

  fhamborg / news-please

  news-please - an integrated web crawler and information extractor for news that just works

  news-crawlernews-extractorcrawlerextractornewsnews-websiteselasticsearchjsonpythonnlpdata-gatheringnews-archivenews-articlescommoncrawlextract-articlesextract-informationnews-scraperccnewscc-newsroberta
  Language:Python 1928
• cacti

  Cacti / cacti

  Cacti ™

  cacticacti-communitycacti-frameworkdata-gatheringgraphgraph-templatingnetwork-discoveryphprrd-filesrrdtool
  Language:PHP 1561
• H4X-Tools

  vil / H4X-Tools

  Open source toolkit for scraping, OSINT and more.

  pythonpython-scriptpython3toolshackinglinuxh4x-toolshacking-toolhacktoolsip-scannerphone-numberwebhook-spammerdata-gatheringosintwebscrapingwebsearchdirbusterport-scanneremail-osintigscraper
  Language:Python 270

• lamthuyvo / social-media-data-scripts

  social-mediasocial-webdata-gatheringpythontwitteryoutubefacebooknicar18nicar-2018
  Language:Python 244

• arup-group / social-data

  Code and data for eviction and housing analysis in the US

  riskdata-gatheringevictionshousingcounty-levelcompare-countiesburdened-householdspython-scriptsfredpreventing-evictionsevictiondatabasedata-analysisrentcostcovid-19
  Language:Python 65

• shadawck / glit

  Retrieve all mails of users related to a git repository, a git user or a git organization

  data-gatheringemailemail-osintinformation-gatheringmultithreadedosintosint-toolrust
  Language:Rust 41

• viralvaghela / Jwiki

  Java tool to get wikipedia data

  javawikipediawikipedia-apijavawikipedajavatoolwikipedia-scraperdata-gathering
  Language:Java 34

• chrislicodes / Udacity-Data-Analyst-Nanodegree

  Repository for the projects needed to complete the Data Analyst Nanodegree.

  udacitydatadata-analysisdata-visualizationdatasetdata-cleaningdata-analyticsdata-analyst-nanodegreestatisticsdata-wranglingdata-gatheringweb-crawlingapitext-miningpandasnumpymatplotlibseaborntweepy
  Language:Jupyter Notebook 32

• DialRC / PortalAPI

  Portal Tutorial

  api-clientapi-serverdialogdialog-systemsdata-gatheringportal-tutorial
  Language:Python 11

• BahramJannesar / CafebazzarWebsiteScraper

  Data gathering from https://cafebazaar.ir

  data-sciencedata-gatheringscraperwebscrapingcafebazzaraaron-swartz
  Language:Python 6

• dbrennand / twitter-stream-bot-data-gatherer

  An application to watch the Twitter stream and send accounts to the Botometer API for analysis. The results are stored in a SQLite database.

  twitter-apitwitter-bot-detectionbot-detectiontwitter-streaming-apidata-gatheringbotometer
  Language:Python 5

• rdempsey / data-gathering-and-wrangling

  Code and slides for my class: Data Gathering & Wrangling

  data-sciencedata-gatheringdata-wranglingpythonapiweb-spiderwebscrapingwebscraper
  Language:Python 5

• subahanii / COVID19-tracker

  This is for Indian cases and data gathering from Indian governments site.

  covid19covid19-indiacovid19-live-trackercovid19-graphcovid-2019covid19-datacovid-apicovid19-trackercovid-19covid-19-indiadjangodjango-rest-frameworkdjango-projectbs4requests-moduleindian-governmentsindian-casesdata-gatheringwebapppython
  Language:HTML 5

• calista-ai / crowdsourcing-app

  A Web Application to collect data from pairwise image comparisons via crowdsourcing

  web-apppairwise-comparisonsdata-collectiondata-gatheringimage-evaluationdatasetdataset-creationcrowdsourcingmern-stackreactnodeexpressmongodbdockernginxmongo-expresscalistacalista-aiwebsite-aesthetics
  Language:JavaScript 4
• booru-dataset-gatherer

  Corruptex / booru-dataset-gatherer

  A .NET Core 3.1 Console application to gather tags and relevant information from Booru websites for Machine Learning.

  boorucsvdata-gatheringdata-miningdatasetlatent-diffusionmachine-learningnetcorenetcore31stable-diffusion
  Language:C# 4

• openpilot-community / opc-web

  Seeking Maintainers. The official codebase for the openpilot community info portal.

  openpilot-communitydata-gatheringcommaaiself-drivingautonomous-vehiclesvehicledrivingcarcars
  Language:JavaScript 4

• Yara-Alotaibi / Wrangle-and-Analyze-WeRateDogs-Data

  This is Udacity's Data Analyst Nanodegree's 5th project; which is Wrangling and Analyzing WeRateDogs Twitter account.

  data-analysisdata-analyticsdata-analysesdata-visualizationdata-wranglingdata-gatheringdata-assessmentdata-cleaningdata-scrapingudacityudacity-nanodegreeudacity-data-analyst-nanodegreepyhtonpython3twittertwitter-apitweepy
  Language:Jupyter Notebook 4

• joedarby / AlcoSensing

  An Android app for mobile sensing research

  androidalcoholdata-gatheringresearchhuman-behavior
  Language:Java 3

• rhart-rup / Foursquare-Venue-Scraper-2023

  Find all venues in a geographic area using the Foursquare API and collect extended Foursquare data on each venue.

  data-gatheringdata-sciencefoursquare-apijupyter-notebookpythonscrapersearchvenues
  Language:Jupyter Notebook 3

• Shahrukh2016 / Retail_Sales_Prediction

  Revolutionize sales forecasting for Rossmann stores with our high-accuracy XGBoost model, leveraging data analysis, feature engineering, and machine learning to predict sales up to six weeks in advance.

  data-analysisdata-cleaningdata-gatheringdata-preprocessingdecision-treesexploratory-data-analysisfeature-engineeringlightgbmmachine-learningmodel-evaluationmodel-selectionone-hot-encodingoutlier-detectionrandom-forestsregression-analysisregularizationstatistical-analysistransformationvisualizationxgboost
  Language:Jupyter Notebook 3

• ctroller / rlfantasy

  Custom Rocket League Fantasy League Stats Aggregator

  rocket-leaguefantasy-leaguedata-gatheringjavamaven
  Language:Java 2

• kleinpa / keyboardtime

  Foreground application logger for Windows

  personal-analyticsdata-gatheringusage-dataproductivity
  Language:Python 2

• petermeissner / diffrprojects

  rstatsnlptext-comparisondata-gatheringdata-sciencedata-structure
  Language:R 2

• wwengm / findar

  Financial Datareader

  financedata-gatheringbacktesting-trading-strategies
  Language:Python 2

• ZawszeBaka / face_recognition

  Face Detection => Data Gathering => Training => Face Recognition

  face-recognitionface-detectiondata-gathering
  Language:Python 2

• Coool / Cacti

  Cacti ™ (Latvian and Russian translator contribution)

  cacticacti-communitycacti-frameworkcacti-latviancacti-russiandata-gatheringgraphgraph-templatinglatviannetwork-discoveryphprrd-filesrrdtoolrussiantranslator
  Language:PHP 1

• Factobotics / FlexHex-Rose-AP

  ROSE-AP of the FlexHex project tries to make data gathering from Orion Context Broker entities to Influx-db easier.

  ocborion-context-brokerinfluxdbinfluxinflux-dbfastapipythonpython3bootstrap4javascripthtmlrose-apdata-gatheringsubscriptionbucketsmeasurements
  Language:Python 1

• kdvalin / ipmi-exporter

  Exports IPMI sensor information to a CSV

  csvdata-gatheringimpitoolipmisensors
  Language:Python 1

• marcoshsq / Python_DSA

  Minhas anotações e projetos do curso Fundamentos de Linguagem Python Para Análise de Dados e Data Science oferecido pela Data Science Academy de forma gratuita.

  analysisanalyticsbeautifulsoupdata-analysisdata-cleaningdata-gatheringdata-visualizationmatplotlibmatplotlib-pyplotnumpypandaspandas-pythonpysparkpythonpython3seabornsqllitestatistics
  1

• OSINT-TECHNOLOGIES / dpulse

  DPULSE - Domain Public Data Collection Service

  data-gatheringdomain-analysisinformation-gatheringinformation-securityinfosectoolsintelligenceintelligence-gatheringosintosint-toolweb-scraping
  Language:Python 1

• SamAndPel / grab-stick

  A set of python utilities to automatically exfiltrate system data.

  cybersecuritydata-gatheringpythonpython3reconnaissance
  Language:Python 1

• shishir-t3 / Dive_Into-PlayStore

  A project involving Web Scraping of App and reviews info from the Google play store and building a recommendation system deployed using Streamlit.

  data-gatheringdata-visualizationdeep-learningexploratory-data-analysismachine-learningpca-analysispython3recommendation-systemstreamlitt-snetensorflow2web-scraping
  Language:Jupyter Notebook 1

• sorrychoe / covid19today

  Today's World covid-19 Data Gathering Tool

  covid19-datadata-extractiondata-gatheringr
  Language:R 1

• speckly / sucorn_bot

  ML/DL Life Cycle utilities with support for BingImageCreator and Discord

  classificationdata-gatheringdeep-learningdiscordkeras-tensorflowstatisticssupervised-learning
  Language:Python 1

• tarzahedi / imdb-scraper

  Scraper for IMDBA top 1000 movies!

  data-cleaningdata-gatheringdatasetpythonscraper
  Language:Jupyter Notebook 1

• TelRich / Web_Scrapping_with_BeautifulSoup-and-Wptool

  Web scraping Webometrics and Wlkilpedia using Python (Beautiful soup and Wptools) to make a list of top 100 Universities in nigeria

  api-pythonbeautifulsoup4data-extractiondata-gatheringjson-pythonpandas-dataframerequests-library-pythonweb-scrapingwptools
  Language:HTML 1