web-scrapping

There are 4 repositories under web-scrapping topic.

• VarunS2002 / Python-NSE-Option-Chain-Analyzer

  The NSE has a website which displays the option chain in near real-time. This program retrieves this data from the NSE site and then generates useful analysis of the Option Chain for the specified Index or Stock. It also continuously refreshes the Option Chain and visually displays the trend in various indicators useful for Technical Analysis.

  analysisappderivativesdharaskarequityniftynseoption-chainoptionsprogrampythonsameerscriptstrike-priceweb-scrapping
  Language:Python 372
• Proxy-List-Scrapper

  narkhedesam / Proxy-List-Scrapper

  Proxy List Scrapper

  proxyfreeproxyfreeproxylistproxyscrapeproxiesscrapperfree-proxiesweb-scrapperdata-miningcrawlercrawlersweb-scrappingrotating-proxyproxy-listproxypoolhttphttpssockssocks4socks5
  Language:Python 94

• mldsveda / PyScrappy

  All-in-one Web Scrapper for Python

  pythonpyscrappyweb-scrappingecommerce-scrapperfood-scrapperimage-scrappernews-scrappersocial-media-scrappersong-scrapperstock-scrapperwikipedia-scrapper
  Language:Python 50

• spyboy-productions / PhantomCrawler

  Boost website hits by generating requests from multiple proxy IPs.

  ddos-attack-toolsproxyproxy-configurationproxy-rotationweb-crawlingweb-scrappingwebsite-analyticswebsite-hits
  Language:Python 43

• dheison0 / annas-archive-api

  Anna's Archive website unofficial API

  annas-archiveapifree-contentunofficialweb-scrapping
  Language:Python 38

• OpenJarbas / PySychonaut

  Unofficial python api for Erowid, PsychonautWiki and AskTheCaterpillar

  web-scrappingpythonerowiddrugs
  Language:Python 28

• yuis-ice / jseval

  Evaluate JavaScript on a URL through headless Chrome browser.

  command-lineheadless-browserweb-browserbrowser-automationpupeteerheadless-browserscmdlinecommandline-interfacecli-utilitiesevalevaluatorscrapersdatascrapingscrappingdata-scrapingwebscrappingweb-crawlingscrapperwebsite-scraperweb-scrapping
  Language:JavaScript 24

• gugarosa / leaflyer

  🍀 Scraps data from Leafly and collects amazing weed-based meta-data.

  rpaseleniumweb-scrappingleaflystrains
  Language:Python 21

• Or-i0n / sololearnlib

  Library that retrieves public data from sololearn.com

  web-scrapping
  Language:Python 20

• PB2204 / Covid-19

  This Is A Web Scraping Projects With Covid-19 Data From 2 Very Popular & Authentic Websites

  covid-19covid19-dataweb-scrapingweb-scraping-pythonweb-scrapping
  Language:Jupyter Notebook 18

• sallamy2580 / python-web-scrapping

  Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

  newsletterweb-scraperweb-scrappingbloombergdata-scrapingfinancial-datafuturesfutures-historical-datanews-scrapernews-websitesreutersscrapersweb-scrapersdata-scraperfinancial-timesoptions-datapython-web-scraperscrapingwall-street-jowallstreetbets
  Language:Python 17

• Hrushi11 / Yellow-Pages-End-API

  This repository contains the code for completely scraping the yellow pages website to get the details of all the categories from all the cities in America and then turning all of the data into an api to be used later.

  apidynamic-apiflaskweb-scrapingweb-scrappingyellow-pagesyellow-pages-apiyellow-pages-scraper
  Language:CSS 12

• shayan-azizi / TV-Show-Downloader

  I was a little lazy in downloading the series I wanted. So I made it automatic.

  downloaddownload-managerdownloadertv-seriestv-showsweb-scrapperguipythontkinterweb-scrapping
  Language:Python 10

• zeus-habash / Scraping-jobs-from-Indeed

  This Repository is for scraping jobs from Indeed

  web-scrappingwebscrapingwebscraper-websitewebscraping-searchweb-scraperbs4indeedanalystdata-analysisdata-sciencepandas-dataframejobspandastext-miningtext-analytics
  Language:Jupyter Notebook 9

• gentildpinto / rails-web-scrapper

  O Rails WEB SCRAPER é um projeto com a finalidade de extrair dados de filmes do site YIFY Torrents - YTS.

  ytsweb-scrapper-ytsyify-torrentsrailsfilmsrubyrails-apiscrapperscrapper-scriptweb-scrapperweb-scrappingprojetorails-web-scrapper
  Language:Ruby 7

• gugarosa / jucesp_rpa

  🤖 An RPA-based tool for extracting information over JUCESP.

  rpaseleniumweb-scrappingjucesp
  Language:Python 6

• pdrm83 / rotten_tomatoes_scraper

  How to scrape the Rotten Tomatoes website and extract metadata from actor and movie pages.

  rotten-tomatoes-scraperpython3web-scrappingrotten-tomatoes
  Language:Python 6

• rushikeshamale / song-scraper

  This python web scraping script is use to download top 21 Bollywood songs of Today/Yesterday/Week/Month/All from www.mymp3song.site.

  web-scrapingweb-scraperweb-scrapperweb-scrappingweb-scraping-softwareweb-scrapersweb-scrapweb-scraper-rule-parsermymp3songsmp3songssongscrap-songspythonpython-scraperpython-scrapypython-web-scraperweb-scraper-songdownload-songsdownload-mp3
  Language:Python 6

• shakewingo / furniture-recommender-system

  An end-to-end development of living room furniture recommender system based on both text and image Latent Dirichlet Allocation (LDA)

  image-analysisweb-scrappingmachine-learning-algorithmscontent-based-recommendationrecommendation-engine
  Language:Jupyter Notebook 6

• devotuoma / British-Airline-Sentiment-Analysis

  This repository contains a project to analyze customer feedback data for British Airways (BA) and uncover insights about the airline. It includes code, data, and documentation for data scraping and preparation, data analysis, and presentation of results and recommendations.

  data-sciencedata-visualisationdeep-learningmachinelearningnlpnlp-machine-learningnltksentiment-analysisweb-scrapping
  Language:Jupyter Notebook 5

• Kadetron / Exticz

  A scrapping tool which is used for crawling and extracting href links from a website

  curlshellcrawlerregexweb-scrapping
  Language:Shell 5

• olucaslopes / BNMP-Scraper

  Navega pela API do Portal BNMP coletando dados

  engenharia-de-dadosweb-scrapping
  Language:Python 5

• ShihabYasin / concurrent-webscrapping-python

  Web Scraping with Python and Selenium ( Concurrent, Parallel, AsyncIO versions compare ) .

  asynciocrawlerpythonscraperseleniumweb-scrapping
  Language:Python 5

• cs-fedy / reddit-crawler

  I'm crawling reddit website, and i want to store them in a database(postgresql maybe).

  web-scrappingweb-crawlingdata-miningpythonseleniumbeautifulsoup
  Language:Python 4

• imamhossain94 / annex-bubt-scraping-script

  A powerful annex BUBT, BUBT Soft, and BUBT website scraping script.

  python3flasktabularbeautifulsoup4annex-bubtbubt-softbubt-websiteweb-scrapping
  Language:Python 4

• paridhimodi / restaurant-recommendation-app

  pythonflask-applicationweb-scrappingweb-applicationrecommender-systemcosine-similarity
  Language:HTML 4

• rajatt95 / Playwright_TS_WebScrapping

  Automation Testing | Web | Playwright | Typescript | VS Code | Get Data | Set Data in txt file | Viewport | Context | Web Scrapping

  playwright-typescripttest-automationvscodewebweb-scrappingcontextheadlessviewport
  Language:TypeScript 4

• ReaperZ0v / csgo-stats-scraper

  A web scraper coded in python for scraping the gaming stats for counter strike global offensive (CSGO) and exporting to CSV

  beautifulsoup4data-extractiondata-miningdata-sciencepandaspandas-tutorialpythonpython3web-scraperweb-scrapingweb-scrapperweb-scrapping
  Language:Python 4

• yasharya2901 / Python-Price-Scrapper

  The Python Price Scraper is a tool that fetches product information (name and price) from Amazon and Flipkart product pages using their URLs.

  beautifulsoup4pythonweb-scrapping
  Language:Python 4

• ArielXL / web-scrapping

  Implemetación de un scrapper para páginas web con el objetivo de descargar todo su contenido.

  python3web-scrapping
  Language:Python 3
• campusx-dsmp

  arv-anshul / campusx-dsmp

  Get all the resources like 🔗 Links and 🗂️ Files of 📝 Notes and 📓 Notebooks provided in the CampusX's DSMP Course.

  campusxcampusx-dsmppythonpython3resourcesweb-scrappingmkdocsmkdocs-material
  Language:Jupyter Notebook 3

• heatingma / VidFetch

  An open-source dataset download tool to obtain copyright-free videos from various free video websites.

  fetchfreevideoweb-scrapping
  Language:Python 3

• kaledgar / RedditImageDownloader

  Python module to help you automate & batch download media from your favourite Reddit creators 🎨📸

  redditreddit-downloaderautomated-downloaderdownloaderimage-downloaderimage-downloader-pythonprawpython3reddit-apiscraperweb-scrapping
  Language:Python 3

• Napolitain / liquipedia-calendar

  A Go / Memcached server which web scrappes matches from Liquipedia when accessed by an iCal URL. Events generated are included in standard calendar apps.

  icalendargoweb-scrappingcaldav-serveresportsliquipedia
  Language:Go 3

• nzagaspard / Predicting-House-Prices-In-Kigali

  This project uses the data collected (Web Scrapped) from a website that list the houses for sale in Rwanda, and employs machine learning to predict the price of a house given its neighborhood, plot size, number of bedrooms and bathrooms, etc.

  machine-learninghouse-price-predictionkigali-rwandaweb-scrappingweb-developmentdata-analysis-python
  Language:Jupyter Notebook 3

• Polytech-Paris-Saclay / polytech-discord-bot

  Bot pour le Discord Polytech Paris-Saclay | Scrapper des notes sur Oasis (profil étudiant) et alerte pour les nouvelles via un bot Discord

  polytechoasispolytech-paris-sudpolytech-paris-saclayparis-saclaydiscorddiscord-pydiscord-botscraperscrapperscrappingscrapingweb-scrapperweb-scraperweb-scrapingweb-scrappingtesla
  Language:Python 3