scraping-python

There are 13 repositories under scraping-python topic.

• VinciGit00 / Scrapegraph-ai

  Python scraper based on AI

  automated-scrapergpt-3gpt-4llama3llmmachine-learningscscrapingscraping-pythonscrapingweb
  Language:Python 8176

• lorien / awesome-web-scraping

  List of libraries, tools and APIs for web scraping and data processing.

  web-scrapingcaptcha-bypasscaptcha-recaptchacrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolwebscrapingcrawlerspider
  Language:Makefile 6357
• botasaurus

  omkarcloud / botasaurus

  The All in One Framework to build Awesome Scrapers.

  anti-botanti-detectioncloudflare-bypasscloudflare-scrapeanti-detectanti-detect-browserantidetect-browserundetectedundetected-chromedriverbypass-cloudflarepython-web-scraperpython-web-scrapingscraping-frameworkscraping-toolundetectableweb-scraping-pythonbot-detectionscraping-pythonweb-crawlingpython-scraper
  Language:Python 956
• serp-scraper-api-guide

  oxylabs / serp-scraper-api-guide

  A quick-start guide on using SERP Scraper API

  pythonscrapergithub-pythonscraping-pythonwebsite-scrapingurl-scrapergoogle-maps-scrapinggoogle-search-apiscraping-apiserp-apiserp-scraperserp-scrapinggoogle-map-scrapergoogle-scraperscrape-google-serpserp-scraping-apigoogle-news-apiapi-for-google-newsapi-google-news
  547

• lkuffo / web-scraping

  Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup

  scrapingscraping-pythonscraping-websiteswebscrapingscrapping-pythonselenium-webdriverselenium-pythonlxml-etreescrapyscrapy-crawlerscrapy-spiderbeautifulsoup4beautifulsoupseleniumweb-scraping
  Language:Python 305

• furas / python-examples

  Python examples from my answers on Stackoverflow and other short scripts.

  pythonexamplesscraping-pythonthreadingflasksocketguitkinter
  Language:Python 171

• lobstrio / shadow-useragent

  Pick the most common user-agents on the Internet 👻

  useragentscrapingscraping-pythonuseragent-switch
  Language:Python 171

• fernandod1 / Instagram-to-discord

  Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

  instagram-scraperinstagraminstagram-photosinstagram-downloaderdiscorddiscord-botdiscordbotdiscordappinstagram-botmonitoring-scriptsmonitormonitorsscraperscrapingscrapperscraping-websitesscraping-pythonpythonpython3webhook-discord
  Language:Python 120

• fabriziomiano / linkedin-scraper

  Tool to scrape linkedin

  scrapingscraping-pythonlinkedinlinkedin-scraperseleniumbeautifulsoup
  Language:Python 76

• ScrapingAnt / amazon_scraper

  Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

  scrapingscraping-apiscraping-websitesscraping-webscraping-pythonscraping-dataprice-scrapingprice-scraperweb-crawlerweb-crawlingweb-crawlersamazonamazon-scraperamazon-scraping-libraryscraperdata-miningnode-jsjsscrape-products
  Language:JavaScript 76

• fernandod1 / Instagram-downloader

  Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!

  pythoninstagraminstagram-photosinstagram-scraperinstagram-downloaderinstagram-feedscraperscrapscraping-pythonscrapingscraping-toolscraping-websitescrawlercrawling-python
  Language:Python 63

• outscraper / outscraper-python

  The library provides convenient access to the Outscraper API from applications written in the Python language. Allows using Outscraper's services from your code.

  google-maps-scrapinggoogle-scrapingscrapinggoogle-maps-apiscraping-pythongoogle-apigoogle-search-apiserp-apigoogle-rating-apigoogle-reviews-apigoogle-serp-apiscraping-websitesgooglegoogle-mapsapiscraper
  Language:Python 62

• CrapTheCoder / UpCode

  Upload accepted solutions from CodeChef and CodeForces to GitHub

  github-apigrequestsmultiprocessingrequestsscraping-pythonjsonpythonpython3seleniumselenium-python
  Language:Python 44

• Steelio / Telegram-Post-Scraper

  Python program designed to scrape posts from Telegram channels using HTTP requests and HTML parsing, rather than Telegrams API. This is useful, as selfbots are against Telegram's ToS.

  pythonscraping-pythontelegramtelegram-scrapertgtg-scrapingtelegram-parsertelegram-scraper-2022telegram-scraper-bottelegram-scraper-2023tele-img-downloadtelegram-post-stealertg-downloader-bottele-scraper-bottg-downloadtg-scraper-bot
  Language:Python 44

• xtekky / TikDown

  Fast TikTok NO Watermark Video Downloader (username or url)

  pythonrequestsscrapingscraping-pythontiktoktiktok-apitiktok-downloadertiktok-scrapertiktokbot
  Language:Python 40

• mike-gee / webtranspose

  Web scraping API for building AI applications.

  chatbotscrawlingcrawling-pythonpythonscrapingscraping-pythonweb-crawlingweb-scrapingweb-scraping-python
  Language:Python 36

• poudelroshan / BOTVID-19

  Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku

  python3python-3flaskwebappseleniummessenger-botmessenger-chatbotcovid-19mysqlmysql-databasescraperscraping-websitesscraping-pythonscraping-botheroku-deploymentheroku-appfacebook-messenger-botfacebook-bot
  Language:Python 34

• alessio-ds / BSCWhalesMonitor

  BSC whales monitor and detector written in Python.

  bscbinance-smart-chainbinance-apibscscanetherscancryptomonitorscraping-pythonscraping
  Language:Python 33

• officialpm / scrape-amazon

  🤩 Python Package for Scraping Amazon Product Reviews ✨

  scrapeamazonbeautifulsoupbeautifulsoup4reviewsproductamazon-reviewsdataamazon-scraping-libraryscraping-dataweb-crawlersscraping-webscraping-pythonscraping-apishacktoberfest
  Language:Python 32

• mattdood / web_scraping_example

  Simple RSS feed reader for HackerNews.

  datascraping-pythonceleryrss-feed-scraper
  Language:Python 29

• serpwow / google-search-results-python

  Scrape and parse Google search results in Python

  googleserpserp-apiseoseotoolsseo-toolsseo-monitorscrapingscraping-pythonserpwow
  Language:Python 29

• kevinam99 / Instagram-Like-Bot

  A simple Instagram like bot that likes posts based on the hashtags you provide.

  instagram-botscraping-pythonselenium-pythonkivypython3python
  Language:Python 28

• wetcork / raiplay-dl

  The most advanced raiplay.it downloader

  downloaddownloaderpythonpython3raiplayscrapingscraping-pythonstreamingweb-dl
  Language:Python 28

• fcoagz / pydolarvenezuela

  Esta librería desarrollada en Python te brinda la capacidad de consultar los precios del dólar y/o euro en diversos monitores en Venezuela, también como las tasas de cambio del BCV.

  bcvdolar-cotizacionlibrarypythonvenezueladolardolar-oficialdollarpydolarvenezuelascraping-pythonscraping-websites
  Language:Python 26

• baronet2 / FirstCyclingAPI

  An unofficial Python API wrapper for firstcycling.com

  cyclingsports-datasportssports-analyticssportsanalyticssports-statssports-sciencecyclinganalyticsapiscraperscraping-websitesscrapingscraping-pythontourdefrancepython
  Language:Python 22

• sd3v / openinsiderData

  An Openinsider Scraper written in Python. Get the full Database behind the infamous SEC site :)

  insider-tradingpythonscraping-pythonopeninsider
  Language:Python 21

• morpheusthewhite / jwscraper

  A python library for scraping videos from JW Player

  pythonpython3jw-playerscraping-pythonscraping
  Language:Python 20

• fernandod1 / ProductHunt-scraper

  Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.

  pythonpython3python-scriptscraperscrapingscraping-websitesscraping-pythonscraping-toolscraping-botdata-miningdataminingproducthuntproducthunt-usersproducthunt-apiscrapescraped-datascraper-enginecrawlercrawling-sitescrawling
  Language:Python 18
• robbot

  MasterCruelty / robbot

  My personal Telegram bot made in Python. It has several features and it's based on Pyrogram.

  pyrogramtelegrampythongeopywikipediaweather-forecastcovid-19openweathermap-apiopenstreetmap-datawttrinpyrogram-botopenaitpertper-autobustrenitaliascraping-pythonmatplotlib-pyplottrivialatm-milano
  Language:Python 18

• outscraper / outscraper-php

  The library provides convenient access to the Outscraper API from applications written in the PHP language. Allows using Outscraper's services from your code.

  google-maps-scrapinggoogle-scrapingscrapingscraping-pythongoogle-maps-apigoogle-apigoogle-rating-apigoogle-reviews-apigoogle-serp-apiserp-apiscraping-websitesphpscraper
  Language:PHP 16

• hhhrrrttt222111 / Selenium_python

  pythonpython-scraperseleniumselenium-webdriverselenium-pythonbeatifulsoupscraping-websitesscraping-pythonwebscrapingrequests-htmlwebscraperpython-requestsbeautifulsoup4beautifulsoup-libraryspiderspycharm-idechromedrivergeckodriverpython-parserhacktoberfest
  Language:Python 15

• easonlai / facebook_post_scraping_and_text_analytics

  This is demo repo to demostrate how to scrape post data from Facebook by Python with library facebook_scraper. And then use Azure Text Analytics to perform sentiment analysis for post text content.

  facebookfacebook-postscraping-pythonfacebook-scraperfacebook-scrapingpythonpython3azuremicrosoft-cognitive-servicestext-analyticsdata-scrapingazure-text-analyticsazure-text-analysismicrosoft-azurepandasseabornkey-phrase-extractionwordcloud
  Language:Jupyter Notebook 14

• wael-sudo2 / facebook-page-info-scraper

  Free Facebook pages MetaData Scraping Library - Unlimited Calls

  crawlercrawling-pythonfacebookfacebook-page-informationfacebook-scraperfacebook-scrapingmetadatapythonscraping-pythonseleniumfacebook-page-info-scraperdata-analysisdata-engineeringdata-mining
  Language:Python 14

• gurjeet29 / telegram_members_scrapper

  Python Script to scrape members from a selected Telegram group.

  telegram-bottelegramscrapingscraping-pythonexcelcsvapiextractpython
  Language:Python 13

• mateuszbuda / instagram-scraping-fish

  A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com

  instagrampythonscraperscrapingscraping-apiscraping-pythonweb-scraping
  Language:Jupyter Notebook 13

• omkarcloud / botasaurus-starter

  🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

  beautifulsoupcrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolheadlessnode-crawlerpython-crawlerscraperscrapingscraping-frameworkscraping-pythonscraping-toolseleniumweb-crawlerweb-crawlingweb-scraperweb-scrapingwebscraping
  Language:TypeScript 13