python-scraper

There are 9 repositories under python-scraper topic.

• botasaurus

  omkarcloud / botasaurus

  The All in One Framework to build Awesome Scrapers.

  anti-botanti-detectioncloudflare-bypasscloudflare-scrapeanti-detectanti-detect-browserantidetect-browserundetectedundetected-chromedriverbypass-cloudflarepython-web-scraperpython-web-scrapingscraping-frameworkscraping-toolundetectableweb-scraping-pythonbot-detectionscraping-pythonweb-crawlingpython-scraper
  Language:Python 981
• instascrape

  chris-greening / instascrape

  Powerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically

  beginner-friendlydata-miningdata-scienceinstagraminstagram-datainstagram-scraperlightweightpythonpython-scraperpython3webscraping
  Language:Python 618

• Smartproxy / Smartproxy

  HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.

  proxyproxieshttps-proxyproxy-serverpythondata-collectionproxy-integrationproxy-listpython-scraperscrapingurl-scraperweb-scrapingweb-scraping-apiresidential-proxiesdata-gatheringhttp-proxyip-rotationproxy-rotatorproxy-scrapersocks5-proxy
  Language:C# 426

• TheSpeedX / WhatScraper

  A Whatsapp Group Link Scraper And Checker

  whatsapp-botwhatsappscraperpython-scraperspeedxhacktoberfest
  Language:Python 200

• yousefkotp / Movies-and-Series-Scraper

  A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole season with one click.

  scraperseriesseries-scrapermovie-scrapperbeautifulsoupbeautifulsoup4moviemoviespythonpython-scraperpython-scrapingpython-scriptscrapingscraping-websites
  Language:Python 114

• harismuneer / Android-Apps-Downloader

  📱 A tool to download android apps from Google Play Store and Xiaomi App Store (the famous Chinese Store).

  scrapercrawlerandroid-researchpython-scraperxiaomi-appsandroid-application-downloaderscraping-toolcrawling-toolopen-source-projectgoogle-play-store-scraperxiaomi-store-scraperwget-utilitygplaycliresearch-toolandroid-scraperandroid-apps-crawlerandroid-toolgoogle-play-application-downloaderapp-downloaderandroid-market-scraper
  Language:Python 31

• Smartproxy / Web-Scraping-API

  Web Scraping API code examples for Python, PHP and Node.js

  data-miningdata-scrapingfacebook-scrapinginstagram-scrapernodejs-scrapingphp-scrapingpython-scraperpython-scrapingscraperscrapingscraping-apiscraping-webscraping-websitessocial-media-scrapersocialmediascrapertwitter-scrapingweb-scraperweb-scrapingwebscraperwebscraper-api
  Language:JavaScript 20

• LaskasP / TripAdvisor-Python-Scraper-Restaurants-2021

  An implementation on python for scraping unique stores or scraping a whole geographical area from TripAdvisor

  tripadvisorpython-scraperrestaurants-reviewsreviewsscraperarearegiontripadvisor-scrapertripadvisorreview
  Language:Python 18

• SuperKogito / CoinMarketCapScraper

  a small python scraper to scrape historical data from the CoinMarketCap website and convert it to csv files . This is an initial step for a data mining process to develop a predictive model of cryptocurrencies prices.

  scraperscraped-datacoinmarketcapcryptocurrencycsv-filesbig-datacryptocurrencies-pricespython-scrapercoinmarketcap-websitecsv
  Language:CSS 18

• bilalahhmedd / ebay-products-scraper

  This is ebay products scrapper to scrap images and metadata details of products from ebay.com

  scrapyscrapy-crawlerscrapy-ebayebay-scraperdata-scrapingpython-scraperpython-scrapy
  Language:Python 15

• hhhrrrttt222111 / Selenium_python

  pythonpython-scraperseleniumselenium-webdriverselenium-pythonbeatifulsoupscraping-websitesscraping-pythonwebscrapingrequests-htmlwebscraperpython-requestsbeautifulsoup4beautifulsoup-libraryspiderspycharm-idechromedrivergeckodriverpython-parserhacktoberfest
  Language:Python 15

• shaheenfazim / url-scraper

  A python script to scrape URL's from major search engines.

  bing-scraperduckduckgo-scrapergoogle-scraperpython-scraperscraperweb-scraperyahoo-scraper
  Language:Python 13

• dootss / catbox-scraper

  An extremely fast script for scraping file hosting site catbox.moe for any file extension.

  catboxfile-scraperpython-scraperrandom-imagesscrapercatbox-moe
  Language:Python 11

• MSadeghzadehG / Scrap_Learning

  Scrap a website with bypass the captcha

  python-scraperbypasscaptcha
  Language:Jupyter Notebook 11

• RGProjectX / yts-torrent-scrapper

  A Python Program Based On BeautifulSoup To Search The User's Desired Movies On https://yts.mx And Return Movies And Torrent Info

  yts-torrentyts-apiyts-moviesscraping-websitesbeautifulsouptorrentstorrent-scrapingpython-scrapermovie-scrapperyify-torrentsyify-movies
  Language:Python 11

• ttycelery / bni-api

  A Python wrapper for some of BNI's internet banking functionalities.

  internet-bankingscraperpython-scraperlxmlwrapperpython3python
  Language:Python 10

• 1x-eng / chart_data_extractor

  This webservice will help scrape data out of chart(s) presented on any given website. (At this moment, I only support scrape from HighCharts and AmCharts. Other libraries, maybe next time).

  scraperscraper-enginepython-scraperpython-chart-scraperchart-data-extractorchart-datachartshighchartsamchartsamcharts-js-chartshighcharts-jsbeautifulsouppython-web-scraperhacktoberfesthacktoberfest2018
  Language:Python 9

• mzubairtahir / Google-Maps-Scraper

  Scraper that scrapes data from search results of google maps

  business-datadatadata-scrapinggoogle-map-apigoogle-map-scrapergoogle-mapslead-generatorscraperscraping-websitespython-scraperpython-scrapingpython3
  Language:Python 9

• notscar / zalando-scraper

  Zalando coming soon releases scraper sent with discord webhooks

  zalandoscraperzalando-scaperpython-scraper
  Language:Python 9

• 0x4D-5A / e-scraper

  Python script to extract unique email addresses from a list of domains using regular expression.

  email-crawleremail-extractionemail-extractoremail-marketingemail-scraperemail-scrapingpython-scraperscraping-websites
  Language:Python 8

• kishanmodi / Torrent-Scrapper-API

  An API to Scrap Magnet/Torrent Links from 1337x, It provides the top seeded result from your query. Scrapping is done using BeautifulSoup4 and Python3. API is hosted on Heroku.

  bs4flaskherokupython-scraperpython3scrapping1337x-apimagnet-linktorrenttorrent-scrapertorrent-search-enginehacktoberfesthacktoberfest-accepted
  Language:Python 8

• sbmagar / raidfscrape

  Code to Scraping some portion of Data from forum(RaidForums) with Python SCRAPY spiders bypassing recaptcha and storing to PostgreSQL database.(used scrapper-API as captcha, proxy bypass) SQLAlchemy as ORM for PostgreSQL - Python.

  scraping-websitesscraping-pythonscrapy-crawlerforum-scrapingscrapy-spiderpython-scraperdata-scrapingscrapper-api
  8

• TheAdnan / hadith-of-the-day

  Firefox WebExtension that displays a different hadith on click

  beautifulsoup4firefoxfirefox-addonfirefox-extensionfirefox-webextensionhadithpython-scraperpython3scraperwebextension
  Language:HTML 8

• sakshamssr / upanime

  UpAnime : Modern Search Engine API for Manga.

  animeapicomicscomics-apimangamanga-apimanga-scraperpythonpython-scraperpython-scriptpython3scraperanime-apirest-apimanga-readermangareadermangadexpython-scriptingweb-scraperweb-scraper-api
  Language:Python 7

• androiddevnotesyoutube / scrape-twitter-json-to-html-table

  This script shows how to scrape your tweets by date or year using the opensource project Twint and turn it into a beautiful HTML table. No API key is required..

  twitterjsonpythonfilterscriptscrapescraperpython-scriptpython-scraperbeautifulsoup
  Language:Python 6

• rushikeshamale / song-scraper

  This python web scraping script is use to download top 21 Bollywood songs of Today/Yesterday/Week/Month/All from www.mymp3song.site.

  web-scrapingweb-scraperweb-scrapperweb-scrappingweb-scraping-softwareweb-scrapersweb-scrapweb-scraper-rule-parsermymp3songsmp3songssongscrap-songspythonpython-scraperpython-scrapypython-web-scraperweb-scraper-songdownload-songsdownload-mp3
  Language:Python 6

• Touexe / LinkTreeScraper

  Scraping Linktree user's information and links

  linktreelinktree-apiscraperpython-scraper
  Language:Python 6

• Ximaz / instagram-api

  This project is an Instagram API guest-oriented, meaning you can perform actions of data collection without having to register. However, you may be facing some Ratelimits, so I recommend you to put some delay between operations.

  instagramapiinstagram-apiinstagram-botinstagram-clientinstagram-downloaderinstagram-feedinstagram-scraperscraperscrapingscraping-websitespythonpython-scraperpython3
  Language:Python 6

• BinayakJha / ImageScraper

  Scrape images of web pages just by entering url

  beautifulsoup4image-scraperpython-scraper
  Language:CSS 5

• Genone22 / emails_phones_scraping

  Extract emails and phone numbers from the list of url addresses

  email-scraperemail-scrapingextract-dataparsingpython-scraperscraping
  Language:Python 5

• Jimut123 / Scrawll

  Scrawll : a tool to download enormous amount of good quality wallpaper pictures for free ( Python3)

  python3crawllerscrapperpython-scraperpixelhdwallpapercollectorcodereqsslbs4urllibwget
  Language:Python 5

• Manish-M2018 / MSRIT-Results-scraper

  CLI tool to scrape the results of the students from the website

  pythonpython3python-scraperpython-scriptclitoolbeautifulsoupurlliboptparsehtmleducationscraping-websites
  Language:Python 5

• rounakdatta / Xcheck

  Fake news detection

  fakenewsdetectormachine-learningpython-scraperdjangohackathon
  Language:Python 5

• sharibarboza / py_zap

  A Python scraper for fetching TV ratings from tvbythenumbers.zap2it.com.

  tvpython-scraperzap2itscreenertvratings
  Language:Python 5
• weheartpy

  aswinnnn / weheartpy

  A fast, reliable API wrapper for weheartit.com

  weheartitscrapeapi-wrapperapipythonbeautifulsoupscrapingpython-scraperapi-clientpinterestpython-librarypython3
  Language:Python 4

• Hatim315 / Manhua-Manga-Manhwa_Downloader

  This script downloads manhua, manga or manhwa and save them in a same name directory.

  image-scrapermangamanga-scrapermanhuamanhua-scrapermanhwamanhwa-scraperwebsite-scraperscraperadvanced-scraperpython3pythonpython-3python-scraperasynchronousasyncioasyncasynchronous-programming
  Language:Python 4