scraping-api

There are 2 repositories under scraping-api topic.

• amazon-scraper

  oxylabs / amazon-scraper

  Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.

  amazonamazon-apiamazon-scraperamazon-scrapinge-commerce-apiweb-scrapingcsharpjavascriptpythonapiscrapergolangphpamazon-scraper-apigithub-pythonamazon-scraping-libraryamazon-price-trackerurl-scraperemail-scraperscraping-api
  Language:Python 504
• serp-scraper-api-guide

  oxylabs / serp-scraper-api-guide

  A quick-start guide on using SERP Scraper API

  pythonscrapergithub-pythonscraping-pythonwebsite-scrapingurl-scraperemail-scrapergoogle-maps-scrapinggoogle-search-apiweb-search-apiscraping-apiserp-apiserp-scraperserp-scraper-apiserp-scrapingserp-api-pythongoogle-map-scrapergoogle-scrapergoogle-scraper-api
  380

• Azure-Samples / durablefunctions-apiscraping-dotnet

  Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.

  azureazure-functionsdotnetdotnet-corescraping-api
  Language:C# 105

• pavlovtech / WebReaper

  Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

  crawlerparserwebcrawlerwebscrapingdataminingscraperparsingscrapingscraping-apiscraping-datascraping-toolscraping-webscraping-websites
  Language:C# 92

• ScrapingAnt / amazon_scraper

  Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

  amazonamazon-scraperamazon-scraping-librarydata-miningjsnode-jsprice-scraperprice-scrapingscrape-productsscraperscrapingscraping-apiscraping-datascraping-pythonscraping-webscraping-websitesweb-crawlerweb-crawlersweb-crawling
  Language:JavaScript 75
• instagram-without-api-node

  orsifrancesco / instagram-without-api-node

  A simple Node.js code to get unlimited instagram public pictures by every user without api, without credentials.

  instagraminstagram-apiinstagram-scrapernodenode-jsnodejsscraperscrapingscraping-apiwithout-api
  Language:JavaScript 63

• Matthew17-21 / Captcha-Tools

  All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!

  captchascraperscrapingscraping-apisneakerssneakerbotsneakerbotsrecaptchahcaptcha2captcha2captcha-apianticaptchaanticaptcha-clientcapsolvercapsolvercom
  Language:Go 57

• serpapi / serpapi-python

  an official Python client library for SerpApi.

  api-clientpythonscraping-apiserpapiapi-wrappergoogle-search-apigoogle-search-resultsrequestsapi
  Language:Python 37

• Azure-Samples / durablefunctions-apiscraping-nodejs

  Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.

  azureazure-functionsjavascriptnodejsscraping-api
  Language:JavaScript 34

• kunalnagarco / imdb-scraper

  🎬 An attempt at the most complete IMDb API

  imdbimdb-apiimdb-datasetimdb-informationimdb-moviesimdb-webscrappingscraperscraping-apiscraping-websites
  Language:TypeScript 34

• serpwow / google-search-results-nodejs

  Scrape and parse Google search results in Node.JS

  googleserpserp-apiseoseotoolsseo-toolsseo-monitorscrapingscraping-apiserpwow
  Language:JavaScript 32

• MontFerret / ferret-server

  Advanced declarative web scraping

  crawlingdata-miningferret-servergolangquery-languagescraperscrapingscraping-apiserver
  Language:Go 29

• ScrapingAnt / zoominfo_scraper

  Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

  dataminingleadgenleadgenerationpythonscraperscrapingscraping-apiscraping-datascraping-toolscraping-websitesweb-crawlerweb-crawler-pythonweb-crawlingweb-harvestingzoominfo-client
  Language:Python 27

• Smartproxy / eCommerce-Scraping-API

  eCommerce Scraping API code examples for Python, PHP and Node.js

  aliexpress-scraperamazonamazon-scraperamazon-scrapingamazon-scraping-librarydata-miningdata-scrapingecommerce-scrapingecommerce-web-scraperidealoprice-scraperprice-scrapingpython-scrapingscrapescrapingscraping-apiscraping-datascraping-webscraping-websiteswayfair
  Language:PHP 22
• ryuanime

  ChrisMichaelPerezSantiago / ryuanime

  A free anime streaming , using the jkanime content by scraping the jkanime website.

  jkanimescraping-websitesstreaming-videotypescriptnodejsexpreesvuejsscraping-apivideosanimeelectron-appdesktop-application
  Language:Vue 21

• crawlbase / proxycrawl-node

  ProxyCrawl Node library for scraping and crawling

  crawlercrawlingproxycrawlproxycrawl-apiscraperscrapersscrapingscraping-apiscraping-websites
  Language:JavaScript 21

• Smartproxy / Web-Scraping-API

  Web Scraping API code examples for Python, PHP and Node.js

  data-miningdata-scrapingfacebook-scrapinginstagram-scrapernodejs-scrapingphp-scrapingpython-scraperpython-scrapingscraperscrapingscraping-apiscraping-webscraping-websitessocial-media-scrapersocialmediascrapertwitter-scrapingweb-scraperweb-scrapingwebscraperwebscraper-api
  Language:JavaScript 20

• serpwow / google-search-results-php

  Scrape and parse Google search results in PHP

  googleserpserp-apiseoseo-toolsseo-monitorscrapingscraping-apiserpwow
  Language:PHP 19

• scrapfly / python-scrapfly

  Scrapfly Python SDK for headless browsers and proxy rotation

  crawlerheadless-browserpythonscraperscrapingscraping-apisdkweb-scraperweb-scraping
  Language:Python 18

• ScrapingAnt / alibaba_scraper

  Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

  alibaba-scraperdataminingprice-scraperprice-scrapingpythonscraperscrapingscraping-apiscraping-datascraping-toolscraping-webscraping-websitesweb-crawlerweb-crawler-pythonweb-crawling
  Language:Python 17

• Smartproxy / SERP-Scraping-API

  SERP Scraping API code examples for Python, PHP and Node.js

  baidubingdata-miningdata-scrapinggooglegoogle-scrapergoogle-scrapingpython-scrapingscrapescraperscrapingscraping-apiscraping-datascraping-webserpserp-apiserp-scraperserp-scrapingserpapiyandex
  Language:PHP 15

• mateuszbuda / instagram-scraping-fish

  A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com

  instagrampythonscraperscrapingscraping-apiscraping-pythonweb-scraping
  Language:Jupyter Notebook 13
• acciotables

  npranav10 / acciotables

  API to scrap data from dynamic webpages. (say tables on Sports Reference websites)

  api-serviceherokuherokuapppuppeteerscrapingscraping-apiscraping-websites
  13

• Smartproxy / Social-Media-Scraping-API

  Social Media Scraping API code examples for Python, PHP and Node.js

  instagraminstagram-scrapernodejsphppythonscrapingscraping-apisocial-mediatiktoktiktok-scrapertiktok-apitwittertwitter-apitwitter-scrapertwitter-scraping
  Language:PHP 13

• crawlbase / scrapy-proxycrawl-middleware

  Scrapy middleware interface to scrape using ProxyCrawl proxy service

  middlewareproxycrawlproxycrawl-apiscraperscrapingscraping-apiscrapyscrapy-crawlerscrapy-framework
  Language:Python 10

• juftin / yellowstone-camping

  Campsite Reservation Cancellation Finder (Yellowstone National Park)

  pythondockerscrapingpush-notificationspushovercampingnational-parksscraping-api
  Language:Python 10

• mateuszbuda / webscraping-benchmark

  Web scraping API benchmark

  benchmarkpythonscraperscrapingscraping-apiscraping-pythonweb-scrapingwebscraping
  Language:Python 9
• Doublegram-Startup-Telegram-Scraper-Adder

  BeyondGoodAndDev / Doublegram-Startup-Telegram-Scraper-Adder

  Add users to your groups and channels automatically using your Telegram accounts. Doublegram let you do that easily and in an automatic and personalized way.

  adderbotpythonscrapingscraping-apitelegramtelegram-channel-member-scrapertelegram-scrape-more-than-10k-membertelegram-scrapertelegram-scraper-2024telegram-scraper-bottelethontelethon-api
  Language:Python 8

• umihico / minigun-requests

  Web scraping API to outsource tons of GET & xpath to cloud computing

  scrapingweb-scrapingscraping-apiscraping-pythoncrawlercrawlingscraping-framework
  Language:Python 8

• vulturno / lurte

  🌊 Scraping AEMET

  aemetbash-scriptopen-datascraperscrapingscraping-apispain
  Language:Shell 8

• fckveza / create-proxy

  HTTP / HTTPS Proxy

  proxy-serverproxyproxy-httpsbot-wabot-linescrapscraping-apiscraping
  6

• jaeyk / digital_data_collection_workshop

  Digital Data Collection Workshop

  scraping-websitesscraping-toolscraping-datascraping-botscraping-api
  Language:HTML 6

• Santa-Clara-Media-Lab / twitter-scraping-with-python

  Twitter Scraping with Python!

  pythondata-sciencescraping-pythonscraping-apidata-miningsocial-mediatwitterdata-mining-pythonsocial-media-analysisdata-analysisresearch-project
  Language:Python 6

• serpwow / google-search-results-golang

  Scrape and parse Google search results in Golang

  googleserpserp-apiseoseo-toolsseo-monitorscrapingscraping-apiserpwow
  Language:Go 5

• KalyanM45 / Article-Web-Scraping

  This Python script is designed to scrape articles from The Guardian's technology section using their API. It fetches article data, extracts the titles and content, and then saves each article's content to separate text files. The text files are organized in a folder named with the current date and time of the scraping.

  article-scraperbeautifulsoupbs4scrapingscraping-apiweb-scraping
  Language:Jupyter Notebook 4

• Smartproxy / trustpilot_python_scraper

  Scrape Trustpilot utilising Smartproxy's Web Scraping API

  htmljsonparserparsingpythonpython3scrapingscraping-apitrustpilotweb-scraperweb-scrapingwebscraperwebscraping
  Language:Python 4