apify
There are 5 repositories under apify topic.
- crawlee
apify / crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Language:TypeScript 12353 Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.
Language:TypeScript 116House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
Language:JavaScript 113- Language:TypeScript 108
- apify-sdk-python
The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.
Language:Python 108 amitupreti / Hands-on-WebScraping
This repo is a part of blog series on several web scraping projects where we will explore scraping techniques to crawl data from simple websites to websites using advanced protection.
Language:Python 83VaclavRut / actor-amazon-crawler
Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.
Language:JavaScript 68maxCopell / tripadvisor-scraper
Scrape Tripadvisor restaurant, hotels, and places.
Language:JavaScript 47- Language:JavaScript 40
- Language:Python 38
- actor-youtube-scraper
bernardro / actor-youtube-scraper
Apify actor to scrape Youtube search results. You can set the maximum videos to scrape per page as well as the date from which to start scraping.
Language:JavaScript 23 You can use this act to monitor any page's content and get a notification when content changes.
Language:JavaScript 18JuroOravec / crawlee-one
Crawlee One is a framework built on top of Crawlee and Apify for writing robust and highly configurable web scrapers.
Language:TypeScript 16metalwarrior665 / actor-google-sheets
No more dealing with Google API. Simple Node.js program to automate access to Google Sheets.
Language:JavaScript 16lhotanok / actor-ticketmaster-scraper
Apify actor for scraping events from Ticketmaster based on their categories
Language:JavaScript 13pocesar / actor-twitter-scraper
Scrape any Twitter user profile. Extract tweets, retweets, replies, favorites, and conversation threads with no Twitter API limits
Language:TypeScript 12sauermar / web-browser-recorder
Web application for recording, management and editing of inteligent RPA workflows using Playwright technology
Language:TypeScript 12Combines Apify's crawling system and article parsing with unfluff library.
Language:JavaScript 11petrpatek / airbnb-scraper
Apify public actor for scraping Airbnb homes.
Language:JavaScript 11- Language:PHP 10
Experimental scraper in Rust suited for running locally or on the Apify platform. Inspired by Apify SDK.
Language:Rust 10Automate monitoring prices on the most popular solution for building online stores and selling products online. Crawl arbitrary Shopify-powered online stores and extract a list of all products in a structured form, including product title, price, description, etc
Language:JavaScript 10Apify actor to run web spiders written in Python in the Scrapy library
Language:Python 9Grab a session for any website for usage on your own actor
Language:TypeScript 9- Language:JavaScript 8
cermak-petr / act-anti-captcha-recaptcha
Apify act for solving google recaptcha using the anti-captcha.com service.
Language:JavaScript 8Nikolay-Lysenko / servifier
An easy-to-use tool for making web service with API from your own Python functions.
Language:Python 8apify-projects / store-website-checker
Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.
Language:TypeScript 6The actor implements the legacy Apify Crawler product. It uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of JavaScript code.
Language:JavaScript 6ganevdev / actor-webdesignernews-scraper
Scraper for www.webdesignernews.com, using Apify.
Language:TypeScript 6Apify actor extracting data from Zalando
Language:TypeScript 6- Language:JavaScript 6
- Language:JavaScript 5
Search organisations from Erasmus+ and European Solidarity Corps programmes. Define search criteria such as legal name, business name, hyperlink, PIC or an OID from: https://webgate.ec.europa.eu/erasmus-esc/index/organisations/search-for-an-organisation
Language:TypeScript 4Get Coronavirus epidemilogy data for Brazil in CSV
Language:JavaScript 4Strajk / actor-github-repositories-search-scraper
Apify actor for extracting repositories from GitHub based on search queries
Language:JavaScript 4
