web-extraction

There are 2 repositories under web-extraction topic.

• platonai / PulsarRPAPro

  Fully automated and hands-free, accurately extracting and understanding web content — powered by machine learning agents.

  aiauto-web-miningmlscrapingweb-crawlerweb-extractionweb-scrapingrpa
  Language:Kotlin 125

• lightfeed / extractor

  Using LLMs and AI browser automation to robustly extract web data

  ai-agentsarticle-extractorcrawlerdata-engineeringdata-pipelineetlgoogle-geminihtml-parserhtml-to-markdownllmllm-extractionllm-scrapermarkdownnlpopenairagrss-feedweb-data-extractionweb-extractionwebscraping
  Language:TypeScript 52

• iamxiatian / octopus_spider

  基于Scala Akka的分布式主题网络爬虫

  spidercrawlerakkaweb-extractionscala-spiderscala-crawlerakka-spiderakka-crawler
  Language:Scala 15

• galinaalperovich / Ms-Thesis-CVUT

  Automatic extraction of the information on local event from a webpage with Machine Learning

  information-retrievalinformation-extractionweb-extractionmachine-learning
  Language:Jupyter Notebook 5

• lightfeed / browser-agent

  Serverless AI browser agent

  aiai-agentsautomationaws-lambdabrowserbrowser-agentbrowser-automationcrawlingplaywrightscrapingserverlessserverless-frameworkweb-crawlingweb-extractionweb-scraping
  Language:TypeScript 3

• akshatsinghal92 / Product-recommendation-analysis

  Predicting product recommendation score using the data available on the website of the client

  web-extractionselenium-pythonnlppythonseaborn-plotsword-embeddingsregression-modelsmachine-learningtextblob-sentiment-analysisuniversal-sentence-encoderpartial-dependence-plot
  Language:Jupyter Notebook 2

• avirathtib / scrapeneatly

  A powerful and lightweight web scraping library with LLM extraction capabilities. This library combines web scraping with AI-powered content extraction using either OpenAI or OpenRouter APIs.

  llmsopen-sourcescrapingstructured-web-dataweb-extraction
  Language:Python 2

• franciscomvargas / DeUrlCruncher

  Get google URL results from search query

  web-extraction
  Language:Batchfile 1

• timkriz / wieramemo_vase

  Programming assignments for Web Information Extraction and Retrieval, FRI UL, 2021. PA1: standalone webcrawler of .gov.si web sites, PA2: approaches of the structured web data extraction, PA3: Data processing and indexing and Data retrieval.

  htmlpythonregexweb-extractionwebcrawlerwebcrawlingxpath
  Language:HTML 1

• Victor-Pavageau / AverageMoviesDuration

  pythonpython3moviesallocinebeautifulsoupbeautifulsoup4requestsmatplotlibscatter-plotmeanpython-threadingthreadthreadingweb-extraction
  Language:Python 0

• bharatpurohit97 / Webextractor

  Extracting links from any website.

  pythonseleniumweb-extraction
  Language:Python

• gazelle93 / Various-Web-Text-Extraction-Methods

  This project is a command-line tool that extracts text from web pages and PDF files, including scanned documents. It supports various extraction methods. This tool is ideal for data scraping, NLP preprocessing, and content analysis.

  natural-language-processingnlppdf-extractiontext-extractionweb-extraction
  Language:Python