content-extraction

There are 3 repositories under content-extraction topic.

• currentslab / extractnet

  A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one package

  content-extractionauthor-extractiondate-extractionwebscrapingweb-scrapingtext-cleaningtext-miningnews-extractornews-extractionnewsnews-articlesmachine-learningpython
  Language:HTML 176

• mvasilkov / readability2

  Readability2 converts HTML to plain text.

  javascriptreadabilityhtmlplaintextcontent-extraction
  Language:TypeScript 107

• gregors / boilerpipe-ruby

  Pure ruby implementation of the Boilerpipe content extraction algorithm tuned for online articles

  boilerpipe-algorithmboilerpipecontent-extractionwebscrapingnews
  Language:Ruby 40

• tuffstuff9 / nextjs-pdf-parser

  Next.js template for seamless PDF parsing using pdf2json and FilePond. Ideal for developers seeking a ready-to-use solution for PDF content extraction in Next.js projects.

  content-extractionfilepondnextjspdf-parsepdf-parserpdf-parsingpdf-uploadpdf2jsonreact-pdfnextjs-pdfnextjs-pdf-parsenextjs-pdf-parsernextjs-pdf-parsingreact-pdf-parser
  Language:TypeScript 36

• nikitautiu / learnhtml

  Web content extraction using machine learning

  deep-learninghtmlcontent-extraction
  Language:HTML 32

• gdamdam / sumo

  Tool to extracts the text from a web article urls and get frequency words, entities recognition, automatic summary and more

  sentence-extractionautomatic-summarizationnlpcontent-extractionnltkentity-recognitionsemantic-analysis
  Language:Python 19

• pdfix / pdfix_sdk_example_cpp

  Make PDF Files Accessible, Extract Data from PDF, Convert PDF to HTML, Fill-in PDF Form, Stamp PDF and more...

  pdf2htmlpdfuadigital-signaturepdf-converterpdf-manipulationextract-datapdf-data-extractionwatermarkhtmlmetadataconversionconvertertaggingautotagwcagsignpdf-formspdfcontent-extractionaccessibility
  Language:C++ 16

• LandWhale2 / TD-Spider

  Via Text Density Simple Web Crawler With Go

  golangweb-crawlerkeyword-searchcontent-extractiondata-miningdomopensourcescrapingtext-density
  Language:Go 13

• timoteostewart / benson

  Benson turns a list of URLs into mp3s of the contents of each web page - take control over your reading backlog!

  content-extractionboilerplate-removalweb-scrapingproductivity
  Language:Python 13

• peremenov / seize

  Seize is light Node or Browser web-page content extractor inspired by arc90 readability and Safari Reader

  content-extractiondomtext-scorereadabilityextractreader
  Language:HTML 12

• zeoagency / mobile-first-indexing-tool

  Mobile First Indexing Tool

  mfiseoseo-toolcontent-extractionaws-layersaws-lambdalighthouse
  Language:Python 11

• bencmc / youtube_video_summarizer

  This repository houses a Python application for extracting YouTube video transcripts and summarizing its content.

  content-extractiongpt-35-turbonaturalnatural-language-processingopenaipythontext-processingtext-summarizationtranscript-analysisvideo-processingyoutube-apilangchain-pythonstreamlit
  Language:Python 7

• oiwn / dom-content-extraction

  DOM Based Content Extraction via Text Density

  scrapingcontent-extractiondom-based
  Language:Rust 4

• minarc / godensity

  This repository is implematation of 📄 DOM based content extraction via text density. Tested for Korean web pages.

  content-extractionweb-content-extractor
  Language:Go 3

• pdfix / pdfix_sdk_example_node_js

  Example project demonstrating how to use PDFix SDK WebAssembly build in Node.js. Make PDF Files Accessible, Extract Data from PDF, Convert PDF to HTML, Fill-in PDF Form, Stamp PDF and more...

  wasmwebassemblynodejspdf2htmlsdkpdf-converterextract-datapdf-data-extractionhtmlconversiontaggingsignpdf-formspdfpdf-manipulationautotagcontent-extraction
  Language:JavaScript 3
• crawler

  rmwkwok / crawler

  Multi-process crawler which extracts main content and sustain itself by extracting more links to crawl.

  crawlermultiprocesscontent-extraction
  Language:Python 3

• SbstnErhrdt / node-readability

  Simple node server to extract relevant content from website source code using Mozilla's Readability.js

  content-extractiondockernoderedability
  Language:JavaScript 3

• SvenEichelsheimer / filegazer

  FileGazer - deep file analysing and categorisation

  document-processingocrtesseracttikafile-analysingdocument-categorisationcontent-extraction
  3

• TypesetIO / jsuite

  Tools for parsing and manipulating JATS XML documents.

  xml-schemacontent-extraction
  Language:Python 3

• leroyanders / acrticle-scrapper

  This Python-based repository hosts a sophisticated service designed for scraping web articles and converting them into Markdown format. The core functionality of this service includes extracting the main content of articles, such as headlines, key paragraphs, and associated images, and then seamlessly transforming this content into well-structured…

  article-parsercontent-extractiondata-archivinghtml-to-markdown-converterimage-downloadingmarkdown-conversionmetadata-extractionpythonweb-scrapingcontent-creation-tools
  Language:Python 1

• thorkill / dbce

  Diff Based Content Extraction is a part of my Bachelor Thesis: Joint Approach to Boilerplate Detection in Web Archives

  content-extractionwebarchivemachine-learningmachine-learning-algorithmsbachelor-thesishtml-content-extraction
  Language:HTML 1

• bhut-vasu / Theai

  artificial-intelligencecontent-extractionmern-stack-development
  Language:JavaScript 0
• news-feed-scraper

  HarryDulaney / news-feed-scraper

  Configurable and schedulable web scrapping tool. Used to extract raw article content and metadata for aggregated news feeds.

  content-extractionjava-web-scrapernews-feednews-feed-providernewsscraperscraperscraperapiweb-automationwebscraper
  Language:Java

• KunlinY / DistributedCrawlSystem

  分布式爬虫系统

  content-extractioncrawlerjavaredis
  Language:Java

• masud-technope / ContentSuggest-Replication-Package-CASCON2015

  Recommending Relevant Sections from a Webpage About Programming Errors and Exceptions

  content-extractioncontent-suggestreplication-packagedom-manipulation
  Language:Hack

• midstreeeam / peduncle

  content extraction from html

  content-extraction
  Language:Python

• pdfix / pdfix_sdk_example_npm

  Example project demonstrating how to use PDFix SDK WebAssembly build in Node.js. Make PDF Files Accessible, Extract Data from PDF, Convert PDF to HTML, Fill-in PDF Form, Stamp PDF and more...

  autotagcontent-extractionconversionextract-datahtmlnodejspdfpdf-converterpdf-data-extractionpdf-formspdf-manipulationpdf2htmlremediationsdktaggingwasmwebassemply
  Language:JavaScript

• sebischair / LowestCommonAncestorExtractor

  A python content extraction library for the structured extraction of Terms and Conditions from German and English online shops

  content-extraction
  Language:Python