html-to-markdown

There are 33 repositories under html-to-markdown topic.

• firecrawl / firecrawl

  The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data 🔥

  aicrawlerdatamarkdownscraperhtml-to-markdownllmragscrapingweb-crawlerai-scrapingwebscraping
  Language:TypeScript 57422

• ScrapeGraphAI / Scrapegraph-ai

  Python scraper based on AI

  scrapingscraping-pythonautomated-scraperllmaiweb-crawlerweb-scrapingai-scrapingcrawlerhtml-to-markdownmarkdownragweb-crawlers
  Language:Python 21296

• mixmark-io / turndown

  🛏 An HTML to Markdown converter written in JavaScript

  javascripthtmlmarkdownhtml-to-markdownbrowsernodecommonmarkgfm
  Language:HTML 10259

• adbar / trafilatura

  Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

  web-scrapingtext-extractionnlphtml2texttext-miningcrawlertext-cleaningtext-preprocessingarticle-extractorreadabilityscrapingnews-crawlerteihtml-to-markdowncorpus-buildercorpus-toolsrss-feednews-aggregatorragllm
  Language:Python 4672
• html-to-markdown

  JohannesKaufmann / html-to-markdown

  ⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules.

  gogolanghtmlhtml-to-markdownmarkdownconvertercli
  Language:Go 3081

• vsch / flexmark-java

  CommonMark/Markdown Java parser with source level AST. CommonMark 0.28, emulation of: pegdown, kramdown, markdown.pl, MultiMarkdown. With HTML to MD, MD to PDF, MD to DOCX conversion modules.

  commonmarkpegdownjavamarkdown-parsermarkdown-processormarkdown-conversionmarkdown-flavorsmarkdownmarkdown-to-htmlhtml-to-markdownmarkdown-to-pdf
  Language:Java 2493

• any4ai / AnyCrawl

  AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

  aitoolscrawlscrapeserpwebscraperai-scrapingdatahtml-to-markdownragscraping
  Language:TypeScript 2143

• helloworld-Co / html2md

  helloworld 开发者社区开源的一个轻量级，强大的 html 一键转 md 工具，支持多平台文章一键转换，并保存下载到本地。

  htmlmdvuejavascriptmarkdown-to-htmlmarkdowncsdnjuejinnodejsdomnuxthtml-to-markdown
  Language:JavaScript 768

• philschmid / clipper.js

  HTML to Markdown converter and crawler.

  crawlhtml-to-markdownmarkdownnlpretrieval-augmented-generationsearch
  Language:TypeScript 591

• firecrawl / firecrawl-app-examples

  🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.

  aiai-scrapingdataexampleshtml-to-markdownllmmarkdownragscrapersweb-crawlertemplates
  Language:Jupyter Notebook 544

• breakdance / breakdance

  It's time for your markup to get down! HTML to markdown converter. Breakdance is a highly pluggable, flexible and easy to use.

  markdownhtmlconvertparsecompilerenderto-markdownhtml-to-markdownconvertermarkupgfmcommonmarkturndownremarkablemarkedmarkdown-it
  Language:JavaScript 533

• devflowinc / firecrawl-simple

  ➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.

  aiai-scrapingcrawlerdataembeddingshtml-to-markdownllmmarkdownragscraperscrapingsearchweb-crawlerwebscraping
  Language:TypeScript 519

• paulpierre / markdown-crawler

  A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

  html-to-markdownhtml-to-markdown-converterhtml2mdllmllmopsmarkdownmarkdown-parserragweb-scrapermarkdown-crawlermarkdown-scrapermd-crawler
  Language:Python 402

• mrusme / reader

  reader is for your command line what the “readability” view is for modern browsers: A lightweight tool offering better readability of web pages (and EML files!) on the CLI.

  clituicommand-linecommand-line-toolhtmlmarkdownhtml-to-markdownasciiascii-artreadabilitywebterminalterminal-basedreader
  Language:Go 374
• copy-as-markdown

  notlmn / copy-as-markdown

  📋 Browser extension to copy text as Markdown (with GFM and MathML support)

  markdownhtml-to-markdownbrowser-extensionchrome-extensionfirefox-addon
  Language:JavaScript 366

• inhumantsar / slurp

  Slurps webpages and saves them as clean, uncluttered Markdown. Think Pocket, but better.

  html-to-markdownobsidian
  Language:TypeScript 243

• 0x6b / copy-selection-as-markdown

  Firefox add-on to copy selection as Markdown

  firefox-addonmarkdownhtml-to-markdown
  Language:JavaScript 208
• medium-2-md

  gtmdh / medium-2-md

  A CLI tool that converts exported Medium posts (html) to Jekyll/Hugo compatible markdown with front matter.

  mediummarkdownhtmlhtml-to-markdownjekyllhugofrontmatter
  Language:JavaScript 148

• Spenhouet / confluence-markdown-exporter

  Export Atlassian Confluence pages as markdown files.

  atlassianatlassian-confluenceconfluenceexporthtml-to-markdownmarkdown
  Language:Python 126

• bevacqua / domador

  :smirk_cat: Dependency-free and lean DOM parser that outputs Markdown

  markdownhtml-to-markdown
  Language:JavaScript 86

• oidlabs-com / Lexoid

  Multimodal document parser for high quality data understanding and extraction

  llmspdf-documentparser-librarypdf-parsermultimodalgenailarge-language-modelsocrocr-pythonhtml-to-markdownhtml-to-pdf
  Language:Python 79

• inaridiy / webforai

  The best HTML to Markdown library, A esm-native & Useful Utilities with simple, lightweight and epic quality.

  article-extractorextractorhtml2markdownhtml2mdhtml2textreadabilityscrapingtext-mininghtml-to-markdown
  Language:TypeScript 71

• EvitanRelta / htmlarkdown

  HTML-to-Markdown converter that adaptively preserves HTML when needed (eg. when center-aligning, or resizing images)

  converterhtml-to-markdowntypescriptcommonmarkgfmhtml-converterjavascriptnodenode-jsnodejs
  Language:TypeScript 68

• agarwalvishal / claude-chat-exporter

  Claude Chat Exporter is a JavaScript tool that allows you to export your conversations with Claude AI into a well-formatted Markdown file.

  chatexporterclaudeclaude-aiexportchatconversationconversational-aihtml-to-markdownmarkdown
  Language:JavaScript 66

• tim-gromeyer / html2md

  Transform your HTML into clean, easy-to-read markdown with html2md.

  html-to-markdownhtml5markdowncpp17cpp-libraryhtmlpython3html2markdownhtml2md
  Language:C++ 66

• syfxlin / xkeditor

  :pencil: XK-Editor | 一个支持富文本和Markdown的编辑器

  editormarkdowntinymcemarkdown-editormarkdown-to-htmlhtml-to-markdown
  Language:CSS 58

• ActuallyTaylor / SwiftHTMLToMarkdown

  A simple Swift package that converts HTML into Markdown

  htmlhtml-to-markdownhtml-to-markdown-converterhtmltomarkdownmarkdownswift
  Language:Swift 47

• lightfeed / extractor

  Using LLMs and AI Browser Automation to Robustly Extract Web Data

  ai-agentsarticle-extractorcrawlerdata-engineeringdata-pipelineetlhtml-parserhtml-to-markdownllmllm-extractionllm-scrapernlpragrss-feedweb-data-extractionweb-extractionwebscrapingmarkdowngoogle-geminiopenai
  Language:TypeScript 46
• Stardown

  Stardown-app / Stardown

  Copy the web as markdown

  markdownbookmarksnotestext-fragmentsbrowser-extensionnotetakingobsidianscroll-to-text-fragmentweb-clipperhtml-to-markdowngithub
  Language:JavaScript 40

• iw4p / url-to-markdown

  URL to Markdown API is a service that convert web content into clean, structured Markdown format through a simple HTTP GET request. It's built using FastAPI and the MarkItDown library, offering a straightforward way to convert various content types (web pages, YouTube videos, PDFs, documents) into Markdown that's optimized for Large Language Mod

  html-to-markdownllmmarkdownpdf-to-markdownvectoryoutube-to-markdown
  Language:Python 32

• kasvith / htmd

  A fast HTML to Markdown converter for Elixir, powered by Rust

  elixirelixir-langhtmdhtmlmarkdownrustlerrustler-precompiledturndownhtml-to-markdownhtml2markdown
  Language:Elixir 32

• dedalozzo / converter

  A set of classes to translate a text from a HTML to BBcode and from BBCode to Markdown.

  converterhtmlbbcodemarkdownhtml-to-markdownhtml-to-bbcodebbcode-to-markdownphp
  Language:PHP 27

• ParryQiu / Generate-Cnblogs-Articles-To-Markdown

  导出博客园的文章成 Markdown 文件存储

  cnblogshtml-to-markdown
  Language:C# 25

• izyuumi / html2md-rs

  HTML to Markdown converter written in Rust

  htmlhtml-to-markdownmarkdownrust
  Language:Rust 23

• opendocs-md / do-tutorials

  Digital Ocean tutorials in Markdown format

  digitaloceantutorialsmarkdownhtml-to-markdowndigital-ocean-tutorials
  Language:Ruby 23

• spider-rs / web-crawling-guides

  How to guides on web-crawling or scraping

  agentsai-agentsai-scrapingclean-markdowncrawlerhtml-to-markdownllm-webcrawlerscraperweb-scrapingfast-webcrawler
  23