extract-data

There are 9 repositories under extract-data topic.

• opendatalab / MinerU

  A one-stop, open-source, high-quality data extraction tool, supports PDF/webpage/e-book extraction.一站式开源高质量数据提取工具，支持PDF/网页/多格式电子书提取。

  ai4sciencedocument-analysisextract-datalayout-analysisocrparserpdfpdf-converterpdf-extractor-llmpdf-extractor-pretrainpdf-extractor-ragpdf-parserpython
  Language:Python 11763

• bda-research / node-crawler

  Web Crawler/Spider for NodeJS + server-side jQuery ;-)

  cheeriocrawlerextract-datajavascriptjquerynodejsspider
  Language:TypeScript 6694
• PyMuPDF

  pymupdf / PyMuPDF

  PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

  data-scienceepubextract-datafontmupdfocrpdfpdf-documentspymupdfpythontable-extractiontesseracttext-processingtext-shapingxps
  Language:Python 5174

• meltano / meltano

  Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

  dataopsdataops-platformeltopen-sourceopensourcedatapipelinesextract-datameltanomeltano-sdkconnectorsintegrationtaptapstargettargetsloadersdata-pipelinessingerdata-engineering
  Language:Python 1796

• markummitchell / engauge-digitizer

  Extracts data points from images of graphs

  digitizerextract-dataimage-analysisutility
  Language:C++ 1232

• elixir-crawly / crawly

  Crawly, a high-level web crawling & scraping framework for Elixir.

  elixirerlangscraperscrapingscraping-websitesextract-dataspidercrawlercrawling
  Language:Elixir 971

• slotix / dataflowkit

  Extract structured data from web sites. Web sites scraping.

  cdpchrome-fetchercrawlingextract-datagogolanggolang-libraryheadlessscraperscrapingscraping-websites
  Language:Go 658

• danschultzer / receipt-scanner

  Receipt scanner extracts information from your PDF or image receipts - built in NodeJS

  extract-dataextract-informationocroptical-character-recognitionreceipt-scannerreceipts
  Language:JavaScript 293

• OmkarPathak / ResumeParser

  A simple resume parser used for extracting information from resumes

  resume-parserextract-dataguipython3pythonparser
  Language:Python 288

• Qusic / TraceUtility

  Extract data from .trace documents generated by Instruments

  instrumentsextract-datareverse-engineeringprofilingxcode
  Language:Objective-C 224

• jpjacobpadilla / Stealth-Requests

  Undetected Web-Scraping & Seamless HTML Parsing in Python!

  http-requestsrequestswebscrapingbrowser-automationhtml-parsinghttp-clientweb-scrapingpython-scrapingpython-web-crawlerweb-crawlerextract-dataxpath
  Language:Python 143

• yuanxu-li / html-table-extractor

  extract data from html table

  html-tableextract-databeautifulsouphtmltablescrapingcrawler
  Language:Python 84

• ropensci / smapr

  An R package for acquisition and processing of NASA SMAP data

  nasasmap-datarasterextract-dataacquisitionsoil-moisturesoil-moisture-sensorsoil-mappingpeer-reviewedrr-packagerstats
  Language:R 79

• msoap / html2data

  Library and cli for extracting data from HTML via CSS selectors

  golangextract-datahomebrewhtmlcss-selectorclilibraryscrappingparser
  Language:Go 68

• CairX / extract-colors-py

  Extract colors from an image. Colors are grouped based on visual similarities using the CIE76 formula.

  extract-dataimage-colorscie76extract-colors
  Language:Python 67

• isaacmg / fb_scraper

  FBLYZE is a Facebook scraping system and analysis system.

  extract-datafacebook-scraperflinkkafkasparktf-idf
  Language:Jupyter Notebook 64

• fivesmallq / web-data-extractor

  Extracting and parsing structured data with jQuery Selector, XPath or JsonPath from common web format like HTML, XML and JSON.

  extract-datajquery-selectorjsonpathspiderxpath
  Language:Java 54

• Techcatchers / PyLyrics-Extractor

  Get Lyrics for any songs by just passing in the song name (spelled or misspelled) in less than 2 seconds using this awesome Python Library.

  extract-datalyrics-fetcherpython-librarysearch-algorithm
  Language:Python 53

• asad70 / Insider-Trading

  This program extracts insider trading data from the sec website and stores it in excel file for the specified time frame.

  insider-tradingextract-dataalgotradingtradingtickerstrading-strategiesinsidersdata-science
  Language:Python 52

• labteral / bluebird

  Unofficial Python client for Twitter

  scrapingcrawlingsocial-mediaextract-datacrawlerscraperscraper-enginetwittertwitter-apitwitter-bottwitter-clienttwitter-streaming-apitwitter-scrapertwitter-streamtwitter-searchtwitter-scrapingtweets
  Language:Python 43

• osh / gr-eventstream

  gr-eventstream is a set of GNU Radio blocks for creating precisely timed events and either inserting them into, or extracting them from normal data-streams precisely. It allows for the definition of high speed time-synchronous c++ burst event handlers, as well as bridging to standard GNU Radio Async PDU messages with precise timing easily.

  burstc-plus-plusevent-handlingextract-dataextractorgnu-radioinjectionmessage-passingpythonradiosignal-processingsignaling-pathwayssynchronizationsynchronization-servicesynchronoustiming-simulator
  Language:C++ 42

• giveabit / Trio-Plus-Data

  Extract audio and other data from the Digitech Trio Plus guitar pedal's SD card

  guitartriodigitech-triodigitech-trio-plustrio-plusmusicextract-audioextract-data
  Language:Python 41

• Mamdouh66 / Extracty

  Extract structured data from any unstructured web page

  extract-datainstructorpydanticscraperscrapingllm-scraper
  Language:Python 38

• Skyluker4 / UnityAssetReplacer

  A tool to replace data in a Unity Asset Bundle from modified files.

  csharpunityasset-bundleasset-bundlesasset-bundlingreverse-engineeringextractextractorextractionextract-datadotnet-coredotnetdotnet-5
  Language:C# 34

• peterbencze / serritor

  Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaScript to render data.

  crawlerjavaseleniumframeworkscraperdynamic-websitedynamic-webpagesautomationdata-miningselenium-crawlerscrapingscraping-frameworkcrawling-frameworkinformation-retrievalinformation-extractionwebspidercrawlingcrawlerscrawlextract-data
  Language:Java 31

• hseera / python-utilities

  Different python utility scripts to help automate mundane/repetitive tasks. Useful for performance testers/data scientist or anyone who wants to automate mundane tasks in python.

  python-utilitiesextract-datasortspythonpivot-tablesutilitiesswap-columnsabnacnjmetercsvtfncreditcard-generatorverbosegcwebspherevisualizationfilenamelighthouse-audits
  Language:Python 25

• ionictemplate-app / Social-Network-Data-Scraper-Pro

  Easily scrape 10,000+ email messages in one hour, helping you quickly increase your customers Extracts data from (LinkedIn, Facebook, Instagram, Youtube, Pinterest, Twitter) Perfect search by specific Keywords Ready-to-use Social Network Data Scraper Software to get started instantly 100% Include source code and install file

  business-emailbusiness-extractoremail-scraperextractor-emailscraper-addressscraper-emailscraper-facebookscraper-instagramscraper-linkedinscraper-namescraper-phonescraper-twitterextract-dataextract-emailssocial-mediasocial-networksocial-scrapergoogle-extract
  24

• righthandabacus / mdict_reader

  Extract data from Octopus mdict (*.mdd, *.mdx) files

  pythonoctopus-mdictmdict-readerextract-data
  Language:Python 22

• serhaturtis / TOOL-FastBatchImageCrop

  A simple UI tool to batch crop images to prepare datasets from images and videos.

  dataset-generationguiimage-classificationmachine-learningstable-diffusionuicropping-imagesextract-datapython
  Language:Python 22

• ark-mod / ArkSavegameToolkitNet

  Library for reading ARK Survival Evolved savegame files using C#.

  arkarksurvivalevolvedextract-datagamegame-ark
  Language:C# 21

• peterstangl / svg2data

  A Python module for reading data from a plot provided as SVG file.

  svgplotpdfextract-datadata-extraction
  Language:Python 21

• mhismail / PinPoint-Digitizer

  Open source digitizer application to extract data from plots

  datadigitizerelectron-appextract-dataextractionfreejavascriptopensourcepinpointplot
  Language:SCSS 20

• pdfix / pdfix_sdk_example_cpp

  Make PDF Files Accessible, Extract Data from PDF, Convert PDF to HTML, Fill-in PDF Form, Stamp PDF and more...

  pdf2htmlpdfuadigital-signaturepdf-converterpdf-manipulationextract-datapdf-data-extractionwatermarkhtmlmetadataconversionconvertertaggingautotagwcagsignpdf-formspdfcontent-extractionaccessibility
  Language:C++ 20

• Akulbasov / PGA

  This is a library for making batch request to Google Analytics Core Reporting v3 API and extracting data from Google Analytics property into Python 3 data structures.

  google-analyticsdata-framepgapandasextract-data
  Language:Python 19

• alienzhou / giframe

  extract the first frame in GIF without reading whole bytes, support both browser and nodejs 📸

  gifdecoderframeextract-datastream-likeprogressivegif89agif87a
  Language:TypeScript 17

• rdlopes / WebHere

  HTML scraping for Objective-C.

  ioshtmlwebscrapingosxxpathextract-datacocoapodsafnetworkinggdataxml-htmlnocilla
  Language:Objective-C 17