data-extraction

There are 17 repositories under data-extraction topic.

vi3k6i5 / flashtext
Extract Keywords from sentence or Replace keywords in sentences.
data-extraction keyword-extraction nlp search-in-text word2vec
Language:Python 5530
JonathanLink / PDFLayoutTextStripper
Converts a pdf file into a text file while keeping the layout of the original pdf. Useful to extract the content from a table in a pdf file for instance. This is a subclass of PDFTextStripper class (from the Apache PDFBox library).
data-extraction extract java layout pdf pdfbox text
Language:Java 1531
hi-primus / optimus
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
spark pyspark data-wrangling bigdata big-data-cleaning data-science data-cleansing data-cleaner data-transformation machine-learning data-profiling data-extraction data-exploration data-analysis data-preparation cudf dask dask-cudf data-cleaning
Language:Python 1446
hacker-news-digest
polyrabbit / hacker-news-digest
:newspaper: Let ChatGPT Summarize Hacker News for You
hacker-news python data-extraction hacker-news-reader rss extract-summaries hacker-news-digest spider crawler machine-learning news-aggregator chatgpt chatgpt-api openai openai-api
Language:Python 645
adrienjoly / npm-pdfreader
🚜 Parse text and tables from PDF files.
data-extraction pdf-converter parsing javascript tabular-data pdf-reader parse-tables rule-based-parsing
Language:HTML 580
a-maliarov / amazoncaptcha
Pure Python, lightweight, Pillow-based solver for Amazon's text captcha.
amazon amazon-captcha amazon-scraper amazoncaptcha captcha captcha-solver data-extraction pillow python3 training-data
Language:Python 409
vnstock
thinh-vu / vnstock
A powerful Python library for getting rich data from the Vietnam Stock Market using just a few lines of code
stock-market data-extraction stock-screener
Language:Python 361
molybdenum-99 / infoboxer
Wikipedia information extraction library
data-extraction mediawiki wikipedia
Language:Ruby 173
sypht-python-client
sypht-team / sypht-python-client
A python client for the Sypht API
data-extraction information-extraction api-client python python3 python3-library sypht sypht-python-client sypht-api invoice extract extract-fields extract-data-from-pdf receipt-scanner pdf-parser receipt-capture invoice-parser receipt-reader receipt-scanning document-capture
Language:Python 163
clauneck
serpapi / clauneck
A tool for scraping emails, social media accounts, and much more information from websites using Google Search Results.
automation command-line command-line-tool data-extraction data-extractor email email-extract-with-proxy email-extraction email-extractor email-marketing email-scraper open-source ruby rubygem serp social-media-scraper web-crawling webscraping
Language:Ruby 141
py-pdf / benchmarks
Benchmarking PDF libraries
benchmark data-extraction mupdf pdf poppler-utils pypdf2 text-extraction
Language:Python 140
johnbumgarner / newspaper3_usage_overview
This repository provides usage examples for the Python module Newspaper3k.
newspaper newspaper3k news scraping-websites python data-extraction beautifulsoup python-requests nlp-parsing
Language:Python 129
sayn
173TECH / sayn
Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
analytics etl data-modeling data-engineering data-science python sql automation elt data-extraction
Language:Python 117
nfx / go-htmltable
Structured HTML table data extraction from URLs in Go that has almost no external dependencies
data-extraction go go-generics html
Language:Go 113
dilawar / PlotDigitizer
A Python utility to digitize plots.
digitization data-extraction python3 image-processing
Language:Python 108
sshniro / line-segmentation-algorithm-to-gcp-vision
Line segmentation algorithm for Google Vision API.
google-vision proposed-algorithm data-extraction invoice segmentation
Language:Kotlin 94
villagecomputing / superpipe
Superpipe - optimized LLM pipelines for structured data
classification data-extraction data-labeling llm llm-evaluation llm-optimization structured-data
Language:Python 94
hermit-crab / ScrapeMate
Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
xpath-selector scraping css-selector extension firefox-extension chrome-extension data-mining data-extraction devtools
Language:JavaScript 93
nppoly / cyac
High performance Trie and Ahocorasick automata (AC automata) Keyword Match & Replace Tool for python
nlp data-extraction automata trie search search-in-text keyword-extraction double-array-trie cython
Language:Cython 91
reincubate / ricloud
Python client for Reincubate's ricloud API. Yes, it works with iOS 14 & iPhone 12 backups!
icloud-api icloud-access icloud data-extraction cloudkit python-client data-recovery
Language:Python 91
dav009 / flash
Golang Keyword extraction/replacement Datastructure using Tries instead of regexes
text golang search trie data-extraction go text-search
Language:Go 90
sypht-java-client
sypht-team / sypht-java-client
A Java client for the Sypht API
api-client data-extraction java java8 information-retrieval information-retrieval-engine extract-data-from-pdf extract-fields sypht-java-client sypht sypht-api invoice extract receipt-scanner pdf-parser receipt-capture invoice-parser receipt-reader receipt-scanning document-capture
Language:Java 88
hred
danburzo / hred
Reduce HTML and XML to JSON from the command line, using an expressive query language inspired by CSS selectors.
cli data-extraction html json xml
Language:JavaScript 64
WeTransfer / format_parser
file metadata parsing, done cheap
format-parsers ruby file-parser data-extraction aiff arw cr2 exif flac gif jpeg moov mp3 mpg ogg pdf png tiff wav zip
Language:Ruby 60
rohanpillai20 / Table-Extractor-From-Image
This repository contains the code that extracts a table from an image and exports it to an Excel.
ocr data-extraction data-manipulation python
Language:Python 53
scopashq / typestream
⚡️ Next-generation data transformation framework for TypeScript that puts developer experience first
data-transformation developer-experience typescript auto-reload data-extraction data-pipeline
Language:TypeScript 53
uhh-lt / newsleak
Information extraction and interactive visualization of textual datasets for investigative data-driven journalism and eDiscovery
data-driven-journalism data-extraction docker ediscovery elasticsearch journalism metadata nlp
Language:Java 52
hext
html-extract / hext
Domain-specific language for extracting structured data from HTML documents
cpp html-extraction scraping html dsl data-extraction python php ruby node
Language:C++ 51
docwire / docwire
DocWire SDK: Award-winning modern data processing in C++20. SourceForge Community Choice & Microsoft support. AI-driven processing. Supports nearly 100 data formats, including email boxes and OCR. Boost efficiency in text extraction, web data extraction, data mining, document analysis. Offline processing is possible for security and confidentiality
api c cli cpp linux macos parsing shell terminal windows tensorflow sdk text-extraction machine-learning artificial-intelligence data-extraction text-extraction-from-image data-processing text-mining extract-transform-load
Language:C++ 49
VorTECHsa / refinery
Refinery is a tool to extract and transform semi-structured data from Excel spreadsheets of different layouts in a declarative way.
excel extraction data-extraction excel-extraction-api poi semi-structured-data wrangling
Language:Kotlin 44
tech-engine / goscrapy
GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by Python's Scrapy framework.
data-extraction go-scrapy golang goscraper scrapy spider web-crawler webscraper webscrapping
Language:Go 42
tinvois-parser
rekloud / tinvois-parser
Extract receipt info
ocr data-extraction data-science image-processing image-parser invoice-parser receipt-parser rest-api
Language:Python 40
linw1995 / jsonpath
A query expression for extracting data from JSON.
cli data-extraction data-extractor jsonpath
Language:Python 37
shriprem / FWDataViz
Fixed Width Data Visualizer plugin for Notepad++. Turns Notepad++ into Excel for fixed-width data files. Displays cursor position data. Jumps to specific fields. Folding Record Blocks. Extracts Data. Builtin dialogs to configure file-type, record-type & fields; Themes & Colors; and Folding. Handles homogenous, mixed & multi-line records.
fixed-width visualizer navigator notepad-plus-plus plugin data-visualization excel data-extraction
Language:C++ 35
Zubdata / Google-Maps-Scraper
Google maps scraper with gui
data-extraction googlemaps gui-application leadsheets python web-scraping-software scraper
Language:Python 34
sypht-golang-client
sypht-team / sypht-golang-client
A Golang client for the Sypht API
data-extraction api-client golang go golang-library golang-package sypht sypht-golang-client sypht-api invoice extract extract-fields extract-data-from-pdf receipt-scanner pdf-parser receipt-capture invoice-parser receipt-reader receipt-scanning document-capture
Language:Go 33