Giters

maithilish / gotz

Gotz - Heavy duty ETL to automate data extraction from tons of HTML pages

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

etlhtmlunitjavajsoupscraperunstructured-data

gotz-banner

Build Status Coverage Status

Gotz ETL is replaced with much faster and easy to use Scoopi Web Scraper

The XML definiton files of Gotz is complex and Scoopi replaces it with much simpler YAML configuration

Scoopi is 5x faster than Gotz.

  • Gotz takes around 10 minutes to scrape 1000 pages where as Scoopi completes it in under 2 minutes.

Go to Scoopi Web Scraper

About

Gotz - Heavy duty ETL to automate data extraction from tons of HTML pages

etlhtmlunitjavajsoupscraperunstructured-data

License:GNU General Public License v3.0

Languages

Language:Java 92.3%Language:HTML 4.0%Language:TypeScript 2.8%Language:Shell 0.4%Language:XSLT 0.2%Language:JavaScript 0.2%Language:Dockerfile 0.0%Language:CSS 0.0%Language:Batchfile 0.0%