myisaak / ferret-server

Advanced declarative web scraping

Ferret Server

Server for advanced web scraping.
Open API defintion.

Features

• Scripts persistence
• Scraped data persistence
• Script execution scheduling
• Integration with 3rd party systems
• Web Hooks
• Security

WIP

Be aware, that the project is under heavy development.
There is no documentation and some things may change in the final release.

Installation

Binary

You can download latest binaries from here.

Source code

Production

• Go >=1.11
• Chrome or Docker
• ArangoDB

Development

• Go Swagger
• GNU Make
• ANTLR4 >=4.7.1

Quick start

ferret-server --db=http://0.0.0.0:8529