redxio / murphy

A web crawler written in golang

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Introduction

Murphy is a web crawler implemented using golang, which supports to crawl a variety of resources on web concurrently, it can also be used to crawling javascript-based dynamic webpages by enabling chrome headless mode.

Installation

$ go get -u github.com/NzKSO/murphy

TODO

filter and DOM event handler

License

This project is licensed under the MIT License - see the LICENSE file for details

About

A web crawler written in golang

License:MIT License


Languages

Language:Go 100.0%