lpj0017 / CtripPro

a multi-thread web crawler written in Java8

Ctrip Web Crawler

Introduction

A web crawler based on Java8 with GUI.

Prerequisite

• Java8
• Maven

How to use

1. clone this repository from github
2. run MainJFrame to show you a GUI
3. you can choose the data folder and the cities you want to crawl
4. multi-thread is set by default, you can choose to close it by deselecting at settings menu