ITtraveler / beedo

A crawler system based on jsoup.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

前端Vue项目:beedo-ui

beedo

Beedo is a crawler system based on jsoup.

The system framework using springboot+JPA and the database using mysql and mongodb.In system , the MySQL is only used to store basic configuration information. The contents crawled by the system will be stored in mongodb.

The front and rear ends are separated with a simple UI operation interface. The project name is beedo-ui

Feature:

  • Support for timing tasks and multithreading,and configurable crawler task;
  • Simple operation interface
  • Front end separation

under development...

Welcome to join

中文

Beedo是一个基于jsoup开发的爬虫系统,系统框架使用SprinBoot+JPA,数据库使用到mysql和mongodb。 mysql仅用于存储基本的配置信息,所爬取的内容将存储于mongodb中。 前后端分离,有着易操作的ui操作界面,前端项目名beedo-ui

特性:

  • 支持定时任务和多线程爬虫,且为可配置的任务;
  • 简洁的操作界面;
  • 前后端分离.

目前处于开发阶段...

欢迎加入一同开发.

About

A crawler system based on jsoup.


Languages

Language:Java 99.7%Language:HTML 0.2%Language:Dockerfile 0.1%