Distributed crawler4j
Make crawler4j distributed using java agent development environment (jade framework)
I am using master/slave architecture to make crawler4j a distributed system
Required libraries
libraries files are
1-jade.jar
2-mysql-connector-java-5.1.23-bin.jar
3-crawler4j-4.5.0-SNAPSHOT-jar-with-dependencies.jar