sophia-jihye / web-crawler

various web-crawler samples

web-crawler

various web-crawler samples

1. linkReader: Visits pages
   • Steps
     1. In Main.java, you have to declare the page url which you want to begin from.
     2. In Main.java, you have to declare the key word you want to find.
2. pageReader: Visits only one page
   • 원하는 데이터를 찾을 때까지 시간 간격을 두고 특정 페이지를 계속 방문