Giters

eklem / browsercrawler

Crawling content from a site within the browser. A basis for i.e. a search solution for static sites.

Home Page:https://eklem.github.io/browsercrawler/doc/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

search-index-housekeeper may need to be a part of crawler-in-browser

eklem opened this issue · comments

commented

Figure out where the crawl queue should live. Try to make crawler-in-browser as small as possible.

commented

Could be that I should have a function like doSomethingWith(data) with a keepTrackOfIt callback, where the doSomethingWith() could send the data to a search engine, while the keepTrackOfIt logs this in a indexedDB.