how to know when a link is found for the second/third... time?

Question

how to know when a link is found for the second/third... time?

bobemoe opened this issue 4 years ago · comments

bobemoe commented 4 years ago

I have a use case for a CrawlObserver to know when a link is found again:

Count the number of times a link is found
Collate all the foundOnUrls for a given link

I created PR #280 which I am still using as a patch in my project, but it got closed stale and I cant reopen it.

Freek Van der Herten · Answer 1 · Tue Nov 17 2020 15:18:00 GMT+0800 (China Standard Time)

That PR contains a breaking change, so I'm not going to merge it in for now. I'll reconsider this when creating a new major version.

bobemoe · Answer 2 · Tue Nov 17 2020 16:16:00 GMT+0800 (China Standard Time)

Sure. Is it worth keeping it open? looks like its already missed a major release since I submitted it.

If you'd like any help just give me a shout.

Thanks.

Freek Van der Herten · Answer 3 · Wed Nov 18 2020 16:17:12 GMT+0800 (China Standard Time)

@bobemoe I've just created the v6 branch where the next major version can be prepared. Feel free to send a PR with the proposed functionality to that branch, make sure to include an updated readme and tests.