Question: categorizing headless browsers as spiders?
jayaddison opened this issue Β· comments
James Addison commented
Hello π
Would a change to categorize headless browsers (Chrome and PhantomJS) as Spider
browsers be acceptable for uap-core
, or is that the kind of thing that is better for individual applications to customise using logic on their side?
(I noticed there is also a collection of other user-agents under a comment of headless - there's a large variety of application types within that though, so I'm asking only about user agents that are more clearly headless browsers to begin with)