Prevent pdf, images, etc...

Question

madchops1 opened this issue 7 years ago · comments

Philip Lucks · Answer 1 · Fri Oct 13 2017 21:19:58 GMT+0800 (China Standard Time)

Is there a way to ignore PDFs at this point? It does get stuck

EDIT: add Disallow: /pdf into the UI where robots.txt would be

Philip Lucks · Answer 2 · Fri Oct 13 2017 21:37:09 GMT+0800 (China Standard Time)

Also, SVGs create an error, but they do get skipped:

Error: <polygon> attribute points: Expected number, "\\\"313.11".
a.getLinks @ scripts.24d0890a.js:1