clemfromspace / scrapy-selenium

Scrapy middleware to handle javascript pages using selenium

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Run different spiders with different selenium

Tobeyforce opened this issue · comments

Forgive my insolence,
Is it possible to have multiple spiders run selenium at the same time?
Meaning, can they start up new instances of the browser or would they just try to access the same browser?
My problem is that I need to run several spiders concurrently, all being able to render javascript.

If this doesn't work, can I run different spiders on different tabs at the same time?

An answer would be very very appreciated as Splash simply doesn't work in my current use case.