clemfromspace / scrapy-selenium

Scrapy middleware to handle javascript pages using selenium

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Using both scrapy.Request and scrapy_selenium.SeleniumRequest in same website session. Is it possible?

Joaovitorls opened this issue · comments

I was wondering if it is possible to yield requests from both standard Scrapy and scrapy-selenium in the same spider.
I have mapped many requests that the website shows in developer tools to compute some values.
I think it could save me some requests as the data I need would already have its final value in screen.

In the tests I made, the SeleniumRequest didn't throw any errors, but the response was showing the website login page. Like the session was not being shared.