Error validversion

Question

Error validversion

rizal-mujahiddan69 opened this issue a year ago · comments

rizal-mujahiddan69 commented a year ago

Why error in install spark, im in version sparklyr 1.8.1

Titus Jungao · Answer 1 · Mon Jun 26 2023 10:12:43 GMT+0800 (China Standard Time)

+1 on this. getting the same error

Brett Koblinger · Answer 2 · Mon Jun 26 2023 21:57:14 GMT+0800 (China Standard Time)

I has able to reproduce the error with:

library(sparklyr) spark_versions()

Installing the github version fixed the problem for now.

I traced the problem back to read_spark_versions_json(), but couldn't quite pin it down. From what I can tell, spark_versions() expects each version of spark to have at least 2 hadoop versions, which isn't the case for spark-3.4.0.

Edgar Ruiz · Answer 3 · Wed Jun 28 2023 03:13:32 GMT+0800 (China Standard Time)

Hi, yes, that's fixed in the dev version. So it'll be fixed in the next CRAN version.

If you'd like to try it now, feel free to install sparklyr from Github:

devtools::install_github("sparklyr/sparklyr")

github-actions · Answer 4 · Fri Jul 28 2023 14:04:51 GMT+0800 (China Standard Time)

Automatically closed because there has not been a response for 30 days. When you're ready to work on this further, please comment here and the issue will automatically reopen.