Support scala and SparkR sessions

Question

Support scala and SparkR sessions

acroz opened this issue 6 years ago · comments

Only PySpark is currently tested.

Andrew Crozier · Answer 1 · Mon Feb 26 2018 09:40:36 GMT+0800 (China Standard Time)

The session-kind branch now supports Scala Spark and SparkR sessions, but SQL sessions, reading data out into local dataframes from non-PySpark sessions, and mixed language sessions remain untested.

Andrew Crozier · Answer 2 · Tue Feb 27 2018 06:29:30 GMT+0800 (China Standard Time)

Code execution in scala, SparkR and Spark SQL is now tested in PR #8, but reading dataframes out remains to be done.

Andrew Crozier · Answer 3 · Tue Feb 27 2018 07:28:40 GMT+0800 (China Standard Time)

Reading DataFrames now implemented in PR #8.