svenkreiss / pysparkling

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

https://pysparkling.readthedocs.io

svenkreiss/pysparkling Issues

`.toPandas()`: `AttributeError: 'SQLContext' object has no attribute '_conf'`
Updated a year ago1
Spark case sensitivity
Updated 3 years ago1
pytest-xdist
Updated 3 years ago
Make the imports of the `sql` module less complicated
Updated 3 years ago
Show a bit of coverage report in Github Action terminal
Updated 3 years ago
AttributeError: 'StructType' object has no attribute 'treeString'
Updated 3 years ago2
Aggregating column has a wrong datatype.
Updated 3 years ago1
new release
Closed 3 years ago3
Supporting SQL/DataFrame ?
Closed 4 years ago12
Drop support of Python2?
Closed 4 years ago
Link to documentation leads to author's personal page instead
Closed 4 years ago2
RDD.takeSample does not support withReplacement=False
Closed 5 years ago2
Coalesce without shuffle can increase the number of partitions
Closed 5 years ago2
h2o_pysparkling_2.2 (with pysparkling 0.4.7) incompatible with Spark 2.2 + Python 2.7
Closed 5 years ago1
Add accumulators
Closed 5 years ago3
context.textFile does not support hdfs
Closed 5 years ago
rdd.reduce does not handle empty partitions
Closed 5 years ago
Second argument to context.parallelize is numSlices, not numPartitions
Closed 5 years ago3
pysparkling H2OConf interfering with my application log
Closed 6 years ago1
Including RDDs in RDDs should probably throw an error
Closed 6 years ago2
implement partitionBy() and repartitionAndSortWithinPartitions()
Closed 7 years ago1
Anonymous Connection to Public S3 buckets
Closed 8 years ago1
reduceByKey() and groupByKey() throw errors with numpy arrays
Closed 8 years ago2
move docs to readthedocs
Closed 8 years ago
Warning when running tests
Closed 8 years ago6
RDD Outer joins don't handle duplicate values
Closed 8 years ago1
RDD.fullOuterJoin is not implemented
Closed 9 years ago3
Does this work with Python 3. I have a pip error
Closed 9 years ago2