spirom / spark-mongodb-connector

A prototype native MongoDB connector for Apache Spark, using Spark's external datasource API

spirom/spark-mongodb-connector Issues

Querying MongoDB with predicate fails on Spark 1.4+
Closed 9 years ago3
BSONTimestamp unit test fails
Updated 9 years ago
Schema inference for Spark SQL integration needs to allow adjustable sampling
Updated 9 years ago
All configuration must be available via OPTIONS in Spark SQL's CREATE TEMPORARY TABLE
Updated 9 years ago
Non trivial queries are not supported via core Spark
Updated 9 years ago
Sharding by multiple indexed keys is not supported
Closed 9 years ago1
In Spark SQL, It should be possible to use several MongoDB instances (and configurations) in a single context
Updated 9 years ago
Spark SQL integration will fail for any collection whose documents have conflicting types
Updated 9 years ago
Not all MongoDB atomic types are supported through Spark SQL
Updated 9 years ago
Spark SQL is not supported
Closed 9 years ago1
Spark 1.2.0 is not supported
Closed 9 years ago3
Scala 2.11 is not supported
Updated 9 years ago1
A Java client API is needed
Updated 9 years ago
A Python client API is needed
Updated 9 years ago
Authentication is not sufficiently tested
Updated 10 years ago
Poor error handling for unknown database/collection
Updated 10 years ago
Advanced authentication is not supported
Updated 10 years ago
We don't take advantage of replication
Updated 10 years ago
Writing to MongoDB is not supported
Updated 10 years ago