jperkelens / spark-snowflake

Snowflake Data Source for Apache Spark.

Home Page:http://www.snowflake.net

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

spark-snowflake

Snowflake Data Source for Apache Spark.

Build Status codecov License

The main version of spark-snowflake works with Spark 2.4. For use with Spark 2.3 and 2.2, please use tag vx.x.x-spark_2.3 and vx.x.x-spark_2.2.

To use it, provide the dependency for Spark in the form of net.snowflake:spark-snowflake_$SCALA_VERSION:$RELEASE, e.g. net.snowflake:spark-snowflake_2.11:2.2.2. See Spark Packages and Maven Central for more info.

For a version working with Spark 1.5 and 1.6, please use branch-1.x. Artifacts of that version are also available in the Snowflake UI.

For a user manual and more information, see the official documentation.

For developer notes, see README-DEV

Acknowledgments

This project was originally forked from the spark-redshift project. We also occasionally port relevant patches from it. We would like to acknowledge and thank the developers of that project, in particular Josh Rosen.

About

Snowflake Data Source for Apache Spark.

http://www.snowflake.net

License:Apache License 2.0


Languages

Language:Scala 89.5%Language:Java 5.7%Language:Python 3.0%Language:Shell 1.7%