TigerGraph-DevLabs / TG-Snowflake-Connector

The project is to write the data from snowFlake into the TigerGraph. The goal is to import data by modifying configuration file. Full Documentation: https://github.com/TigerGraph-DevLabs/TG-Snowflake-Connector/wiki/TigerGraph-Snowflake-Connector-Documentation

TigerGraph-Snowflake-Connector

1. Introduction

This project enables users to load data from Snowflake database into TigerGraph database easily. For more details, refer to the documentation page

If you:

• are a developer and would like to look at the source code, the code is located in src folder.
• just want to use the connector, you can find the artifacts in 'assets' folder or review tests folder.

Note: You can use QuickStart to get started with the connector or visit the documentation page

2. QuickStart

friendNet

Detailed documentation location：TigerGraphConnector_readme

3. Folder description

# Connector that can be used, Configuration file and connector usage documentation
assets/

# source code
src/

# Use cases
# including Snowflake table building statement
# TigerGraph construction sentences and Loading Job
tests/

4. Development environment

• Java 8+

• Maven 3.5.4+

• Install tg-java-driver jar to your local maven repository.

  1. Get tg-java-driver-1.2.jar

  • Compile the source code https://github.com/tigergraph/ecosys/tree/master/tools/etl/tg-jdbc-driver

  • Or get it from : SF2TGconfig

  2. Install to maven repository

     mvn install:install-file -Dfile=/{location}/tg-java-driver-1.2.jar -DgroupId=com.tigergraph -DartifactId=tg-java-driver -Dversion=1.2 -Dpackaging=jar

5. Code structure

src.main
	|--resources
		|--connector.yaml(configuration file)
	|--scala
		|--com.tigergraph.spark_connector
			|--reader(data origin)
			|--support(Read the configured support class)
			|--utils
			|--writer
			|--SF2Spark2Tg(main class)