tomexiskandar / copython

An ETL program using Python (I'm moving this work to Bintang)

Home Page:https://github.com/tomexiskandar/bintang

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

copython

A copy data program to copy data from and to database. This program is intended for data analyst, data scientist, data engineer and data warehouse specialist.

copython.py is the module that users/clients can use as interface. Some testings* done and worked as expected.

*Testings are done with the following servers editions with installed ODBC drivers:

SQL Server version 12.0.200 year 2014 64 bit. ODBC driver 11 for SQL Server
PostgreSQL version 10.1 year 2017 64 bit. ODBC driver PostgreSQL Unicode(x64)
Oracle version 11g Express Edition year 2017 64 bit. ODBC driver Oracle in instantclient_12_2, Oracle in XE
MySQL version 5.7.20 year 2017 64 bit. ODBC driver MySQL ODBC 5.3 Unicode Driver

Successful copies operations as the followings:

copy csv file into SQL Server
copy csv file into table and vice versa
copy SQL Server select query to PostgreSQL table and vice versa
copy MySQL table and sql query to SQL Server table
copy Oracle sql query to SQL Server
copy Oracle table to SQL Server

To test out:

  • Your machine must have python >= 3.7, SQL Server and ODBC driver installed.
  • Download copython-0.0.1.zip from folder dist and install in your machine eg. pip install path/copython-0.0.1.zip.
  • Download the files in folder samples and change any path accordingly.
  • execute the python script load_csv_into_mssql.py.

About

An ETL program using Python (I'm moving this work to Bintang)

https://github.com/tomexiskandar/bintang

License:MIT License


Languages

Language:Python 100.0%