IlyessAgg / PII

SQL to NoSQL : Automated data migration.

SQL to NoSQL migration

Transfer your data from SQL to MongoDB.

Objective

This project aims at helping research in the automation of the migration of a relational database to NoSQL. The importation of the initial schema to Modelio will allow for modifications at will. The schema is then exported into an XMI that will be read and used to supervise the exportation of the data to JSON files which will be imported to MongoDB.

Progress

Done :

• Extraction into Java clases
• Modelio import
• XMI reading
• JSON creation and import

To Do :

• Extract the metadata
• Improve JSON creation (storing rows into a single JSONArray is not a good solution)
• Fetch foreign keys

Example

Using the TPC-D Benchmark.

• Mapping of the classes using Hibernate.

• Export in Modelio

• JSON creation using the XMI file.

• MongoDB import.

> mongoimport --db Cities --colection customer --file dss_customer.json --jsonArray
connected to: localhost
[############............] Cities.customer       24.3MB/45.8MB (53.1%)
[########################] Cities.customer       45.8MB/45.8MB (100.0%)
imported 150000 documents

> show collections;
customer
nation
part
partsupp
supplier

Issues