data-migration

There are 8 repositories under data-migration topic.

• goodreads_etl_pipeline

  san089 / goodreads_etl_pipeline

  An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

  airflowairflow-dagapache-airflowapache-sparkdata-engineeringdata-engineering-pipelinedata-lakedata-migrationemr-clusteretl-frameworketl-jobetl-pipelinegoodreads-data-pipelinelivypythonredshifts3schedulersparkwarehouse
  Language:Python 1260

• kstone-io / kstone

  Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd data, and intelligent diagnosis.

  etcdmanagementinspectionbackupwebconsoledata-migrationkubernetesdashboardcloudnativeoperatormonitoring
  Language:Go 674

• actiontech / dtle

  Distributed Data Transfer Service for MySQL

  mysqldata-transferdata-migrationreplicationcdcchange-data-capture
  Language:Go 548

• backube / volsync

  Asynchronous data replication for Kubernetes volumes

  kubernetesstoragekubernetes-operatormirroringcsidata-replicationdata-protectionpersistent-volumedisaster-recoverydata-migration
  Language:Go 509

• forcedotcom / SFDX-Data-Move-Utility

  SFDMU is a cutting-edge Salesforce data migration tool for seamless org population from other orgs or CSV files. It handles all CRUD operations on multiple related objects in one go.

  csv-exportcsv-importdata-loaderdata-migrationdata-migration-tooldataloadersalesforce-data-loadersalesforce-data-migrationsalesforce-data-migration-toolsalesforce-data-transfersfdxsfdx-plugin
  Language:TypeScript 433

• ka8725 / migration_data

  Migrate data along with schema migrations in Rails and keep them up to date.

  railsmigrationsdatadata-migration
  Language:Ruby 364

• prescottprue / fireadmin

  Application for Managing Firebase Applications. Includes support for multiple environments and data migrations

  admin-dashboarddata-managementdata-migrationfirebasefirestorefirestore-reactredux-firebaseredux-firestore
  Language:JavaScript 238

• sodafoundation / strato

  SODA Strato (Multi-cloud) project provides a cloud vendor agnostic data management for hybrid cloud, intercloud or intracloud. This project is renamed as 'Strato'

  multi-cloudaws-s3ibm-cloudazure-blobhuaweiclouddata-migration
  Language:HTML 234

• DivineOmega / uxdm

  🔀 UXDM helps developers migrate data from one system or format to another.

  data-migratordata-migrationpdocsvarrayjsonxmlwordpressmarkdowndata-conversionphpphp-libraryuxdm
  Language:PHP 167

• statebox / cql

  CQL: Categorical Query Language implementation in Haskell

  aqldata-migrationquery-languagecategory-theoryhaskell
  Language:Haskell 162

• microsoft / DataMigrationTeam

  Repository for the Data Migration Team

  migrationdatadata-migration
  109

• benbalter / github_records_archiver

  Backs up a GitHub organization's repositories and all their associated information for archival purposes.

  githubexportdata-portabilitybackupdata-liberationdata-migration
  Language:Ruby 108

• caosiyang / py-mongo-sync

  Oplog-based data sync tool that synchronizes data from a replica set to another deployment, e.g.: standalone, replica set, and sharded cluster.

  mongodboplog-basedrealtimemongooplogdata-transmissionsyncpythondata-migration
  Language:Python 107

• forcedotcom / SFDX-Data-Move-Utility-Desktop-App

  The SFDMU GUI Desktop Application is a comprehensive tool for Salesforce data migration between SF environments or importing/exporting CSV data into SF environments. It builds upon the capabilities of the SFDX Data Move Utility Plugin (SFDMU), offering a user-friendly interface for seamless data management tasks.

  sfdmu-pluginsfdxdataloadersalesforce-data-loaderdata-migrationdata-migration-tool
  Language:JavaScript 95

• jsphpl / enpass-to-keepass

  Convert an Enpass csv export so it can be imported to a KeePass database using KeePassXC

  keepasskeepassxcdata-migrationpassword-managerenpass
  Language:Python 50

• gagoyal01 / mongodb-rdbms-sync

  Bi-directional data sync between Relational Databases (Oracle, MySql) & MongoDB.

  mongodbmongomongodb-replicationmysqlsqletlmigratorsyncmigrationdata-migrationmongodb-migrationdatabaserelational-databaseoracle
  Language:Java 40

• polardb / polardbx-tools

  Tools for PolarDB-X, such as data migration, CSV files import, benchmark, etc.

  distributed-databasedata-migrationcsv-importdatabase-be
  Language:Java 33

• kurt213 / mongodb-to-postgresql

  Migrate and replicate data from MongoDB to PostgreSQL in Node.js

  mongodbpostgrespostgresqldatabase-modeldatabase-migrationetldata-migrationdata-migration-tool
  Language:JavaScript 30

• jlorente / laravel-data-migrations

  An extension to allow you to separate data migrations from structure migrations

  laravelmigrationsdata-migration
  Language:PHP 29

• SAP-samples / commerce-migration-toolkit

  SAP Commerce extensions to support data migrations to SAP Commerce Cloud.

  samplesample-codesap-commerce-clouddata-migrationcommerce
  Language:Java 24

• mcgizzle / oh-migrations

  Data migrations through implicit function composition at the type-level

  scalatypeleveltypelevel-programmingdata-migrationshapelesscomposition
  Language:Scala 22

• ei-grad / sqlacrossover

  SQLAlchemy-based cross-database migration tool

  sqlalchemydata-migrationdata-transfermysqlpostgresqlrdbms
  Language:Python 17

• davidag / tiddlywiki-migrator

  Export tiddlers from a single-file html TiddlyWiki, "classic" or "modern", to Markdown.

  tiddlywikitiddlywiki5data-migrationmarkdown
  Language:Makefile 16

• ser94mor / CloudTieringFS

  Policy-Driven Multi-Tier File System

  filesystemfile-systemlinuxcgplv3cloudtiered-file-systemstorage-tieringdata-migrationmulti-tierdaemonposixs3migrationorangefscloudtieringfsbtrfs
  Language:C 10
• unlock-mainframe-data-files-on-aws

  aws-samples / unlock-mainframe-data-files-on-aws

  This solution is designed to help you unlock legacy mainframe data by migrating data files from mainframe systems to AWS. By migrating the data, you can make use of the powerful analytics, machine learning, and other services available in AWS to gain insights and make better decisions based on the data.

  awsaws-lambdacopybookcopybook-parsercsvdata-augumentationdata-conversiondata-migrationdatasetebcdicebcdic-to-asciimainframepythonmainframe-data
  Language:Python 8

• beyondstorage / beyond-tp

  Neutral data migration service

  data-migration
  Language:Dart 8

• gluent / goe

  GOE: a simple and flexible way to copy data from an Oracle Database to Google BigQuery.

  data-migrationdata-migration-tooloracle
  Language:Python 8

• dzhanrafetov / Melifera-Revamp

  E-commerce web application with Spring Boot, Spring Security (JWT), ElasticSearch,OpenFeign, MySQL, Docker,Logstash,Redis and more.

  docker-composeeccomercejwt-authenticationopenfeignspringspring-bootspring-mvcspring-securityspringschedulingapiautorizationdockerjavajava-mail-sendermysqlredisdata-migrationelasticsearchkibanalogstash
  Language:Java 7

• hextriclosan / mubi2letterboxd

  A simple way to migrate user data from MUBI.com to letterboxd.com

  mubiletterboxddata-migration-tooldata-migration
  Language:HTML 7

• spiegelp / Poco.Evolved

  Schema and data migration framework for .NET

  schema-migrationsdata-migrationsqlrdbmslitedbdatabase
  Language:C# 6

• nilsding / enpass2keepassxc

  Converts an Enpass JSON export to a KeePassXC XML export

  enpasskeepassxckeepassjson-exportxmldata-migrationpassword-managercrystal
  Language:Crystal 5

• pientaa / booking-demo

  Project for @PUT.NET. Spring with dockerized MongoDB. Presented both classic MVC and CQRS with Event Sourcing approach.

  kotlinspringmongodbkotestdockercqrsevent-sourcingevent-sourcing-and-cqrsmvcdata-migrationmongobeerabbitmqcommand-querymvc-demo
  Language:Kotlin 5

• Rillke / mdbtools-docker

  Dockerized MDB Tools - Read Access databases on *nix

  dockersqlodbc-drivermicrosoft-accessdata-migration
  Language:Dockerfile 5

• ronpinkas / dbBridge

  dbBridge is an 'SQL Migration Tool' - enabling import of SQL Databases from any supported Dialect (MsSql, MySql, Oracle, PostgreSQL, Sqlite) to any of these supported dialects with just three lines of PHP code.

  data-integrationdata-migrationdata-transferdata-transformationdatabase-conversiondb-migratedb-migrationetlmigrationmssqlmysqlopen-sourceoraclephppostgresqlsqlsqliteminimalsimple
  Language:PHP 5

• samsamai / ecto_immigrant

  Data migrations for your ecto-backed elixir application

  elixirectodata-migration
  Language:Elixir 5

• zproksi / bpatch

  Tool & library for binary data processing according JSON formatted rules

  cpp20cybersecuritydata-migrationjson-parsertestingbinary-data-transformationbinary-streamforensic-analysislearning-cppautomationconsole-applicationhuman-readable-binary-rulesencryption-decryptionsoftware-developmentvirtual-inheritanceautomation-frameworksoftware-architecture-and-designsettings
  Language:C++ 4