ClouGence / cloudcanal-data-process

CloudCanal real-time sync custom Java process SDK

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Overview

Custom Code allows users to write Java code with data processing logic , upload Java jar packages to CloudCanal, and CloudCanal automatically call these codes during Full Data and Incremental to achieve various data transformation processing purposes.

Project Description

  • wide-table
    • The fact table and dimension tables join processing code.
  • data-transform
    • General data transformation code, e.g., doing operation changes, adding additional fields, filter data,and so on.
  • data-gather
    • Aggregate sharding data code.e.g.,eliminate constraint conflicts, adding additional fields and so on.
  • data-compare
    • Verification and correction with business logic.
  • business-alert
    • Provides corresponding alarms based on stream data.

Steps

References

README.md

About

CloudCanal real-time sync custom Java process SDK

License:Apache License 2.0


Languages

Language:Java 100.0%