wuchunfu / scaleph

Open data platform based on flink and kubernetes. Now scaleph is supporting data integration with seatunnel on flink

scaleph

The Scaleph project features data integration, develop, job schedule and orchestration and aims to run on cloud environment.

It trys to provide one-stop data platform for simplifying development of data application. Scaleph hopes to help peoples to aggregate and analyze data, free data internal worth and make profit from them.

Scaleph is driven by personal interest and evolves actively through faithful developer, flowerfine is open and appreciates any helps.

Features

• Data Integration

  • Web-ui click-and-drag data integration ways backended by Apache SeaTunnel on Flink engine.

  • Support the latest 2.3.4 V2 out-of-the-box connectors and transforms.

  • DataSource management.

• Data Development

  • Jar. User develops Flink job using DataStream or Table API and package it as a jar.
  • SQL. Support online Flink SQL editor backended by Flink SQL Gateway.

• Data Warehouse

  • Doris. Support Doris Cluster management on Kubernetes backended by doris-operator.

• Other

  • Kubernetes. Manage Flink through Flink Kubernetes Operator and Doris through doris-operator.

Documentation

Whenever people want to explore Scaleph system, they want a running Scaleph application, then people can interact with Scaleph through Scaleph Admin.

Firstly, read documentation website quick start and begin to bootstrap scaleph.

Secondly, take followed steps.

• Install Docker and Kubernetes on your machine. Reference: Prepare
• Clone the repository
• Use Docker Compose and Scaleph Docker image quickly install and run Scaleph.

git clone https://github.com/flowerfine/scaleph.git

cd scaleph
git checkout 2.0.1

cd scaleph/tools/docker/deploy/scaleph
docker-compose up

Once all containers have started, the UI is ready to go at http://localhost:8096, user can login by sys_admin/123456.

Code of Conduct

This project adheres to the Contributor Covenant code of conduct

Contributing

For contributions, please refer CONTRIBUTING

Thanks for all people who already contributed to Scaleph!

Contact

• Bugs and Features: Issues

• Chinese user:

  

Sponsor

Thanks to JetBrains for supporting us free open source licenses.

License

Scaleph is licenced under the Apache License Version 2.0, link is here.