CloudQuery is an open-source, high-performance data integration framework built for developers.
CloudQuery extracts, transforms, and loads configuration from cloud APIs to variety of supported destinations such as databases, data lakes, or streaming platforms for further analysis.
Installation
See the Quickstart guide for instructions how to start syncing data with CloudQuery.
Why CloudQuery?
- Open source: Extensible plugin architecture. Contribute to our official plugins or develop your own with CloudQuery SDK.
- Blazing fast: CloudQuery is optimized for performance, utilizing the excellent Go concurrency model with light-weight goroutines.
- Deploy anywhere: CloudQuery plugins are single-binary executables and can be deployed and run anywhere.
- Pre-built queries: CloudQuery maintains a number of out-of-the-box security and compliance policies for cloud infrastructure.
- Eliminate data silos: Eliminate data silos across your organization, unifying data between security, infrastructure, marketing and finance teams.
- Unlimited scale: CloudQuery plugins are stateless and can be scaled horizontally on any platform, such as EC2, Kubernetes, batch jobs or any other compute.
Links
- Homepage: https://www.cloudquery.io
- Documentation: https://www.cloudquery.io/docs
- Plugins: https://www.cloudquery.io/docs/plugins/overview
- Releases: https://github.com/cloudquery/cloudquery/releases
- Plugin SDK: https://github.com/cloudquery/plugin-sdk
License
By contributing to CloudQuery you agree that your contributions will be licensed as defined on the LICENSE file.
Hiring
If you are into Go, Backend, Cloud, GCP, AWS - ping us at jobs [at] our domain
Contribution
Feel free to open a pull request for small fixes and changes. For bigger changes and new plugins, please open an issue first to prevent duplicated work and to have the relevant discussions first.