brianamaral / airflow_pdi_composer

My configurations for running apache airflow and a Carte server locally

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

About The Project

My configurations for running apache airflow and a Carte server locally with docker compose

Built With

  • Docker
  • Bash
  • Python

Getting Started

Prerequisites

  • Docker
sudo apt get docker

Installation

  1. Clone the repo
git clone https://github.com/brianamaral/airflow_pdi_composer.git
  1. Edit the config.xml located at /configs as you like
<slave_config>
  <slaveserver>
      <name>Master</name>
      <hostname>0.0.0.0</hostname>
      <port>9090</port>
      <username>cluster</username>
      <password>cluster</password>
      <master>Y</master>
  </slaveserver>
</slave_config>
  1. Optionally, you can put some jobs in the /jobs folder and build a volume pointing from there

Usage

  1. Run the command below
docker-compose up
  1. Then, just go to https://localhost:8080 for running airflow, and https://localhost:9090 for the Carte server

Contributing

Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

Contact

Brian Bomfim Amaral - Linkedin - brian.amaralt@gmail.com

Project Link: https://github.com/brianamaral/pdi-docker

About

My configurations for running apache airflow and a Carte server locally


Languages

Language:Python 76.5%Language:Dockerfile 23.5%