cloudcomposer

There are 0 repository under cloudcomposer topic.

• okzapradhana / cloud-flower

  Batch ETL using Cloud Environment which is GCP by utilizing Cloud Composer + Google Cloud Storage + Dataflow + Cloud Build

  dataengineeringgooglecloudplatformcloudcomposergooglecloudstoragedataflowapachebeamcloudbuildcicdairflow
  Language:Python 6

• aroraayush / airflow-spark-stackoverflow-logs-analysis

  Ask Ubuntu Logs analysis with PySpark on GCP | Pipeline with Airflow (Cloud Composer)

  ubuntuaskubuntulog-processingstackoverflowairflowcloudcomposersparkbatch-processing
  Language:HTML 1

• George-Nyamao / GCP_ETL_Project

  An ETL pipeline to move an uploaded flat file ffrom GCS, mask PII, store Big Query, and Create a report in Looker.

  airflowbigquerycloudcomposerdata-fusiongcs-bucketlookerpython3wrangler
  Language:Python 1

• thunchanokbow / AudibleBook-Revenue

  Manage big data on cloud computing to find a list of best-selling audible books, generate reports and dashboards, and provide products and sales promotions that meet the needs of consumers in Thailand

  pandaspython3apache-airflowbigquerycloudcomposerdata-visualizationdatalakedatawarehousegooglecloudstoragelookerstudio
  Language:Jupyter Notebook 1

• thunchanokbow / Inventory-Amazon

  Inventory value is also important for determining a company's liquidity, or its ability to meet its short-term financial obligations. A high inventory value can indicate that a company has too much money tied up in inventory, which could make it difficult for the company to pay its bills.

  azureclouddatabasedataprocpostgresqlpyspark-sqlpython3powerbibigquerycloudcomposercloudstoragecompute-engine
  Language:Jupyter Notebook 1

• bmv3cg / cloud-composer

  terraformterraform-modulegooglecloudcloudcomposer
  Language:HCL 0

• bsrikanth24 / gcp-data-engineering-etl-with-composer-dataflow

  This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering solution for processing, storing, and reporting daily transaction data in the online food delivery industry.

  apache-beamcloud-storagecloudcomposerdata-engineeringdataflowgcp
  Language:Python 0

• selvakrishnan / DataFusion_Airflow_Trigger

  A simple dag for triggering the Cloud Data Fusion Pipeline using Apache Airflow.

  airflowcloudcomposerdagdatafusiongoogle-cloud-platformpipelinepythonschedulercdf
  Language:Python 0

• erickmaiaa / cloud-etl-batch-pipeline

  This project shows a real world use case with ETL batch pipeline using Cloud Storage, Dataflow and BigQuery orchestrated by Cloud Composer / Airflow

  airflowbigquerycloudcomposercloudstoragedataflowetlgcp
  Language:Python