google-dataproc

There are 0 repository under google-dataproc topic.

• miraisolutions / spark-bigquery

  Google BigQuery data source for Apache Spark

  sparkbigqueryspark-datasourcegoogle-dataproc
  Language:Scala 17

• ColeMurray / movie-rec-tutorial

  cloud-infrastructuresparktutorialgoogle-dataprocmachine-learning
  Language:Python 2

• arunabellgutteramesh / PigHiveOnStackExchangeData

  StackExchange data procured is cleaned with pig, queried with hive-ql, performed tf-idf to obtain top 10 words used by top 10 users of StackExchange.

  google-dataprochive-querypigtf-idf
  Language:Python 1

• gofynd / ignite

  A Python framework for managing Dataproc cluster and Scheduling PySpark Jobs over it. Additionally it provides docker based development for debugging PySpark jobs.

  spark-jobsgoogle-dataprocpysparkdockerapache-spark
  Language:Python 1

• sangwanamit621 / SnowSpark-Orchestration

  This project orchestrates a data processing workflow using Apache Airflow, Spark, Google Cloud Storage (GCS), and Snowflake. The workflow is designed to handle daily data updates, filter completed orders, and update a Snowflake target table with the latest information. The project leverages Apache Airflow for workflow scheduling and management.

  airflowairflow-dagsdata-pipelineetl-pipelinegoogle-cloud-platformgoogle-cloud-storagegoogle-dataprocorchestrationpysparkpythonpython3snowflakespark
  Language:Python 1

• sangwanamit621 / learning-and-experiments

  Welcome to the Learning and Experiments Hub—a dynamic repository capturing my journey of exploration and experimentation in the vast world of technology. This space serves as a digital canvas where I document my learning process, experiments, and discoveries.

  airflowairflow-dagsdockerdocker-composedockerfilepythonairflow-operatorsgoogle-cloud-platformgoogle-dataprocgoogle-storage-bucketorchestrationpysparksparkcassandracassandra-pythonhivehive-udf
  Language:Jupyter Notebook 0

• sangwanamit621 / mini-projects

  Welcome to the MiniProjects Playground—an interactive space where learning meets doing! This repository is a collection of hands-on mini-projects that I've crafted after delving into various tech stacks and frameworks. From theory to application, each project is a testament to the practical side of coding.

  airflowairflow-dagsdatapipelinedynamic-configurationetl-pipelinegoogle-cloud-composergoogle-cloud-platformgoogle-cloud-storagegoogle-dataprocmini-projectspythonpython3airflow-operatorspysparkspark
  Language:Python 0

• silvadev / dio-desafio-data-engineer

  Desafio do curso Criando um Ecossistema Hadoop Totalmente Gerenciado com Google Cloud Dataproc

  diodigital-inovation-onecarrefourhadoopgoogle-cloud-platformdataprocgoogle-dataproc
  0

• Anant / example-airflow-dataproc-astra

  airflowapache-airflowdataprocdatastaxdatastax-astragitpodgoogle-dataproc
  Language:Python

• LeosonH / mrjob_dataproc

  Experiments with MapReduce (mrjob) and Google Dataproc

  google-cloudgoogle-cloud-platformgoogle-dataprocmapreducemrjobmrjob-dataprocpython
  Language:Python