google-cloud-dataproc

There are 6 repositories under google-cloud-dataproc topic.

• kubeflow / spark-operator

  Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

  kuberneteskubernetes-operatorapache-sparkkubernetes-crdkubernetes-controllersparkgoogle-cloud-dataproc
  Language:Go 2673

• GoogleCloudPlatform / flink-on-k8s-operator

  [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.

  google-cloud-dataprocflink-operatorkubernetes-operatorapache-beamapache-flinkkubernetesoperator
  Language:Go 657

• GoogleCloudDataproc / initialization-actions

  Run in all nodes of your cluster before the cluster starts - lets you customize your cluster

  google-cloud-dataproc
  Language:Shell 584

• GoogleCloudDataproc / spark-bigquery-connector

  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

  bigquerybigquery-storage-apigoogle-bigquerygoogle-cloudgoogle-cloud-dataprocspark
  Language:Java 354

• GoogleCloudDataproc / hadoop-connectors

  Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.

  bigquerygoogle-cloud-dataprochadoophadoop-filesystemhadoop-hcfs
  Language:Java 276

• GoogleCloudDataproc / cloud-dataproc

  Cloud Dataproc: Samples and Utils

  google-cloud-dataproc
  Language:Jupyter Notebook 192

• GoogleCloudDataproc / custom-images

  Tools for creating Dataproc custom images

  google-cloud-dataproc
  Language:Python 32

• GoogleCloudDataproc / jupyterhub-dataprocspawner

  google-cloud-dataproc
  Language:Python 14

• kumgaurav / BigQuerySpark3Scala12

  A sample demo to check latest spark, big query connector and scala 2.12

  bigqueryspark3google-bigquerybigquery-storage-apigoogle-cloud-dataprocscala12
  Language:Scala 1

• Eu-Bitwise / spark-json-streaming

  Streaming JSON data to Spark or Google Cloud Dataproc.

  google-cloud-dataprochivejsonpythonspark
  Language:Python

• jonathanAmancioSales / Hadoop_Dataproc_Google_Cloud_Platform_DIO

  Projeto do Curso "Criando um Ecossistema Hadoop Totalmente Gerenciado com Google Cloud Dataproc" do Bootcamp Data Engineer da Digital Innovation One

  google-cloudgoogle-cloud-dataprochadooppysparkdataproc-cluster
  Language:Shell

• VagnerBellacosa / 030_CriandoUmEcossistemaHadoopTotalmenteGerenciadoComGoogleCloudDataproc

  Sua missão será criar um ecossistema de Big Data usando o Google Cloud Platform (GCP). Para isso, o expert te ensinará a configurar o Google Cloud Dataproc, um Hadoop totalmente gerenciado, usando seus créditos gratuitos da GCP.

  labshadoopgcpdiodigital-innovation-onegoogle-cloud-dataprocgoogle-cloud-platform
  Language:Python