hdinsight

There are 0 repository under hdinsight topic.

• dotnet / spark

  .NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

  analyticsapache-sparkazurebigdatacsharpdatabricksdotnetdotnet-coredotnet-standardemrfsharphdinsightmachine-learningmicrosoftsparkspark-sqlspark-streamingstreamingtpcdstpch
  Language:C# 2002

• microsoft / data-accelerator

  Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

  sparkspark-streamingspark-sqlsparksqlstreaming-datastreamingservicefabricnodejsdockerhdinsightcosmosdbreactazureapache-sparkiothubeventhubbig-dataiotkafkakafka-streams
  Language:C# 295

• microsoft / MCW-Big-data-analytics-and-visualization

  MCW Big data analytics and visualization

  machine-learningazure-data-factoryhdinsightspark-sqldatabase-administratorpower-bi
  Language:JavaScript 190

• microsoft / AzureSMR

  AzureSMR is no longer being actively developed. For ongoing support of Azure in R, see: https://github.com/Azure/AzureR

  razurehdinsightazure-resources
  Language:R 59

• hdinsight / hdinsight-kafka-tools

  HDInsight Kafka Tools

  kafkahdinsighthdinsight-clusterarm-templates
  Language:Python 21

• caiomsouza / microsoft-big-data-scientist-and-ai

  Microsoft Big Data, Data Scientist, and AI

  microsoft-azuredata-scienceaidatadata-analysisdata-visualizationdata-miningpythonrsparkdatabricksnotebookshdinsightpowerbimachine-learningcomputer-visionbigdatastream-processingdatalakestream-analytics
  11

• kcheeeung / hive-benchmark

  Automated TPC-DS and TPC-H benchmark for Apache Hive LLAP

  benchmarkinghivetpcdstpchllapbenchmarkhadooptpc-dstpc-hazurehdinsightaws
  Language:Python 9

• SyncfusionSuccinctlyE-Books / HDInsight-Succinctly

  This is the companion repo for HDInsight Succinctly by James Beresford. Published by Syncfusion.

  hdinsightdata-scienceazure
  Language:C# 9

• UnoSD / SparkSharp

  C# Livy client to submit Spark jobs to HDInsight and other Spark clusters

  sparklivycsharpcosmosdbcosmoscosmos-dbazurehdinsight
  Language:C# 9

• kojish / hdinsight-spark-livy-client

  Java client for submitting a remote job to HDInsight Spark cluster via Livy.

  hdinsightlinuxspark
  Language:Java 6
• airflow-ditto

  angadsingh / airflow-ditto

  An airflow DAG transformation framework

  airflowairflow-daggraph-algorithmsnetworkxawsazurehdinsightemrsparklivyyarnframeworkextensibleisomorphismdataflowgraph-manipulation
  Language:Python 5

• angadsingh / airflow-hdinsight

  HDInsight provider for Airflow

  airflowairflow-operatorsazurehdinsighthdinsight-operatorlivylivy-operatorsazure-storageadlsairflow-hdinsight
  Language:Python 5

• syedhassaanahmed / azure-kafka-spark-adls

  Azure ARM template to deploy Kafka and Spark clusters in same VNet with ADLS

  kafkahdinsightvnetarm-templatesazure-data-lakecertificatebash-scriptopensslservice-principal
  Language:Shell 5

• hau-mal / articles

  BigData Blog articles

  azurebigdatadatalakehdinsightnifi
  3

• AdamPaternostro / Azure-Databricks-HDInsight-Hive-Metastore

  How to share an HDInsight Hive Metastore with Azure Databricks

  azuredatabricksazure-databasehive-metastorehdinsightazure-hdinsight
  1

• AdamPaternostro / Azure-HDI-DistCP

  Creates a HDInsight cluster then runs distcp remotely to copy data between blob and/or data lake (ADLS)

  azurehdinsightdistcphadoopfile-copyazure-storageazure-data-lake
  Language:Shell 1

• AdamPaternostro / Azure-HDInsight-ARM-Template

  Creates an HDInsight cluster that has an external Hive metastore and access to Azure Data Lake Store

  hdinsighthdinsight-service-principleazure-arm-templatesazure-data-lake
  1

• AdamPaternostro / Azure-Spark-Livy-Application-Insights-External-Dependency

  Use Spark with Livy along with Application Insights. Learn to host your external dependencies in data lake.

  azurehdinsightlivyjavasparkspark2application-insightsazure-data-lake
  Language:Java 1

• AfonsoFeliciano / Azure-Data-Factory-for-Data-Engineers

  Repositório do curso de Azure Data Factory for Data Engineers - Project Covid 19

  adbadfazuredata-lake-storehdinsight
  Language:Python 1

• anirudhgupta22 / Microsoft-Azure-HDInsight

  Short documentation on Microsoft's Azure HDInsight

  microsoftazurehdinsighthdinsight-clusterdata-warehousesqoopooziehivepighadoopblobs
  1

• iBalajiShanmugam / covid19-adf

  COVID19-ADF is a project that leverages Azure services to collect, analyze, and visualize COVID-19 data. With seamless data integration and advanced analytics, it provides valuable insights into the pandemic's impact, enabling informed decision-making in the fight against COVID-19.

  adfadlsgen2azurecovid-19data-pipelineecdchdinsightpipelinepowerbisql
  1

• kcheeeung / hive-testbench

  TPC-DS benchmark for experimenting with Apache Hive at any data scale

  benchmarkinghivetpcdstpchllapazurehdinsightbenchmark
  Language:Python 1

• kcm117 / jupyter_local_hdispark_config

  Configure local jupyter with HDInsight Spark cluster

  azurehdinsightjupyterspark
  Language:Python 1

• kojish / hbase-client

  HBase client application

  hbasehdinsight
  Language:Java 1

• murggu / azure-hdinsight-aks-terraform

  An example repo for provisioning a complete HDInsight on AKS environment.

  hdinsighttemplatesterraformaksflinksparktrino
  Language:HCL 1

• windson / HDInsight-Top-N-OverPriced-Products-MapReduce

  Top N OverPriced Products Using HDInsight streaming MapReduce Job

  hdinsightmapreducestreaming-datacsharpdatamining
  Language:C# 1

• windson / HDInsight-TopN-Reviews-MapReduce

  TopN Products by category using HDInsight Streaming MapReduce

  csharphdinsightmapreducestreaming-datadatamininghdinsight-cluster
  Language:C# 1

• windson / ReviewsByDate

  Get date wise number of reviews in the descending order using HDInsight

  hdinsightmapreducecsharpdataminingstreaming-data
  Language:C# 1

• zjplab / Processing-Big-data-with-Hadoop-in-Azure-HdInsight

  Microsoft edx course DAT202.1x

  hdinsighthadoop-mapreduceazure
  1

• bdsines / azure-terraform

  infrastructure-as-codeazurehdinsightvirtual-network
  Language:HCL 0

• calhaley / covid19_report_azure_data_factory

  Integration of Covid-19 data utilising Azure Data Factory to perform data ingestion, transformation and storage activities. The goal of this guided project was to become familiar with Microsoft Azure technologies, including; Azure Data Factory(ADF), Azure Data Lake Storage Gen2, Azure SQL Database, Azure Blob Storage, Dataflow, Databricks, etc.

  azureblobstorageazuredatafactoryazuredatalakegen2azuredatastudioazuresqldbdatabricksdataflowhdinsightpythontsql
  Language:Python 0

• cs-uche / adf-pandemic-analytics

  Pandemic Analytics with Data Factory

  azure-data-factorydata-platformdatabrickshdinsightdata-engineeringci-cd
  Language:PowerShell 0

• proazr / hdinsight-script-actions

  Custom HDInsight Script Actions

  pythonbash-scripthdinsighthadoopambari-api
  Language:Shell 0

• anjijava16 / Azure-Cloud-utils

  Azure Analytics (azure_cloud_utils)

  hdinsighteventhubblobdatabricksdatabricks-notebooks

• Datatamer / terraform-azure-hdinsight-hbase

  Terraform module for terraform-azure-hdinsight-hbase

  azureterraform-managedhbaseterraform-moduleterraformhdinsight
  Language:HCL

• khoinguyen19k8 / adf-covid19

  Data pipeline that processes Covid19 data in Azure Data Factory. CI/CD with Azure Devops.

  azure-data-factoryci-cddatabricksdataflowhdinsight
  Language:PowerShell