apache-avro

There are 1 repository under apache-avro topic.

• miguno / kafka-storm-starter

  [PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

  apache-kafkakafkaapache-stormstormsparkapache-sparkscalaintegrationavroapache-avro
  Language:Scala 727

• thekvs / cpp-serializers

  Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

  apache-avroavroboostc-plus-pluscapn-protocerealcppflatbuffersmsgpackperformance-testingprotobufserializationthriftyas
  Language:C++ 715

• only-cliches / NoProto

  Flexible, Fast & Compact Serialization with RPC

  schemasprotocol-buffersflatbuffersdeserializationzero-copyserializationrpcjsonbsonmessagepackavroapache-avroflexbuffersdata-buffersdatabases
  Language:Rust 365

• marcosschroh / dataclasses-avroschema

  Generate avro schemas from python classes. Code generation from avro schemas. Serialize/Deserialize python instances with avro schemas

  avroapache-avroavro-schemasjson-schemapydanticpython3serializationschemajsoncode-generationmodel
  Language:Python 201

• ynqa / pandavro

  Apache Avro <-> pandas DataFrame

  apache-avropandaspython
  Language:Python 134

• gauravrmazra / gauravbytes

  Examples for gaurav.cc

  apache-avrobigdatadockerelasticsearchelk-stackimdgjavajava-8jupyter-notebookmongodbpandas-dataframespringspring-bootspring-cloudspring-mvc
  Language:Java 59

• leocalm / avro_validator

  A pure python avro schema validator

  avroavro-schemaapache-avropythonpython3
  Language:Python 27

• jwoschitz / avrocount

  Count records in Avro files efficiently

  apache-avroavroutility
  Language:Java 16

• holixon / axon-avro-serializer

  Provide support for axon event serialization via apache avro.

  axonaxon-frameworkavroapache-avroschemaschema-registryextension
  Language:Kotlin 12

• aiven / thingum-industries

  Imaginary manufacturing company event-driven application examples

  apache-kafkademo-appapache-avroasyncapi
  Language:HTML 10

• tspannhw / nifi-attributecleaner-processor

  Clean up attribute names for Apache NiFi to send to Apache Avro

  apache-nifiapache-avrocleaning
  Language:Java 10

• woile / avdl-rs

  Apache Avro AVDL parser

  apache-avroavdlavroavsc
  Language:Rust 7

• Tirth27 / Real-time-analytics-with-spark-streaming

  This project aims to build a streaming application to perform real-time analytics of Covid-19 related tweets and deploy an ML model for real-time sentiment predictions.

  apacheapache-avroapache-kafkaapache-sparkconfluentdockerdocker-composeksqlspark-sqlspark-streamingtwitter-api
  Language:Jupyter Notebook 6

• reddy-s / kafka-avro-consumer

  Kafka consumer application which reads messages from Kafka and based on the schema registered in a schema registry and enriches the data. This is just a prototype on how we can efficiently evolve a schema and read messages with BACKWARD compatibility with out breaking the consumers. This application can be used as a base for a stateless stream processing application which would involve processing one event at a time or filtering though a stream of events.

  kafka-consumerkafkaspringspring-cloudapache-avroschema-registrydata-flowarchitecturestream-processing
  Language:Java 5

• big-data-europe / pilot-sc4-kafka-producer

  Producer and consumer of traffic data for Apache Kafka

  apache-avroapache-kafkarealtime-messaging
  Language:Java 4
• kafka-sensors

  fillmore-labs / kafka-sensors

  Kafka Serialization Playground

  javajava17hexagonal-architectureserializationkafkakafka-streamsavroavro-kafkaconfluent-kafkajsonprotocol-buffersbazelmarshallingionthriftapache-thriftapache-avroschema-registryports-and-adapters
  Language:Java 4

• emanuele-falzone / influxdata-webinar-crm-ratings-use-case

  Customer Relationship Management use case for InfluxData Webinar - 16/06/2020

  apache-avroinfluxdatainfluxdbkafkakafka-producertelegraftelegraf-plugin
  Language:Shell 2

• etorres / notifications-engine

  Notifications Engine

  apache-avroapache-kafkacats-effectdeliberate-practicefs2http4slearning-by-doing
  Language:Scala 2

• lxucs / Tryout-Avro

  Sample project to try out Apache Avro.

  apache-avro
  Language:Java 2

• reddy-s / kafka-avro-producer

  Kafka producer application which publishes messages to Kafka and registers the schema of the message in a schema registry

  kafka-producerspringspring-cloudkafkaschema-registryarchitecturedata-flowstream-processingapache-avro
  Language:Java 2
• AI2001_Category-Source_Code-SC-Apache-Avro

  seanpm2001 / AI2001_Category-Source_Code-SC-Apache-Avro

  🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️💾️📜️ The sourceCode:Apache-Avro category for AI2001, containing Apache Avro programming language datasets

  aiai-2001ai-2001-datasetai-2001-developmentai2001ai2001-datasetai2001-developmentapache-avroartificial-intelligencedatasetgpl3gplv3sc-datasetsource-code-datasetapache-avro-langapache-avro-languageapache-avro-sc-dataset
  Language:R 2
• Learn-ApacheAvro

  seanpm2001 / Learn-ApacheAvro

  📚️ A repository for showcasing my knowledge of the Apache Avro programming language, and continuing to learn the language.

  apache-avroapache-avro-langapache-avro-languagearticlecollectioneducationgpl3gplv3knowledgelearnseanpm2001seanpm2001-docsseanpm2001-documentationseanpm2001-educationseanpm2001-languagesseanpm2001-learnseanpm2001-life-archivelearn-apache-avrolearn-apache-avro-langlearn-apache-avro-language
  Language:HTML 2
• SNU_2D_ProgrammingTools_IDE_ApacheAvro

  seanpm2001 / SNU_2D_ProgrammingTools_IDE_ApacheAvro

  ⌨️ The Apache Avro programming language IDE submodule for SNU Programming Tools (2D Mode)

  apache-avroapache-avro-langapache-avro-languagegpl3gplv3ideprogrammingsnusnu-2dsnu-2d-programming-toolssnu-2d-programmingtoolssnu-developmentsnu-programming-toolssnu2d-programming-toolssnu2d-programmingtoolssnu2dprogrammingtoolssnuprogramming-toolssnuprogrammingtoolsweb-developmentweb-ide
  Language:HTML 2

• astrolabsoftware / fink-alert-simulator

  Simulate alert streams for the Fink broker

  apache-avroapache-kafkaastronomystreaming
  Language:Python 1

• era5mx / avro-example

  Este es un breve ejercicio para ejemplificar el uso de Apache Avro ™ utilizando Java.

  apacheapache-avroavroavro-utilizando-java
  Language:Java 1

• esakik / data-engineering-essentials

  Samples related to data engineering, e.g. spark, embulk, airflow, etc.

  apache-beamapache-sparkapache-airflowapache-hadoopfluentdembulkdigdagmrjobcloud-dataproccloud-dataflowamazon-emrprotocol-buffersapache-avrodata-engineering
  Language:Python 1

• lyes-s / multi-element-relationally-interconnected-topology

  M.E.R.I.T : The Microservices NextGen 🕊️

  apache-avroapache-kafkaapache-zookeeperbootstrap5confluent-schema-registryconsulflywayjava-11kafdropmongodbpostgresqlredis-clusterspring-bootspring-cloud-gatewayspring-dataspring-graphqlspring-kafkaspring-mvcspring-webfluxthymeleaf-template-engine
  Language:Java 1

• SharanRajani / SparkStreamingKafkaPOC-Scala

  Apache Kafka Producer and Consumer which uses Spark-Streaming and Avro Serialization written in Scala.

  apache-avroapache-kafkaapache-sparkscalaspark-streaming
  Language:Scala 1

• Vishal1297 / vehicle-manager

  A Vehicle Manager Project Using Java + Kotlin

  gitgithubjavakotlingradleintellijapache-avroapijersey-frameworkjersey-testvehiclemanagervishal1297
  Language:Kotlin 1

• antoniosergiojr / ecommerce_digital_innovation_one

  Criando uma solução de e-commerce com microsserviços em Java

  apache-avroapache-kafkaapache-zookeeperdigital-innovation-onedockerjavapostgresqlspring-boot
  Language:JavaScript 0

• cbdq-io / docker-avro-tools

  Make avro-tools available via a Docker container.

  apache-avrodockerhacktoberfest
  Language:Makefile 0

• AbdullahMu / Data-Streaming-Nanodegree-Project_01-Optimizing-Public-Transportation

  Construct a streaming event pipeline around Apache Kafka and its ecosystem. Using public data from the Chicago Transit Authority, we will construct an event pipeline around Kafka that allows us to simulate and display the status of train lines in real time.

  apache-avroapache-kafkaconfluentconfluent-kafkadata-streamingfaustjdbckafkaksqlpython3serialisationstream-processing
  Language:Python

• alivcor / torque

  Serialize your Spark Dataframes to and from Avro

  apache-avroapache-sparkavroserdeserializationspark
  Language:Scala

• suyashs52 / kafka-avro

  schema registry using kafka avro

  avro-kafkaschema-registryapache-avroconfluent-kafka
  Language:Java

• Vishal1297 / first-avro-project

  An Apache Avro Project Using Java.

  gitgithubjava-8gradlegradle-plugingradle-javaavroapache-avroavscvishal1297
  Language:Java

• Vishal1297 / user-manager

  A User Manager Project Using Dagger 2 & Apache Jersey

  gitgithubjavakotlingradleavroapache-avrojersey2dagger2mongodbcrudcrud-apivishal1297
  Language:Java