zenyui / proto-scala

testing sparkpb

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

scalapb example

Small example demonstrating proto files for many services.

Current issue

spark can't serialize the scalapb.TypeMapper class, so a spark transformation that uses the generated class .parseFrom(Array[Byte]) constructor fails. I'm able to recreate this by defining a proto3 object with a map<string, string> field.

To reproduce this example, run sbt test

About

testing sparkpb


Languages

Language:Scala 100.0%