Chris Bedford's repositories
project.euler
solutions-to-various-discrete-math-number-theory-problems-while-i-learn-up-on-python
python_tictaktoe
learn/improve my python by programming this silly game
spark-struct-streaming-metrics-missing-on-aws
Demo of how when we deploy on AWS/EMR the structured streaming metrics tab shows no batches processed and no graphs
gradle-test-configuration-plugin
Gradle plug-in that sets up testNG as test runner, and adds a new 'integrationTest' task
kafka-spark-testing
Code examples for article here: http://datalackey.com/2020/09/22/unit-integration-testing-kafka-and-spark/
spark.examples.with.gradle6
A home for various Scala examples that I want to retain for posterity.
featuregen
generate features for machine learning
spark-examples
spark sql, dataset/dataframe and structured streaming examples used to study for databricks certification exam
docker-spark-standalone
:ship: Standalone Apache Spark Docker image
spark-structured-streaming-vs-dstreams
toy project illustrating how to process a mock stream of sensor data via Spark structured streaming and the (older) dstreams API
spark-streaming-group-by-event-time
code samples for this article: http://datalackey.com/2019/06/21/exploring-event-time-and-processing-time-in-spark-structured-streaming/
spark-scala-playground
Sample processing code using Spark 2.1+ and Scala
json-schema-validation-demo
short demo -- in scala -- of how to validate arbitrary JSON instance documents against a JSON schema
spark-testing-base-with-streaming
some examples of unit testing with spark streaming and spark sql using spark-testing-base (holden karau)
high-performance-spark-examples
Examples for High Performance Spark
ndbench
Netflix Data Store Benchmark
spark-testing-base
Base classes to use when writing tests with Spark
kafkaOffsetBug
reproducible steps for bug report on kafka 0.8.2.1 getOffsetsBefore API call.
scala-multimodule-sample-project
A sample Scala project with multiple modules and Scalatra
fabric8-k8s-fiddling
create a load balanced service (with externally accessible IP) in kubernetes using the fabric8 API.
akka-fiddling
fiddle with akka and spray
akka-http-microservice
Example of (micro)service written in Scala & akka-http
jenkins-build-box-with-vagrant
Vagrant recipe for provisioning linux box with jenkins,java,maven and optionally, fortify