bigspark's repositories
kafka-local
Basic single broker Kafka cluster - docker compose using confluent image
streamsets_json_schema_validator_processor
A streamsets dc sample processor for validation records with a specified JSON schema
ai-hackathon
General Purpose repo for NW AI Hackathon 2023
genai-presidio
Repository for PII Anonymizer code package and sample FastAPI API to use it to talk to LLM
jvm-profiler
JVM Profiler Sending Metrics to Kafka, Console Output or Custom Reporter
aws-sso-sync
sso-sync tool to help with the SCIM setup for bigspark.
emr-uber-profiler-notebooks
emr-uber-profiler-notebooks
incubator-livy
Mirror of Apache livy (Incubating)
snowpark-scala-data-profiling
Data profiling example using Snowflake sample datasets and Scala
sparkMeasure
This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task and stage metrics data.
test_glue
To test glue job
test_glue_
To test glue job