contactsunny / spring-spark-s3-file-read

A POC written in Java using the Spring framework, which uses Apache Spark to read a file from Amazon S3 FS and counts the number of lines in the file.

Spring - Spark - S3 - File Read POC

A simple POC which reads a file from the Amazon S3 FS using Apache Spark, then counts the number of lines in the file. The project is written in Java using the Spring Boot framework.

Configuration

All configuration parameters could be found in the src/main/resources/application.properties file. You can change the config to match your project.