vsimko / spark-scala-training

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

spark-scala-training

Scala recap

Topics:

  • vals/vars, lazy
  • statement vs expression, if-expr
  • functions and named arguments
  • for-comprehensions vs flatmapping
  • throws vs Try/Either/Option
  • generics, variance, Unit
  • traits, final case classes, companion objects
  • extension methods in scala 2
  • implicits in scala 2
  • package objects (e.g. in testing)
  • multi-word identifiers (e.g. in tests, constants)
  • single-argument functione e.g. Try{...}
  • immutable vs mutable containers
  • update() syntax sugar
  • apply method
  • variable arguments + expanding a collection in place of varargs
  • logging
  • scala-testing

Other topics not covered here:

  • collections, futures, type classes, akka, zio, cats
  • opaque types (scala 3) / value classes (scala 2)
  • tagless final

Spark : Basic Concepts

Master Workers Cluster, Serialization, Plans, Jobs, Tasks, Web Console Spark SQL, Dataframes vs Datatypes

Spark : Type-Unsafe API

Spark : Type-Safe API

Spark : Special Stuff

  • Enumerations
  • MdmsDecimal

About