Join for free and connect with our local tech scene
Stay on top of the latest companies and upcoming events with our weekly newsletter, and be counted among the people building the future of your local tech community.
This is the talk I recently gave at ScalaIO in Lyon, France and at Scale by the Bay in San Francisco. If you didn't make either conference, and you're interested in Spark or Frameless, you'll have a chance to see the talk locally.
The talk, which is mostly in notebooks, compares and contrasts the native Spark DataFrames and Datasets APIs with the Typelevel Frameless API. Frameless adds compile-time type-safety to Spark, via a TypedDataset class, without incurring the runtime overhead associated with the (also type-safe) native Datasets API.
The talk compares and contrasts all three, with lots of running code examples. If you don't know much about Spark, you'll learn a little bit from the talk. If you know Spark, but you know nothing about Frameless, you'll walk away with some exposure to that cool API.
Food sponsor: Vistar Media
Google Meet simulcast: meet.google.com/eqi-sscv-brf