Join for free and connect with our local tech scene

Stay on top of the latest companies and upcoming events with our weekly newsletter, and be counted among the people building the future of your local tech community.

Philadelphia, PA /

Introduction to Apache Spark using Frameless

Azavea 990 Spring Garden 5th Floor , Philadelphia, pa 19123 (map)

This is the talk I recently gave at ScalaIO in Lyon, France and at Scale by the Bay in San Francisco. If you didn't make either conference, and you're interested in Spark or Frameless, you'll have a chance to see the talk locally.

The talk, which is mostly in notebooks, compares and contrasts the native Spark DataFrames and Datasets APIs with the Typelevel Frameless API. Frameless adds compile-time type-safety to Spark, via a TypedDataset class, without incurring the runtime overhead associated with the (also type-safe) native Datasets API.

The talk compares and contrasts all three, with lots of running code examples. If you don't know much about Spark, you'll learn a little bit from the talk. If you know Spark, but you know nothing about Frameless, you'll walk away with some exposure to that cool API.

Venue: Azavea

Food sponsor: Vistar Media

Google Meet simulcast:


Sign in to comment.