Loading…
View analytic
Friday, November 16 • 3:30pm - 3:50pm
Scio data processing nirvana at Spotify

Sign up or log in to save this to your schedule and see who's attending!

Two years ago, Neville introduced Scio, an open-source Scala framework to develop data pipelines and deploy them on Google Dataflow. In this talk, we will discuss the evolution of Scio, and share the highlights of running Scio in production for two years. We will showcase several interesting data processing workflows ran at Spotify, what we learned from running them in production, and how we leveraged that knowledge to make Scio faster, and safer and easier to use.

Speakers
avatar for Bram Leenders

Bram Leenders

Infrastructure Engineer, Spotify
Bram is an infrastructure engineer at Spotify, working on some of the core backend services and event delivery pipelines.
avatar for Julien Tournay

Julien Tournay

Data Engineer, Spotify


Friday November 16, 2018 3:30pm - 3:50pm
data

Attendees (27)