Back To Schedule
Friday, November 16 • 9:50am - 10:30am
Fast Data pipelines with Akka Streams and Alpakka Kafka Connector

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

The Alpakka Kafka connector (formerly known as reactive-kafka) is a component of the Alpakka project.  It provides a diverse streaming toolkit, but sometimes it can be challenge to design these systems without a lot of experience with Akka Streams and Akka.  By combining Akka Streams with Kafka using Alpakka Kafka, we can build rich domain, low latency, and stateful streaming applications with very little infrastructure.

This talk will discuss solutions to common Kafka and streaming problems such as consumer group partition rebalancing, exactly-once/transactional message delivery, stateful stages, state durability/persistence, and common production concerns like job failover and deployment.

The Alpakka project is an open source initiative managed by Lightbend to implement stream-aware, reactive, integration pipelines for Java and Scala. It is built on top of Akka Streams, and has been designed from the ground up to understand streaming natively and provide a DSL for reactive and stream-oriented programming, with built-in support for backpressure.

avatar for Sean Glover

Sean Glover

Software Engineer, Fast Data Platform Team, Lightbend
Sean is a Senior Software Engineer on the Fast Data Platform team at Lightbend.  He specializes in Apache Kafka and its ecosystem.  He has experience consulting with Global 5000 companies on how to build Fast Data platforms using technologies such as Scala, Kafka, Spark, and Akka... Read More →

Friday November 16, 2018 9:50am - 10:30am PST