Data By the Bay has ended
Data By the Bay is the first Data Grid conference matrix with 6 vertical application areas  spanned by multiple horizontal data pipelines, platforms, and algorithms.  We are unifying data science and data engineering, showing what really works to run businesses at scale.
Monday, May 16 • 4:00pm - 4:40pm
The Engineer's Guide to Streaming -- How you should really compare Storm, Flink, and Apex

Sign up or log in to save this to your schedule and see who's attending!

It feels like every week there's a new open-source streaming platform out there. Yet, if you only look at the descriptions, performance metrics, or even the architecture, they all start to look exactly the same! In short, nothing really differentiates itself - whether it be Storm, Flink, Apex, GearPumk, Samza, KafkaStreams, AkkaStreams, or any of the other myriad technologies. 

So if they all look the same, how do you really pick a streaming platform to solve the problem that YOU have? This talk is about how to really compare these platforms, and it turns out that they do have their key differences, they're just not the ones you usually think about. The way that you need to compare these systems if you're building something to last, a well-engineered system, is to look at how they handle durability, availability, how easy they are to install and use, and how they deal with failures. 

This is a relatively accessible technical talk. Newcomers to the streaming realm are welcome!

avatar for Ilya Ganelin

Ilya Ganelin

Senior Data Engineer, Capital One Data Innovation Lab
Ilya is a roboticist turned data engineer. At the University of Michigan he built self-discovering robots and then worked on embedded DSP software with cell phone radios at Boeing. Today, he drives innovation at Capital One. Ilya is a contributor to the core components of Apache Spark... Read More →

Monday May 16, 2016 4:00pm - 4:40pm

Attendees (13)