Data By the Bay has ended
Data By the Bay is the first Data Grid conference matrix with 6 vertical application areas  spanned by multiple horizontal data pipelines, platforms, and algorithms.  We are unifying data science and data engineering, showing what really works to run businesses at scale.
Back To Schedule
Monday, May 16 • 9:50am - 10:30am
Elastic Data Pipelines

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Consumers want applications that make driving a seamless experience. The global automotive software market is expected to reach $10.1 billion by 2020, according to a 2014 report. By that same time, there will be 200 million connected cars on the road generating valuable information that can be utilized to improve safety, enhance quality and build new revenue streams. In this talk, we will discuss how to build real-world data pipelines that can deliver on these consumers demands and help companies tap into new revenue streams. We’ll show how to build and use data pipelines in a scalable and elastic way, and demonstrate their usage for the types spatio-temporal data that vehicles generate as they travel. Attendees will come away understanding how leading edge connected-car applications are delivered to market. The presentation will include the following technology components * Esri-developed Scala/Play app for highly interactive/dynamic map visualization * Azure IoT Hub for event ingestion * Mesosphere Infinity for event processing

avatar for Claudio Caldato

Claudio Caldato

Microsoft, Microsoft
Claudio is a Program Manager in the Azure IoT Team. His team is building an IoT solution that leverages OSS technologies such as Mesos/DC/OS, Spark, Cassandra, Kafka, Akka and many others. Before joining the Azure team he worked on Node.js, Redis and other OSS technologies along... Read More →
avatar for Adam Mollenkopf

Adam Mollenkopf

Real-Time & Big Data GIS Capability Lead, Esri
Adam Mollenkopf is responsible for the strategic direction Esri takes towards enabling real-time and big data capabilities in the ArcGIS platform. This includes having the ability to ingest real-time data streams from a wide variety of sources, performing continuous and recurring... Read More →
avatar for Sunil Shah

Sunil Shah

Engineering Manager, Airbnb
Sunil Shah is an Engineering Manager at Airbnb. His team builds and maintains the Kubernetes-based platform that powers Airbnb.com. Prior to Airbnb, Sunil managed compute for Yelp, helped commercialise Apache Mesos at Mesosphere, studied robotics at UC Berkeley, and build ingestion... Read More →

Monday May 16, 2016 9:50am - 10:30am PDT