Data By the Bay has ended

Create Your Own Event

Data By the Bay

Data By the Bay is the first Data Grid conference matrix with 6 vertical application areas spanned by multiple horizontal data pipelines, platforms, and algorithms. We are unifying data science and data engineering, showing what really works to run businesses at scale.

8:45am PDT

Grand Welcome & Opening Remarks GardnerAlexy Khrabrov

8:55am PDT

Host Sponsor Welcome: Nitro GardnerRoland Tritsch

9:05am PDT

Keynote: Building a Real-time Streaming Platform Using Kafka Streams and Kafka Connect GardnerJay Kreps

9:50am PDT

Time-series Feature Engineering Done Right GardnerParag Namjoshi Building a Realtime Receiver with Spark Streaming MarkovSal Uryasev Elastic Data Pipelines AdaClaudio Caldato • Adam Mollenkopf • Sunil

10:40am PDT

Deploying Image Recognition on a Budget AdaShourabh Rawat Google BigQuery: a fully-managed data analytics service in the cloud GardnerMichael Entin Taming JSON with SQL: From Raw to Results MarkovGreg Rahn

11:10am PDT

Investing in Data Analytics: Risks and Opportunities in the Zettabyte Era AdaKanu Gulati

11:40am PDT

Functional Programming for Machine Learning and Data Pipelines GardnerMalcolm Greaves Apache Flink: A Very Quick Guide AdaVladimir Bacvanski Characterizing and measuring the performance of Big Data processing platforms MarkovManish Singh

1:10pm PDT

Akka Streams for Large Scale Data Processing AdaZack Loebel-Begelman • Dustin Lyons Building domain specific databases with a distributed commit log [Kafka/Kubernetes] MarkovYunjing Xu Netflix Keystone - Streaming Data Pipeline @Scale in the Cloud GardnerMonal Daxini

2:10pm PDT

The Lego Model for Machine Learning GardnerVitaly Gordon Real-time, Streaming Advanced Analytics, Approximations, and Recommendations using Apache Spark ML/GraphX, Kafka Stanford CoreNLP, and Twitter Algebird BONUS: Netflix Recommendations: Then and Now MarkovChris Fregly Twitter Heron in Practice AdaKarthik Ramasamy

3:00pm PDT

A Real Time Analytics Framework AdaHiral Patel Concord: Simple & Flexible Stream Processing on Apache Mesos MarkovShinji Kim Speed up app development with prefabricated, extensible, open-source backends GardnerSlava Akhmechet

4:00pm PDT

Quantitative Trading with Machine Learning AdaMartin Froehler Parallel and distributed big joins in H2O MarkovMatt Dowle The Engineer's Guide to Streaming -- How you should really compare Storm, Flink, and Apex GardnerIlya Ganelin

5:00pm PDT

Panel: Future of Data Services GardnerAlexy Khrabrov • Marius Eriksen • Joel Horwitz • Haoyuan (H.Y.) Li • William Morgan • Neha Narkhede • Roman Shaposhnik

6:00pm PDT

Happy Hour The Galvanize Lobby

8:45am PDT

Opening Remarks GardnerAlexy Khrabrov

8:55am PDT

Host Sponsor Welcome: IBM Analytics GardnerJoel Horwitz

9:05am PDT

Data and Algorithmic Bias in the Web GardnerRicardo Baeza-Yates

9:50am PDT

Building Word2Vec Models with Text Data AdaJorge Castanon Identifying Actionable Messages on Social Media MarkovNemanja Spasojevic The practice of acquiring good labels GardnerOmar Alonso

10:40am PDT

Hunting Criminals with Hybrid Analytics MarkovDavid Talby lda2vec AdaChristopher Erick Moody Smarter Search with Spark, Solr and Machine Learning GardnerGrant Ingersoll

11:10am PDT

Image Retrieval using Short Texts MarkovMaarten Bosma

11:40am PDT

Automatic Links for a Web of Text AdaScott (TS) Waterman Google Translate - how machines do it GardnerBarak Turovsky Using Spark MLlib for NLP MarkovMichelle Casbon

1:10pm PDT

An Innovative Approach to Labeling Ground Truth in Speech AdaJill Desmond Data & Metadata at the Internet Archive GardnerGreg Lindahl Scalably Internationalizing Millions of Latent Semantic Labels MarkovXiao Fan

1:40pm PDT

Of Rules and Probabilities: Computational Linguistics Methods for Improving Machine Learning Models AdaVita Markman

2:10pm PDT

Aspect Based Sentiment Analysis in 20+ Languages AdaAntonio Valderrabanos SAMEntics : Tools for paraphrase detection and paraphrase generation MarkovNiyati Parameswaran Sparse data alternatives with neural network embeddings GardnerMarvin Bertin • David Ott • Mike Tamir

3:00pm PDT

Alluxio (formerly Tachyon): Open Source Memory Speed Virtual Distributed Storage System AdaGene Pang News Analytics in Finance GardnerGary Kazantsev PhrazIt : Tool for automatic text summarization MarkovNiyati Parameswaran

4:00pm PDT

Time series analytics for Big Data and IoT with Kx MarkovFintan Quill Airbnb and Marketplace Matching GardnerSurabhi Gupta Mining Noisy Transaction Data with Neural Nets AdaFrank Taylor

4:20pm PDT

byte2vec: a flexible embedding model constructed from bytes MarkovParsa Ghaffari

5:00pm PDT

Panel: Human Intent and Text Understanding GardnerAlexy Khrabrov • Tihomir Bajić • Jenny Finkel • Surabhi Gupta • Robert Munro

6:00pm PDT

Happy Hour The Galvanize Lobby

8:45am PDT

Opening Remarks GardnerAlexy Khrabrov

9:00am PDT

Let's Build Civic Tech to Scale Democracy for a Better Future GardnerMatt Mahan

9:50am PDT

Synthesizing human and machine capabilities AdaEric Colson Black Magic: How to apply Machine Learning to real-world problems MarkovEvion Kim Hot Legal Issues GardnerFrancoise Gilbert

10:10am PDT

Data From Click To Settlement: A Full-Funnel UX Approach AdaMichael Terry

10:40am PDT

End-2-End Monitoring and Troubleshooting a Real-Time Data Pipeline AdaAlan Ngai How Data Science is Evolving Technology Education GardnerRyan Orban An approach to internal search query analysis MarkovMax Ho • Dhruv Sampat

11:10am PDT

Design for Local Government: Data, Services, and Transparency GardnerSteve Pepple Creating Value by Turning Law Into Data AdaDaniel Lewis Text Analytics Simplified MarkovTrung Diep • Ronald Sujithan

11:40am PDT

Unsupervised NLP Classification with Clustering GardnerMatthew Seal Hidden in plain sight: Using law to summarize the law AdaRichard Downe From text to knowledge via ML algorithms - the Quora answer MarkovXavier Amatriain

1:10pm PDT

Open Collaboration for Civic Impact GardnerLawrence Grodeska Case Law and ML on Spark AdaJeremy Corbett Single Customer View MarkovThomas Trolez

1:40pm PDT

Making Predictions Under Lending Regulations AdaYujay Huoh Litigation Mitigation: Using NLP to Minimize Errors in Contracts GardnerShipra Dingare • Gurinder Sangha Privacy Issues in Big Data Processing in light of Data Breaches MarkovS. Srinivasan

2:10pm PDT

Building a Graph of all US businesses using Spark technologies AdaAlexis Roos Breaking Down Paywalls for Online Health MarkovPauline Ng Why The Best Minds Of Our Generation Are Thinking About How To Get People to Click on Ads GardnerJosh Wills

2:30pm PDT

Building AI that Searches and Sells AdaAnand Kulkarni

3:00pm PDT

Gathering around the data table MarkovJason Lally Analyzing Time Interval Data AdaPhilipp Meisen Insider Text GardnerGregor Stewart

3:20pm PDT

Quantifying Democracy and Freedom with Human Rights and Fertility Metrics MarkovDmitri Gusev

4:00pm PDT

Analytics as Code with Juttle MarkovDaria Mehra Building semantic search using Deep Learning GardnerSamiur Rahman Deep Dive: Spark Memory Management AdaAndrew Or

4:30pm PDT

Data governance and distribution with Dat MarkovKarissa McKelvey

5:20pm PDT

Panel: Data and Society GardnerAlexy Khrabrov • Elizaveta Malashenko • Brad Newman • Gurinder Sangha • Nicole Shanahan

6:00pm PDT

Happy Hour The Galvanize Lobby

8:45am PDT

Opening Remarks GardnerAlexy Khrabrov

9:00am PDT

Keynote: How Can We Trust Machine Learning? Exploration, Evaluation and Explanation for ML Models GardnerCarlos Guestrin

9:50am PDT

Building an A.I. Cloudy Sky: What We Learned at PredictionIO MarkovSimon Chan What Kaggle has learned from 2MM machine learning models GardnerAnthony Goldbloom Beyond 1M Acres of Drone Imagery AdaNicholas Pilkington

10:40am PDT

Predicting Hacker News with Beam and TensorFlow AdaEric Anderson Analyzing Massive Time Series Data with Spark GardnerSandy Ryza The Promise of Heterogeneous Computing MarkovSubbu Rama

11:10am PDT

Finding Your Audience In The Internet of Things MarkovDhruv Choudhary Know the air you are breathing AdaSeema Jethani MacroBase: Analytic Monitoring for the Internet of Things GardnerPeter Bailis

11:40am PDT

Inside Pandora: Practical Application of Big Data in Music GardnerOscar Celma Recommendations for Building Machine Learning Software AdaJustin Basilico The Security Wolf of Wall Street: Fighting Crime with High-Frequency Classification and Natural Language Processing MarkovJeremiah O'Connor and Thibault Reuille

1:10pm PDT

Fast deep recurrent net training GardnerSanjeev Satheesh Building realtime efficient queries and batch jobs in an IOT platform AdaDinesh Narayanan IoT security using data analysis MarkovDr. May Wang

2:10pm PDT

Scalable Training of RNNs for Speech Recognition GardnerErich Elsen Detecting Anomalies in Streaming Data – Real-time Algorithms for Real-world Applications MarkovSubutai Ahmad Deep dive and best practices of Spark streaming AdaPrakash Chockalingam

3:00pm PDT

Automating Data Science for the IOT MarkovRuban Phukan Active Learning and Human-in-the-Loop Machine Learning GardnerLukas Biewald Hidden GEMMs: How Optimized Math Libraries Work AdaMarek Kolodziej

3:30pm PDT

A Match Made at Upwork MarkovAlya Abbott

4:00pm PDT

Apache Beam (incubating): Unified batch and streaming data processing AdaEugene Kirpichov Multimodal Question Answering for Language and Vision GardnerRichard Socher Optimizing Machine Learning Models MarkovScott Clark

4:20pm PDT

Data in the Apache "big data" ecosystem AdaKonstantin Boudnik

5:00pm PDT

Panel: Artificial Intelligence: Who is Winning? GardnerAlexy Khrabrov • SriSatish Ambati • Pete Skomoroch • Richard Socher • Shivon Zillis

6:00pm PDT

Happy Hour The Galvanize Lobby

8:45am PDT

Opening Remarks GardnerAlexy Khrabrov

9:00am PDT

Why you can't afford to ignore deep learning GardnerJeremy Howard

9:50am PDT

On the path to data Nirvana: Supporting OLTP and OLAP on Hadoop AdaMonte Zweben Challenges Applying Traditional UI/UX Principles to Machine Learning Products MarkovDemetri Spanos Coevolution: UX and the Changing Relationship Between Mind and Machine GardnerHunter Whitney

10:40am PDT

Driver: How Data Science and Engineering Can Extend the Lives of Cancer Patients GardnerPetros Giannikopoulos Designing Visualizations of Health that Resonate With Users MarkovAlan McLean Real Time Machine Learning Visualization with Spark AdaChester Chen

11:10am PDT

A Scalable GA4GH Server Implementation AdaAndy Petrella What Healthcare Can Learn from Netflix: Personalizing and Optimizing Preventive Care GardnerEric Williams Visualizing the silent force of the Bay MarkovBoriana Viljoen

11:40am PDT

Interactive Machine Learning on Genomics Data with the Spark Notebook AdaAndy Petrella Real-time diagnostics for the masses GardnerElad Ferber Translating a Trillion Points of Data into Therapies, Diagnostics, and New Insights into Disease MarkovAtul Butte

12:00pm PDT

Build Smarter, Don't Just Build MarkovHernan Asorey • Robin Glinton Challeneges in 3D Volumetric Data Sets AdaTodd Huffman Ginger.io: a Data-Driven Mental Health Care Provider GardnerSai Moturu

1:10pm PDT

Cancer Screening using Deep Learning GardnerDaniel Golden Designing for Inconsistency AdaBrian Studwell Visualizing big data: live coding an interactive dataviz app with opensource tools MarkovOlivier Balbous

1:40pm PDT

How to Use Big Data to Inspire Consumer Confidence AdaDaniel Doerr With Big Data Comes Big Responsibility GardnerNish Bhat

2:10pm PDT

The UMLS - Authoritative biomedical concept names in context AdaBrian Carlsen • Mark Samuel Tuttle Discoveries in using behavioral sensor data for authentication GardnerJohn Whaley Pro-Active: Designing a genuinely helpful SQL interface, that even power-users love MarkovAaron Kalb

3:00pm PDT

Distributed Visualization for Genomic Analysis GardnerAlyssa Morrow • Eric Tu Data Design Challenges for Enterprise IoT Applications: Semantic Sensor Network Ontologies AdaZachary Taschdjian Remixing Design with Data MarkovJames Mulholland

3:30pm PDT

How Data helps UX evolves at realtor.com AdaIan Lin Urban Heartbeat: Data Experiments with Place GardnerSteve Pepple When Visualization Best Practices Fall On Deaf Ears MarkovAkash Mukherjee

4:00pm PDT

Deep Learning, Heart Rate Sensors, and Strokes AdaBrandon Ballinger • Johnson Hsieh Extracting Medical Attributes from Clinical Trials GardnerSanghamitra Deb UX Techniques Supporting Varying Levels of Aggregation in Data Selection and Visualization MarkovKatherine Ahern

4:50pm PDT

Protecting data scientists in healthcare with type safety MarkovGopal Ramachandran Importance of rethinking data visualization GardnerKyle Hailey Towards a virtual reality meta-Earth AdaBo Huang

5:20pm PDT

Panel: Living Data GardnerAlexy Khrabrov • John St. John • priya joseph • Jeff Lerman • Daniella Perlroth

6:00pm PDT

Happy Hour The Galvanize Lobby