Scale By the Bay 2018

Paraphrasing Yogi Berra, “The future of Hadoop is not what it used to be. The times are different. Not necessarily worse or better. They are just different.” In this talk, I would give a brief survey of the future of Hadoop as it used to be from 2005 to 2015, based on the roadmaps of several developers, evangelists (including yours truly), vendors, and analysts over those years, to give a flavor of how the future of Hadoop has changed over the years. I would try to analyze the reasons behind this change, primarily due to emergence of public cloud and rapid response by traditional analytics ecosystem. As hype around “Big Data” seems to subside, it is being replaced by yet another hype about “AI”. I would prognosticate about how the Hadoop ecosystem would evolve to power current and future AI use cases.