Google I/O: Hello Dataflow, Goodbye MapReduce - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Comments
Google I/O: Hello Dataflow, Goodbye MapReduce
Newest First  |  Oldest First  |  Threaded View
IOTpreneur
50%
50%
IOTpreneur,
User Rank: Apprentice
12/1/2014 | 4:37:39 PM
Price war ahead
Hello,

interesting information about this services, Google have been incorporated Moore's Law in pricing structure, it seems Google wants a big share of the market, i think there is a price war, better for us ;)

Regards.
senorcarbone
50%
50%
senorcarbone,
User Rank: Apprentice
7/3/2014 | 9:56:10 AM
Re: Dataflow implications for Hadoop community?
You can take a look on the following Apache incubator projects as the open source equivalents on parallel dataflow processing

- Apache Tez (https://tez.incubator.apache.org/)

- Apache Flink (former Stratosphere) (https://github.com/apache/incubator-flink
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
6/27/2014 | 8:15:00 PM
Google's goal: a competitive service
Agreed, many implications for Hadoop and other open source communities, Doug. There was no discussion on those issues that I got to witness at Google I/O. The thing I see is Google using its data handling expertise to build a competitive cloud service, let the chips fall where they may.
D. Henschen
50%
50%
D. Henschen,
User Rank: Author
6/27/2014 | 11:38:02 AM
Dataflow implications for Hadoop community?
Charlie, this Dataflow announcement would seem to have huge implications for the Hadoop community, given that that platform was inspired by Google's technologies and white papers. With the introduction of YARN, the Hadoop community, too, has been moving away from MapReduce, but what's the Hadoop world's equivalent of Dataflow? Was anybody drawing parallels/similarities to Apache Spark or Apache Storm, for example?


2020 State of DevOps Report
2020 State of DevOps Report
Download this report today to learn more about the key tools and technologies being utilized, and how organizations deal with the cultural and process changes that DevOps brings. The report also examines the barriers organizations face, as well as the rewards from DevOps including faster application delivery, higher quality products, and quicker recovery from errors in production.
News
The State of Chatbots: Pandemic Edition
Jessica Davis, Senior Editor, Enterprise Apps,  9/10/2020
Commentary
Deloitte on Cloud, the Edge, and Enterprise Expectations
Joao-Pierre S. Ruth, Senior Writer,  9/14/2020
Slideshows
Data Science: How the Pandemic Has Affected 10 Popular Jobs
Cynthia Harvey, Freelance Journalist, InformationWeek,  9/9/2020
Register for InformationWeek Newsletters
Video
Current Issue
IT Automation Transforms Network Management
In this special report we will examine the layers of automation and orchestration in IT operations, and how they can provide high availability and greater scale for modern applications and business demands.
White Papers
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Sponsored Video
Flash Poll