Google I/O: Hello Dataflow, Goodbye MapReduce - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Comments
Google I/O: Hello Dataflow, Goodbye MapReduce
Newest First  |  Oldest First  |  Threaded View
IOTpreneur
50%
50%
IOTpreneur,
User Rank: Apprentice
12/1/2014 | 4:37:39 PM
Price war ahead
Hello,

interesting information about this services, Google have been incorporated Moore's Law in pricing structure, it seems Google wants a big share of the market, i think there is a price war, better for us ;)

Regards.
senorcarbone
50%
50%
senorcarbone,
User Rank: Apprentice
7/3/2014 | 9:56:10 AM
Re: Dataflow implications for Hadoop community?
You can take a look on the following Apache incubator projects as the open source equivalents on parallel dataflow processing

- Apache Tez (https://tez.incubator.apache.org/)

- Apache Flink (former Stratosphere) (https://github.com/apache/incubator-flink
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
6/27/2014 | 8:15:00 PM
Google's goal: a competitive service
Agreed, many implications for Hadoop and other open source communities, Doug. There was no discussion on those issues that I got to witness at Google I/O. The thing I see is Google using its data handling expertise to build a competitive cloud service, let the chips fall where they may.
D. Henschen
50%
50%
D. Henschen,
User Rank: Author
6/27/2014 | 11:38:02 AM
Dataflow implications for Hadoop community?
Charlie, this Dataflow announcement would seem to have huge implications for the Hadoop community, given that that platform was inspired by Google's technologies and white papers. With the introduction of YARN, the Hadoop community, too, has been moving away from MapReduce, but what's the Hadoop world's equivalent of Dataflow? Was anybody drawing parallels/similarities to Apache Spark or Apache Storm, for example?


State of the Cloud
State of the Cloud
Cloud has drastically changed how IT organizations consume and deploy services in the digital age. This research report will delve into public, private and hybrid cloud adoption trends, with a special focus on infrastructure as a service and its role in the enterprise. Find out the challenges organizations are experiencing, and the technologies and strategies they are using to manage and mitigate those challenges today.
Slideshows
What Digital Transformation Is (And Isn't)
Cynthia Harvey, Freelance Journalist, InformationWeek,  12/4/2019
Commentary
Watch Out for New Barriers to Faster Software Development
Lisa Morgan, Freelance Writer,  12/3/2019
Commentary
If DevOps Is So Awesome, Why Is Your Initiative Failing?
Guest Commentary, Guest Commentary,  12/2/2019
Register for InformationWeek Newsletters
Video
Current Issue
The Cloud Gets Ready for the 20's
This IT Trend Report explores how cloud computing is being shaped for the next phase in its maturation. It will help enterprise IT decision makers and business leaders understand some of the key trends reflected emerging cloud concepts and technologies, and in enterprise cloud usage patterns. Get it today!
White Papers
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Sponsored Video
Flash Poll