Pivotal Open-Source Play Points To Industry Shift - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Data Management
News
2/17/2015
07:06 PM
Connect Directly
Twitter
RSS
E-Mail
100%
0%

Pivotal Open-Source Play Points To Industry Shift

Open source is driving big data, and two major announcements from Pivotal show that isn't going to stop.

10 In-Memory Database Options Power Speedy Performance
10 In-Memory Database Options Power Speedy Performance
(Click image for larger view and slideshow.)

Two major announcements by Pivotal Tuesday signal a continuing shift toward open source products for big data, and for enterprise software in general. The first was that Pivotal will create what it is calling the "world's first open source big data product suite," by releasing its Pivotal HD, Pivotal HAWQ, Greenplum Database, and Gemfire products all as open source projects.

The second is that Pivotal will join Hortonworks, GE, IBM, Verizon, SAS, Infosys, and others in the creation of an Open Data Platform initiative designed to improve the Hadoop ecosystem. Combined, this news serves as a wakeup call to CIOs who may still be wary of open source software.

The fact that Pivotal would make such a big move with a product that drew over $100 million in subscriptions last year shows the company's belief that the enterprise software market is changing. Big companies "saw success in the first generation of open source and adopting it now is more comfortable," Sundeep Madra, VP of Pivotal's data product group, said in an interview with InformationWeek. "Many CIOs used to say 'open source over my dead body,' and now there are a lot of dead bodies on Wall Street."

Pivotal execs say the move is all about community and responsiveness. Rather than waiting for vendors to get around to adding wanted features, open source code lets customers participate in the creation of the features they most want. "It is part of a continuum on a customer journey," Madra said. "Customers have been working with us for a long time. This is what differentiates us."

Of course, this isn't an isolated incident, as these kinds of open source software contributions are a major trend. Pivotal execs say that this move is inspired by the success they had with open source Cloud Foundry. Even Microsoft recently open-sourced the .Net core. And big data has always relied on major open source products including Hadoop, MapReduce, MongoDB, and many others.

One major driver of this shift to open source is the growing demand to manage massive quantities of data, and analyze that data in real-time, especially for Internet of Things initiatives. One major obstacle to delivering on the promise of the IoT has been a lack of data standards and the fact that many enterprises struggle to go from storing big data to acting on it in real-time. That's where the Open Data Platform initiative comes into play, since it's designed to rationalize a fragmented Hadoop community. The problem with Hadoop, according to Madra, is that many enterprises have to run multiple copies of Hadoop in-house. The initiative hopes to focus on a core of Hadoop offerings to eliminate fragmentation.

(Image: Kaythaney via Flickr)

(Image: Kaythaney via Flickr)

Madra compared Hadoop's situation today with Linux and Unix. Linux's common core gave it an advantage over Unix, which had many different flavors and commercial versions. Linux's common core offered a single open source alternative. The initiative is hoping to avoid the many flavors of Unix problem and stick with a common core version of Hadoop.

As Ben Fathi, Chief Technology Officer of VMware says in the press release announcing the Open Data Platform initiative, "The Open Source movement is fundamentally changing the way that software is being developed in the industry today. Common frameworks and standards such as Open Data Platform will help solidify Open Source as a proven option for enterprises."

The strong community of open source developers in big data, both those in the Pivotal community and the larger Hadoop community, organizing to tackle some of big data's biggest challenges should be welcome news to even the most open source-averse CIO.

David has been writing on business and technology for over 10 years and was most recently Managing Editor at Enterpriseefficiency.com. Before that he was an Assistant Editor at MIT Sloan Management Review, where he covered a wide range of business topics including IT, ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
David Wagner
50%
50%
David Wagner,
User Rank: Strategist
2/19/2015 | 1:11:51 PM
Re: But aren't they self-serving
@techyogjosh- I think you can go through these alliances one at a time and find good and bad ones. Obviously when any of these are formed there are some business reasons. But defragmenting Hadoop is a good thing, even if there are "bad" reasons behind doing it.
David Wagner
50%
50%
David Wagner,
User Rank: Strategist
2/18/2015 | 5:20:08 PM
Re: Promoting Open sources
@Gigi3- You're right on support though I think some of that has to do with some enterprises not being happy with their folks reaching out to the developer community for fear of secrets leaking out. In many ways the open source developer community is better support than many traditional support setups if you're willing to do a little socializing.
David Wagner
50%
50%
David Wagner,
User Rank: Strategist
2/18/2015 | 5:17:05 PM
Re: Key ally included in Open Data Platform
@Charlie- Yes, it pays to have a buddy in this space, I think. And when you add in the initiative for defragmenting Hadoop they have lots of new friends.
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
2/17/2015 | 9:05:44 PM
Key ally included in Open Data Platform
As you say, David, the value of open source code in the form of Linux, Apache, etc. is pretty well established among CIOs, CTOs. I think Pivotal had its hands full trying to compete with the Hadoop market leaders. Instead of proceeding on its own, it's now teamed with one of those leaders, Hortonworks, which includes the Yahoo brain trust that took early Hadoop and produced consistently good revisions. 
InformationWeek Is Getting an Upgrade!

Find out more about our plans to improve the look, functionality, and performance of the InformationWeek site in the coming months.

Slideshows
11 Things IT Professionals Wish They Knew Earlier in Their Careers
Lisa Morgan, Freelance Writer,  4/6/2021
News
Time to Shift Your Job Search Out of Neutral
Jessica Davis, Senior Editor, Enterprise Apps,  3/31/2021
Commentary
Does Identity Hinder Hybrid-Cloud and Multi-Cloud Adoption?
Joao-Pierre S. Ruth, Senior Writer,  4/1/2021
White Papers
Register for InformationWeek Newsletters
The State of Cloud Computing - Fall 2020
The State of Cloud Computing - Fall 2020
Download this report to compare how cloud usage and spending patterns have changed in 2020, and how respondents think they'll evolve over the next two years.
Video
Current Issue
Successful Strategies for Digital Transformation
Download this report to learn about the latest technologies and best practices or ensuring a successful transition from outdated business transformation tactics.
Slideshows
Flash Poll