Databricks Plans Spark Developers Certification Program - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Data Management // Software Platforms
News
9/18/2014
12:55 PM
Connect Directly
LinkedIn
Twitter
RSS
E-Mail
50%
50%

Databricks Plans Spark Developers Certification Program

Databricks says demand for its Spark in-memory analytics platform is skyrocketing, so it's launching its first-ever certification program for professionals.

EMP, Debunked: The Jolt That Could Fry The Cloud
EMP, Debunked: The Jolt That Could Fry The Cloud
(Click image for larger view and slideshow.)

Databricks on Thursday announced a developer-certification program for Apache Spark, the hot big-data-analysis platform that handles everything from machine learning, streaming-data analysis, and SQL querying to R-based analytics, graph analysis, and MapReduce processing.

Spark is quickly gaining interest, thanks to the appeal of offering an all-purpose analysis platform boasting in-memory performance advantages. Developed by Databricks, the open-source Spark platform has attracted more than 300 contributors since its launch in 2012.

To date, Databricks has certified software distributors and support providers, a list that includes Cloudera, Hortonworks, IBM, Oracle, and SAP, but with demand growing to get the software deployed, would-be customers were putting on pressure on Databricks to promote development as well as software distribution and support.

[Want more on Apache Spark? Read Databricks Spark Plans: Big Data Q&A. ]

"Lots of organizations are ready to build apps with Spark, and they're asking us for help, but we're not a professional services organization," said Arsalan Tavakoli, Spark's head of business development, in a phone interview with InformationWeek. "The two goals of the certification program are to help Spark developers demonstrate their skill set and to help companies looking to build applications find qualified experts."

The new Spark developer-certification program will be announced at next month's Strata Conference. Event organizer (and tech publisher) O'Reilly has partnered with Databricks to promote the program to its audience and will manage registrations and handle customer service for the program. Databricks will develop the course content, exams, and certification standards.

The Apache Spark platform covers a range of analyses on top of an in-memory platform that is compatible with Hadoop.
The Apache Spark platform covers a range of analyses on top of an in-memory platform that is compatible with Hadoop.

Databricks and O'Reilly have yet to settle on costs, course length, and whether the course will be entirely online or will involve in-person testing. In either case, Databricks experts will proctor the final exam, said Tavakoli.

Now in its 1.1 release, Spark is available through Databricks-certified software distributors including BlueData, Cloudera, DataStax, Guavus, Hortonworks, IBM, Oracle, Pivotal, SAP, and Stratio. Three of these distributors, Cloudera, DataStax, and MapR, have also won Databricks certification to provide Spark software support, though that's the natural next step for all distributors.

Among the growing signs of Spark maturation, Tavakoli said there are now more than 40 users of Spark Streaming in production, and Spark SQL has matched the MLLib machine-learning component of the platform in terms of active development.

Apply now for the 2015 InformationWeek Elite 100, which recognizes the most innovative users of technology to advance a company's business goals. Winners will be recognized at the InformationWeek Conference, April 27-28, 2015, at the Mandalay Bay in Las Vegas. Application period ends Jan. 9, 2015.

Doug Henschen is Executive Editor of InformationWeek, where he covers the intersection of enterprise applications with information management, business intelligence, big data and analytics. He previously served as editor in chief of Intelligent Enterprise, editor in chief of ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Comments
Threaded  |  Newest First  |  Oldest First
asksqn
50%
50%
asksqn,
User Rank: Ninja
9/25/2014 | 5:56:04 PM
Certs: not all that
Certification will only be valuable IF it's going to translate into anything practical - most I.T. certs are all about a pretty piece of paper to print out and hang on the wall.  It remains to be seen if there is actually a demand for a Spark cert vs. largely imaginary.  
D. Henschen
50%
50%
D. Henschen,
User Rank: Author
9/25/2014 | 6:07:13 PM
Re: Certs: not all that
That's a very broad generalization. Knowing the interest in Apache Spark -- as demonstrated by standing-room-only attendance at the recent Spark Summit -- I can guarantee there will be demand for Spark certification.
News
Top 10 Data and Analytics Trends for 2021
Jessica Davis, Senior Editor, Enterprise Apps,  11/13/2020
Commentary
Where Cloud Spending Might Grow in 2021 and Post-Pandemic
Joao-Pierre S. Ruth, Senior Writer,  11/19/2020
Slideshows
The Ever-Expanding List of C-Level Technology Positions
Cynthia Harvey, Freelance Journalist, InformationWeek,  11/10/2020
White Papers
Register for InformationWeek Newsletters
Video
Current Issue
Why Chatbots Are So Popular Right Now
In this IT Trend Report, you will learn more about why chatbots are gaining traction within businesses, particularly while a pandemic is impacting the world.
Slideshows
Flash Poll