Databricks Plans Spark Developers Certification Program - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Data Management // Software Platforms
12:55 PM
Connect Directly

Databricks Plans Spark Developers Certification Program

Databricks says demand for its Spark in-memory analytics platform is skyrocketing, so it's launching its first-ever certification program for professionals.

EMP, Debunked: The Jolt That Could Fry The Cloud
EMP, Debunked: The Jolt That Could Fry The Cloud
(Click image for larger view and slideshow.)

Databricks on Thursday announced a developer-certification program for Apache Spark, the hot big-data-analysis platform that handles everything from machine learning, streaming-data analysis, and SQL querying to R-based analytics, graph analysis, and MapReduce processing.

Spark is quickly gaining interest, thanks to the appeal of offering an all-purpose analysis platform boasting in-memory performance advantages. Developed by Databricks, the open-source Spark platform has attracted more than 300 contributors since its launch in 2012.

To date, Databricks has certified software distributors and support providers, a list that includes Cloudera, Hortonworks, IBM, Oracle, and SAP, but with demand growing to get the software deployed, would-be customers were putting on pressure on Databricks to promote development as well as software distribution and support.

[Want more on Apache Spark? Read Databricks Spark Plans: Big Data Q&A. ]

"Lots of organizations are ready to build apps with Spark, and they're asking us for help, but we're not a professional services organization," said Arsalan Tavakoli, Spark's head of business development, in a phone interview with InformationWeek. "The two goals of the certification program are to help Spark developers demonstrate their skill set and to help companies looking to build applications find qualified experts."

The new Spark developer-certification program will be announced at next month's Strata Conference. Event organizer (and tech publisher) O'Reilly has partnered with Databricks to promote the program to its audience and will manage registrations and handle customer service for the program. Databricks will develop the course content, exams, and certification standards.

The Apache Spark platform covers a range of analyses on top of an in-memory platform that is compatible with Hadoop.
The Apache Spark platform covers a range of analyses on top of an in-memory platform that is compatible with Hadoop.

Databricks and O'Reilly have yet to settle on costs, course length, and whether the course will be entirely online or will involve in-person testing. In either case, Databricks experts will proctor the final exam, said Tavakoli.

Now in its 1.1 release, Spark is available through Databricks-certified software distributors including BlueData, Cloudera, DataStax, Guavus, Hortonworks, IBM, Oracle, Pivotal, SAP, and Stratio. Three of these distributors, Cloudera, DataStax, and MapR, have also won Databricks certification to provide Spark software support, though that's the natural next step for all distributors.

Among the growing signs of Spark maturation, Tavakoli said there are now more than 40 users of Spark Streaming in production, and Spark SQL has matched the MLLib machine-learning component of the platform in terms of active development.

Apply now for the 2015 InformationWeek Elite 100, which recognizes the most innovative users of technology to advance a company's business goals. Winners will be recognized at the InformationWeek Conference, April 27-28, 2015, at the Mandalay Bay in Las Vegas. Application period ends Jan. 9, 2015.

Doug Henschen is Executive Editor of InformationWeek, where he covers the intersection of enterprise applications with information management, business intelligence, big data and analytics. He previously served as editor in chief of Intelligent Enterprise, editor in chief of ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
D. Henschen
D. Henschen,
User Rank: Author
9/25/2014 | 6:07:13 PM
Re: Certs: not all that
That's a very broad generalization. Knowing the interest in Apache Spark -- as demonstrated by standing-room-only attendance at the recent Spark Summit -- I can guarantee there will be demand for Spark certification.
User Rank: Ninja
9/25/2014 | 5:56:04 PM
Certs: not all that
Certification will only be valuable IF it's going to translate into anything practical - most I.T. certs are all about a pretty piece of paper to print out and hang on the wall.  It remains to be seen if there is actually a demand for a Spark cert vs. largely imaginary.  
2021 Outlook: Tackling Cloud Transformation Choices
Joao-Pierre S. Ruth, Senior Writer,  1/4/2021
Enterprise IT Leaders Face Two Paths to AI
Jessica Davis, Senior Editor, Enterprise Apps,  12/23/2020
10 IT Trends to Watch for in 2021
Cynthia Harvey, Freelance Journalist, InformationWeek,  12/22/2020
White Papers
Register for InformationWeek Newsletters
Current Issue
2021 Top Enterprise IT Trends
We've identified the key trends that are poised to impact the IT landscape in 2021. Find out why they're important and how they will affect you.
Flash Poll