8 Ways You're Failing At Data Science - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Data Management // Big Data Analytics
10:06 AM
Lisa Morgan
Lisa Morgan
Connect Directly

8 Ways You're Failing At Data Science

Data scientists and the Wizard of Oz have something in common: Few people really know what they do behind the curtain, which makes it hard to tell good from bad data science. These tips can help you discern the difference.
1 of 9

(Image: Geralt via Pixabay)

(Image: Geralt via Pixabay)

Data science would be easier to comprehend if there were a standard definition of it. True data science comprises several disciplines, including mathematics, statistics, machine learning, and computer science. A data science team must also understand how to curate and prepare data, analyze it, and present the results to business leaders in terms of potential business impact.

Many organizations are placing far greater emphasis on data than science, however. As a result, their outcomes may be falling short of expectations, and the reason for it may not be obvious.

Nevertheless, the search for the ultimate silver bullet continues. Companies are investing millions of dollars in platforms, solutions, and open source consulting resources hoping to get actionable insights that lead to competitive advantage. Doing data science right can take considerably more time and investment than may be apparent, however.

"It's really hard to get valuable, actionable insights out of data. You've got to build a team and use the scientific method," said Michael Walker, founder and president of the Data Science Association. "There are right ways and wrong ways to do it, and I think a lot of companies and governments are doing it the wrong way."

[ Having trouble making sense of disparate data? Read Data Visualizations: 11 Ways To Bring Analytics To Life. ]

Because the global demand for data scientists exceeds the number of qualified professionals, less qualified candidates are assuming the title. As a result, the data science practice in an organization may be less rigorous -- and ultimately less valuable -- than it would be if more qualified players were on the team.

"Data science is a formal methodology. You have a process. It's about having a hypothesis and testing it to see if the signals in your data really inform you of the things you think," said Kirk Borne, principal data scientist at Booz Allen Hamilton.

Testing a hypothesis sounds easy enough, but it's actually a lot more difficult and time consuming, and requires considerably more effort, than may be apparent to others in the organization. Here are a few things to consider if you want get more value from your data science efforts.

**New deadline of Dec. 18, 2015** Be a part of the prestigious InformationWeek Elite 100! Time is running out to submit your company's application by Dec. 18, 2015. Go to our 2016 registration page: InformationWeek's Elite 100 list for 2016.

Lisa Morgan is a freelance writer who covers big data and BI for InformationWeek. She has contributed articles, reports, and other types of content to various publications and sites ranging from SD Times to the Economist Intelligent Unit. Frequent areas of coverage include ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
1 of 9
Comment  | 
Print  | 
More Insights
InformationWeek Is Getting an Upgrade!

Find out more about our plans to improve the look, functionality, and performance of the InformationWeek site in the coming months.

IT Leadership: 10 Ways to Unleash Enterprise Innovation
Lisa Morgan, Freelance Writer,  6/8/2021
Preparing for the Upcoming Quantum Computing Revolution
John Edwards, Technology Journalist & Author,  6/3/2021
How SolarWinds Changed Cybersecurity Leadership's Priorities
Jessica Davis, Senior Editor, Enterprise Apps,  5/26/2021
White Papers
Register for InformationWeek Newsletters
Current Issue
Planning Your Digital Transformation Roadmap
Download this report to learn about the latest technologies and best practices or ensuring a successful transition from outdated business transformation tactics.
Flash Poll