Why Big Data Doesn't Always Equal Big Insight - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Healthcare // Analytics
05:00 PM
Shvetank Shah
Shvetank Shah

Why Big Data Doesn't Always Equal Big Insight

Data is too often inaccessible and not trusted, and companies aren’t doing enough to nurture 'informed skeptics'.

Even as companies invest eight- and nine-figure sums to analyze the information streaming in from suppliers and customers, fewer than 40% of employees have the right processes and skills to make good use of the analysis. Think of this as a company's insight deficit. To overcome it, "big data" needs to be complemented by "big judgment."

To assess companies' ability to find and analyze relevant information to make decisions, the Corporate Executive Board created the Insight IQ index. Using this model, CEB surveyed 5,000 employees at 22 global companies and discovered that the overwhelming majority (62%) are making poor decisions when attempting to tease out insights from data. To change this, executives need to develop more "informed skeptics," challenge employees' biases, take ownership of their information, and make information more accessible.

We put employees into three categories based on their reliance on analysis and intuition. "Unquestioning empiricists" (43%) trust analysis over judgment, and "visceral decision-makers" (19%) exclusively go with their gut. Only 38% of employees (and 50% of senior managers) are "informed skeptics," who balance judgment and analysis, possess strong analytic skills, and listen to others' analysis to make sound decisions based on data.

To create more informed skeptics, companies need to make sure analytic capabilities aren't concentrated with too few employees. Second, companies must link key metrics to performance objectives and compensation, to build an insight-driven culture. Third, they need effective training that addresses information sources and analytical techniques, and provides reinforcement. Finally, they must train employees on the limitations of data, so they gain critical-thinking skills to uncover deeper insight, find new avenues for analysis, and spot faulty logic or biases.

But a company can't build an insight-driven culture if people can't access data. Seventy percent of business unit leaders in our survey find IT's information management capabilities inadequate. One reason is that, with the rise of social media and other new channels, it's harder to govern and manage the creation, storage, and dissemination of content. Eighty-five percent of companies' information is unstructured, and much of it is out of reach, such as employees' personal drives or in personal cloud storage.

Also, half of survey respondents indicate that information from corporate sources is in unusable formats; two-thirds spend time on unproductive analysis. IT must better understand how, when, and why information is used, then provide a greater selection of analytic tools aligned to specific business units or functions.

Data reliability also is often questioned: Two-thirds of employees don't trust information from other functions in the company. To overcome this distrust, leaders need to make transparent the information's original source, as well how it has been manipulated over time. Simple tactics such as color-coding data to indicate information quality or labeling missing fields increase trust and often spur action to close data gaps.

How valuable can an analytical culture be? We compared corporate functions across the 22 companies in our data set and found that those with the highest Insight IQ performed better, based on efficiency and effectiveness (such as employee engagement for HR or market share growth for business units). The difference on the index between the highest and lowest quartiles: 24%.

Shvetank Shah is executive director of the Corporate Executive Board. More from CEB on this topic is available at insightdeficit.com. Write to us at [email protected]

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Oldest First  |  Newest First  |  Threaded View
Mark Simchock
Mark Simchock,
User Rank: Apprentice
11/29/2011 | 3:33:27 PM
re: Why Big Data Doesn't Always Equal Big Insight
All spot on, mostly.

In theory I agree with the majority of your statements. However, the reality is a high percentage of the workforce is not analytical. More importantly, nor do they want to be.

I say this because years ago I had a position where I was responsible for ah-hoc reports for the consumer marketing department of a major telecommunications company. Let's just say that quite oftenGÇöafter me asking, "What decisions are you hoping to make?"GÇöthe original request was modified because the report requested wasn't the right match for the business needs they were looking to satisfy. I am certain my predecessor, as well as my replacements, were not as "dedicated". And I'm sure there wasn't a complete makeover of the marketing department either.

Maybe it's time to consider that the responsibility of analytics doesn't fit into the traditional org chart as cleanly as many other roles? Maybe instead of asking and expecting ten different people to increase their analytics IQ ten to fifteen points, it would make more sense to bring in someone devoted and capable of the expertise needed at 130+ IQ points? If there's HR, Accounting, Purchasing, etc. why can't there be Analytics? That seem much more realistic to me. In other words, I'm not even sure Analytcis is a good fit for IT (in its current form).

Other than that, yes more data and more information does not necessarily translate to better decision.

Also, perhaps you could share more about the Insight IQ in the future?
Can Cloud Revolutionize Business and Software Architecture?
Joao-Pierre S. Ruth, Senior Writer,  1/15/2021
10 IT Trends to Watch for in 2021
Cynthia Harvey, Freelance Journalist, InformationWeek,  12/22/2020
How CDOs Can Build Insight-Driven Organizations
Jessica Davis, Senior Editor, Enterprise Apps,  1/15/2021
White Papers
Register for InformationWeek Newsletters
Current Issue
2021 Top Enterprise IT Trends
We've identified the key trends that are poised to impact the IT landscape in 2021. Find out why they're important and how they will affect you.
Flash Poll