3 Ways Shadow Analytics May Be Working Against You - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Data Management
07:00 AM
Lisa Morgan
Lisa Morgan
Connect Directly

3 Ways Shadow Analytics May Be Working Against You

Analytics is popping up in more functional areas of businesses, outside of IT's control. Like BYOB, the trend is inevitable. How will your organization manage it?

Businesses are under pressure to compete more effectively, operate more efficiently, and provide users with better customer experiences. To do that, they need to utilize data in smarter ways than they have in the past, faster.

Business units, however, aren't necessarily relying on IT to deliver the analytics they need because they have seen that IT may not have the budget or the agility required to act quickly enough. As a result, lines of business and departments are making their own investments in analytics. However, the investments aren't always in their best interest over the long-term, nor are those investments necessarily in the best interest of the enterprise.

Credit: Pixabay
Credit: Pixabay

How companies handle shadow analytics and how easy it is to deal with depends on the culture of the company, according to Matthew Taylor, managing director, Accenture Strategy

"If you've got a highly centralized IT environment where IT has had full control for many years and the organization is highly regulated, they're struggling more with shadow IT than more distributed organizations," he said.

New Silos Are Being Created

Companies have been grappling with data trapped in silos for years. Information is stored in all kinds of applications and the goal has been to liberate at least some of that information. Meanwhile, analytics is spreading out across organizations, but in pockets. Different users and different functions require different tools and, as a result, more analytics silos are being created.

"The people who want to use data will use any piece of software to get what they need," said Francois Ajenstat, chief product officer at business intelligence (BI) and analytics solution provider Tableau. "It starts with a frustrated individual who knows that analytics can help her do a better job."

Solution Choices May Be Sub-optimal

Individual users and groups tend to have a fairly solid idea of what they want to accomplish, but they don't always approach solution acquisition from that standpoint. For one thing, the number of possible solutions is disorienting, ranging from products that are difficult to implement to cloud-based services that provide easy on-boarding, ease of use, and comparatively fast results.

Sometimes an immediate need results in a solution choice that over promises and under delivers, or proves not to be the best choice over the long term. Including IT in the discussion may help set real expectations of what an off-the-shelf solution can and cannot deliver.

[When shadow initiatives rely on the cloud, security concerns can arise. Read SaaS Security: Gartner's 5 Tips for IT Pros.]

"What's driving shadow analytics is the desire for data in real time and near real time -- marketing, lines of business, product owners, and manufacturing environments. It can show up almost anywhere if IT has not provided those capabilities, an X-as-a-service, on-demand, self-service experience," said Bob Familiar, national practice director for Application Services at  BlueMetal, Insight’s interactive design and technology architecture firm.

According to 2016 Accenture research of C-level executives, more than 70% of respondents didn't involve IT in an "XaaS" decision. Seventy-seven percent believe IT lacks the skills necessary for the as-a-service world.

"Those numbers are high and that's a little scary. It is an area of great concern," said Accenture's Taylor.

It May Be Dangerous

Shadow IT solution choices may impact other parts of the organization, not the least of which is IT. Their implementation may also offend data governance and security policies if sensitive data can be accessed and used in unsanctioned ways.

"The analytics required really depends on the department or unit but you need an infrastructure layer on which models can run," said Ramkumar Murali, Practice Head – Digital Operations at Brillio, a global technology consulting and business solutions company. "The best thing to do is decentralize analytics and centralize the plumbing layer. That way, it's commoditized, you can apply governance, and address security standards."

Bottom Line

The shadow analytics trend is going to continue on the path BYOD did before it. Rather than resisting the trend, it is better for IT to provide a platform-like approach that supports business requirements while minimizing risks to the business. In turn, the business should not discount IT, because their support is likely to be necessary for long-term success.


Lisa Morgan is a freelance writer who covers big data and BI for InformationWeek. She has contributed articles, reports, and other types of content to various publications and sites ranging from SD Times to the Economist Intelligent Unit. Frequent areas of coverage include ... View Full Bio
We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Moderator
1/19/2017 | 12:35:28 PM
IT needs to focus more on "Data as a Service"
Business Units know their data and how external information can affect it and vice versa. IT may not have the business knowledge to do this. What they do have however, is very good controls on accessing and protecting data.

I'd love to see more IT involvement in providing "data as a service" such that I can tap into data sources, perform my analysis, and return a certified result set back into the data silos so some other department can consume it.

There are tools such as Jupyter, RStudio, Power BI, Excel etc., that run on desktops and can consume data such that I can analyze it the way I need to. If IT can support the data pipes to me, it would enable me to provide more value to the business.

Oh... and please dont make me wait weeks for data that I know is accessible in a much shorter timeframe by reaching out to the actual owner of the data.

Think Like a Chief Innovation Officer and Get Work Done
Joao-Pierre S. Ruth, Senior Writer,  10/13/2020
10 Trends Accelerating Edge Computing
Cynthia Harvey, Freelance Journalist, InformationWeek,  10/8/2020
Northwestern Mutual CIO: Riding Out the Pandemic
Jessica Davis, Senior Editor, Enterprise Apps,  10/7/2020
White Papers
Register for InformationWeek Newsletters
2020 State of DevOps Report
2020 State of DevOps Report
Download this report today to learn more about the key tools and technologies being utilized, and how organizations deal with the cultural and process changes that DevOps brings. The report also examines the barriers organizations face, as well as the rewards from DevOps including faster application delivery, higher quality products, and quicker recovery from errors in production.
Current Issue
[Special Report] Edge Computing: An IT Platform for the New Enterprise
Edge computing is poised to make a major splash within the next generation of corporate IT architectures. Here's what you need to know!
Flash Poll