Enterprise 2.0: Uncomfortable Truths About Big Data - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Government // Enterprise Architecture
01:27 PM
Connect Directly

Enterprise 2.0: Uncomfortable Truths About Big Data

Think big data analysis is making your professional expertise less valuable? In some ways, you're right, MIT's Andrew McAfee said Wednesday at the Enterprise 2.0 conference.

"The world is one big data problem."

Andrew McAfee, principal research scientist at MIT and author of Race Against the Machine, said that's a sentiment he keeps hearing in recent meetings in Silicon Valley.

"There's a bit of arrogance in that, and a bit of truth as well," he told the Enterprise 2.0 Boston 2012 conference audience in a Wednesday morning keynote presentation.

Can you address any problem effectively once you have masses of data? Enterprise 2.0 and social technologies are feeding big data analysis, providing new and more personal data points. Embedded sensors in everything from athletic clothing to cars feed big data pools and research that was not possible before, as consultant and InformationWeek guest columnist Vinnie Mirchandani recently detailed. Big data analysis based on Hadoop platform tools is challenging traditional business intelligence wisdom, particularly in retail industries.

While enterprise use of big data analysis can solve tough business problems, some individuals may find big data analysis deeply unsettling to their own career prospects.

Here's the bad news, according to McAfee: Computers are getting smarter all the time. IBM's Watson computer proved it could beat the most talented humans at Jeopardy trivia questions, but that's really just the beginning, McAfee pointed out. He cited Narrative Science, a company that generates news prose from a computer algorithm, in effect replacing reporters, to write basic news stories. Computers have also shown in research studies that they can beat pathologists at reading slides to detect signs of cancer, McAfee said.

[ See our special report: Enterprise 2.0 Boston 2012.]

We were never all that good.

"We kind of come out on the losing end over and over again," McAfee said. Using big data techniques, algorithms can predict questions including how good this year's crop of Bordeaux wine will turn out and how the Supreme Court will decide pending cases, he noted. Big data analysis can outdo purchasing experts, who have spent years learning nuances of vendor strategies and contracts, he said.

In a group of 136 man-versus-machine studies that he examined, humans won in just eight cases. The kisser: This was before the era of big data, he said. The computers likely did not have enough data.

"I kind of see our robot overlords and computer overlords getting smarter and smarter," McAfee said. "Are we all thoroughly depressed about this?" he asked the audience, prompting wry laughs.

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
1 of 2
Comment  | 
Print  | 
More Insights
Oldest First  |  Newest First  |  Threaded View
User Rank: Apprentice
6/26/2012 | 1:59:48 AM
re: Enterprise 2.0: Uncomfortable Truths About Big Data
This seems like the traditional man vs. machine situation. You can't fight the drive towards efficiency. All you can do is try to add to it in some way. It can be difficult, because change often is. The good news though is that people have been doing that throughout history.
Brian Prince, InformationWeek/Dark Reading Comment Moderator
2021 Outlook: Tackling Cloud Transformation Choices
Joao-Pierre S. Ruth, Senior Writer,  1/4/2021
Enterprise IT Leaders Face Two Paths to AI
Jessica Davis, Senior Editor, Enterprise Apps,  12/23/2020
10 IT Trends to Watch for in 2021
Cynthia Harvey, Freelance Journalist, InformationWeek,  12/22/2020
White Papers
Register for InformationWeek Newsletters
Current Issue
2021 Top Enterprise IT Trends
We've identified the key trends that are poised to impact the IT landscape in 2021. Find out why they're important and how they will affect you.
Flash Poll