4 Big Data Essentials For Startups - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Data Management // Big Data Analytics

4 Big Data Essentials For Startups

Data-driven insights aren't just for behemoth enterprises. Here's what startups need to know before embarking on a big-data strategy.

Tech Hygiene: 10 Bad Habits To Break
Tech Hygiene: 10 Bad Habits To Break
(Click image for larger view and slideshow.)

Big-data products are generally targeted at large enterprises, and for good reason. They can be enormously expensive to initiate and operate, and therefore out of reach for the average startup or small business.

That's changing, but fledgling firms need to answer some hard questions before embarking on a data-driven strategy. These include: Do I need a big data system? And what insights do I hope to gain from it?

At last week's Techweek conference in Santa Monica, Calif., a two-day event connecting tech entrepreneurs with investors, Sean Anderson, manager of data services at cloud computing company Rackspace, offered some solid advice in his talk, "How Startups Can Leverage Big Data." Anderson's talk covered a wide range of data-related topics, but we've distilled a few takeaway points for companies debating the merits of a big-data initiative.

1. Explore the three Vs, and don't forget C.
Big data is often defined by the three Vs: volume, velocity, and variety. Anderson recommends adding a fourth letter to the formula: C, for complexity.

Volume, of course, refers to the sheer capacity of data. If the volume of information you're putting into your database or data store is breaking the system, it's a good time to explore a big-data technology. The same wisdom applies to the velocity of incoming data, a growing concern in the era of near-real-time analytics. As for variety, your database should allow you to query multiple data types, including unstructured data such as audio, video, and email text.

[It's time to make your gift-giving list. See 10 Smart Tech Toys For Kids.]

"There are plenty of legacy technologies that can scan and analyze text very, very easily," said Anderson. "But as time goes on... the types of file formats and the things we're trying to analyze and process get increasingly more complex."

That's where complexity comes into play.

"The things we're trying to stick into a database are changing," Anderson said. In this age of social engagement and content sharing, "we want to start understanding and getting insights from stuff that's not just text."

(Source: Camelia.boban)
(Source: Camelia.boban)

2. Volume is overrated.
Startups mustn't assume that big-data technologies are the exclusive domain of enterprises wrestling with petabytes or exabytes of data.

"The reality is, when [we] talk to enterprise customers -- Fortune 100 customers that are starting their big-data initiatives -- they don't have petabytes of information. Some of them don't have terabytes of information. Some are just trying to get good, reliable insights from gigabytes of information."

Takeaway: Don't use volume as the only factor when deciding if big data technology is right for your company.

3. Big data is hard.
The big data landscape is "changing at a feverish pace," said Anderson. He cited a recent Gartner survey that showed, while 73% of enterprise respondents have invested or plan to invest in big data in the next two years, these investments haven't led to an associated boost in organizations reporting deployed big-data projects. In fact, just 13% of respondents reported having "big data projects deployed to production." That's a notable increase from 8% a year earlier, but it also suggests that much of today's big-data work involves pilot programs, strategy development, and experimental projects, according to Gartner.

Takeaway: It's difficult for the smartest organizations, including startups, to keep up with the latest big-data innovations.

4. If it ain't broke...
Maybe you don't need a big-data initiative at all. If your current database system handles all of your data needs today and in the foreseeable future, why fix what doesn't need fixing?

"We... would be remiss to go to any of you with systems that are functioning properly and tell you to deploy a big-data solution," said Anderson. "It's disruptive to your business, and it may not be the thing that you need."

He added: "There are some great stories out there of companies that spent months evaluating big-data technologies, only to find out that their current technology... does everything they need."

Just 30% of respondents to our new Big Data and Analytics Survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives? Get the The Trouble With Big Data issue of InformationWeek Tech Digest today. (Free registration required.)

Jeff Bertolucci is a technology journalist in Los Angeles who writes mostly for Kiplinger's Personal Finance, The Saturday Evening Post, and InformationWeek. View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Strategist
11/26/2014 | 9:27:01 AM
Volume, Velocity, Variety & Complexity
Great to see others finally appreciating Gartner's definition of Big Data, albeit 15 years after we first defined it. My original "3Vs" piece from 2000 can now be found by searching for my blog post: "Deja VVVu: Others Claiming Gartner's Construct for Big Data". The professional courtesy of a citation is always appreciated. --Doug Laney, VP Research, Gartner, @doug_laney 
User Rank: Ninja
11/25/2014 | 12:45:30 PM
Start small
I have talked to so many organizations -- almost equal in how many failed and how many succeeded. The one common component? Those who succeeded started small. They built out a strategy, found a known problem and then found a solution. They were not expecting to completely change the world, simply address one problem. What this did is allow for them to build out an analytical culture and the acceptance level constantly improved as lines of business realized the potential. With each utilization, they often look for a slightly larger problem to tackle.

Peter Fretty, IDG blogger working on behalf of SAS  
CIOs Face Decisions on Remote Work for Post-Pandemic Future
Joao-Pierre S. Ruth, Senior Writer,  2/19/2021
11 Ways DevOps Is Evolving
Lisa Morgan, Freelance Writer,  2/18/2021
CRM Trends 2021: How the Pandemic Altered Customer Behavior Forever
Jessica Davis, Senior Editor, Enterprise Apps,  2/18/2021
White Papers
Register for InformationWeek Newsletters
Current Issue
2021 Top Enterprise IT Trends
We've identified the key trends that are poised to impact the IT landscape in 2021. Find out why they're important and how they will affect you.
Flash Poll