Big Data Tool Analyzes Intentions: Cool Or Creepy? - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Data Management // Big Data Analytics
09:06 AM
Connect Directly

Big Data Tool Analyzes Intentions: Cool Or Creepy?

Lexalytics intention analysis tool determines what you're going to do before you do it, the company says. This goes beyond sentiment analysis.

 Holiday Gift Guide 2015: What Techies Want
Holiday Gift Guide 2015: What Techies Want
(Click image for larger view and slideshow.)

Many organizations mine Twitter and other social media streams to gauge the online masses' impressions of their products or services. But although this sentiment analysis is an effective way to mine for opinions, it's less useful at determining people's future actions.

Lexalytics, an Amherst, Mass., provider of text and sentiment analysis software, will soon release a new feature called intention analysis, which the company claims can predict a person's objectives based on his or her online activities.

"If you can take a content stream -- customer feedback data, for example, or chat logs from a website -- you can mine that [data] for intention, not just sentiment," said Lexalytics founder and CEO Jeff Catlin in a phone interview with InformationWeek.

Lexalytics' claim to fame is sentiment analysis, which the company has been doing for a decade. An impressive roster of tech players license the company's technology, including Oracle and Microsoft, the latter of which uses Lexalytics' software to monitor social media feeds. 

[Want a year-end review of big data's accomplishments? Read Top 5 Big Data Trends Of 2014.]

At first glance, intention analysis might seem a lot like sentiment analysis. But Catlin explained the distinction between the two:

"Take a simple statement like, 'I'm gonna buy a new iPhone from Verizon,'" he said. "If you look at that from a sentiment point of view, there isn't any. There's no actual tone in that. You could argue that buying a new phone is good news, but you're putting an interpretation on it."

The person, however, is stating an intention to buy something: in this case, an iPhone.

(Image: Latin Times)
(Image: Latin Times)

Catlin explained via email how intention analysis software would deconstruct the following tweet: "I've been saving like crazy for Black Friday. iPhone 6 here I come!"

"There are no words like 'buy' or 'purchase' in this tweet, even though their intention is to purchase an iPhone," wrote Catlin. Here's how an intention analysis tool would tag the tweet:

- intention = "buy"

- intended object = "iPhone"

- intendee = "I"

Grammar-parsing technology is the engine that makes intention analysis work.

"Intention is kind of the sexy feature, but the grammar parser is the key that makes it go, the ability to understand what people are talking about, regardless of content type," said Catlin. "We've built a grammar-parser for Twitter, which deals with the fact that there's bad punctuation, weird capitalization, and things like that."

Companies can run this type of analysis on millions of tweets in seconds, which could help them determine customers' buying patterns, Catlin added.

Law enforcement is another potential market.

"If you're the government and worried about terrorism, you can mine Twitter streams and look for harm," said Catlin. "Is there an intention to do harm here? That's a really interesting [example]. I consider it scary, but also very interesting."

Lexalytics plans to add intention analysis to Semantria, its Saas offering, as a premium service. Catlin acknowledged that Internet giants such as Google and Facebook could pose problem competition if they build intention analysis tools in-house.

"We haven't seen Google build it yet. Could they? Sure. But even for them, it would take a certain amount of time to build some of this," he said.  

"Time-to-market matters," added Catlin. "Some cellphone vendors have talked to us and have looked at the features. They could build it themselves if they were interested, but [they] generally pick time-to-market over building it" in-house.

When asked whether intention analysis might provide companies with more opportunities to hurl unwanted sales pitches at social media users, Catlin noted that it's up to Lexalytics' clients to use the technology in a responsible fashion. 

"We're the low-level provider, and it's up to our customers to make those decisions," he said, adding that companies shouldn't "spam people based on their intention."

Just 30% of respondents to our new Big Data and Analytics Survey say their companies are very or extremely effective at identifying critical data and analyzing it to make decisions, down from 42% in 2013. What gives? Get the The Trouble With Big Data issue of InformationWeek Tech Digest today. (Free registration required.)

Jeff Bertolucci is a technology journalist in Los Angeles who writes mostly for Kiplinger's Personal Finance, The Saturday Evening Post, and InformationWeek. View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Ninja
1/6/2015 | 2:12:03 PM
A little of both
How we feel about this really depends heavily on our relationship with the organization ultimately using the resulting analysis. Obviously, as data analysis gets smarter and more personal it presents us with numerous advantages -- many of which are time savers and help improve our productivity.  However, when we do not have a good relationship with a group tracking and leveraging personal data, it can be alarming.  Bottom line: We need to be more data aware as a society. 

Peter Fretty, IDG blogger working on behalf of SAS
User Rank: Ninja
12/28/2014 | 7:29:03 PM
A lot of false positives in Lexalytics future
>>"If you can take a content stream -- customer feedback data, for example, or chat logs from a website -- you can mine that [data] for intention, not just sentiment, [...]" <<


Also known as surveillance without a warrant.  Further, just because I may provide consumer feedback does not necessarily mean I either hate or love the product.  It is feedback.  Period.  
Thomas Claburn
Thomas Claburn,
User Rank: Author
12/15/2014 | 4:57:38 PM
Re: Creepy
If the predictions prove accurate, the first thing people will do is modify their behavior to mess with the predictions.
User Rank: Ninja
12/15/2014 | 3:08:13 PM
can't judge future actions
But although this sentimental analysis is an effective way to mine for opinions, it's less useful at determining people's future actions.

Yes, my finances friend always tells me, "Prior acts are no indication of future acts."
User Rank: Ninja
12/15/2014 | 3:05:46 PM
Re: Creepy
Some people think that marketing--or any entity--that uses a tracking tool is considered Big Brother-y. I just assume I'm being tracked. I see the benefits of my data being analyzed so I've kind of given up the fight.....
User Rank: Author
12/15/2014 | 12:53:42 PM
Marketers using this tool is  one thing, but law enforcement using it definitely screams Big Brother. Of course, anything you post publicly on Twitter is already fair game for whatever AI the government has to point at the opportunity. What do you think, readers?
The Best Way to Get Started with Data Analytics
John Edwards, Technology Journalist & Author,  7/8/2020
10 Cyberattacks on the Rise During the Pandemic
Cynthia Harvey, Freelance Journalist, InformationWeek,  6/24/2020
IT Trade Shows Go Virtual: Your 2020 List of Events
Jessica Davis, Senior Editor, Enterprise Apps,  5/29/2020
White Papers
Register for InformationWeek Newsletters
Current Issue
Key to Cloud Success: The Right Management
This IT Trend highlights some of the steps IT teams can take to keep their cloud environments running in a safe, efficient manner.
Flash Poll