October 23 - Day 3: Adapt Your Infrastructure to Learn From Your Data - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Comments
October 23 - Day 3: Adapt Your Infrastructure to Learn From Your Data
You must login to participate in this chat. Please login.

This really was a great session, Jim -- thanks so much. I hope everyone will join us again on Monday and invite their colleagues to take advantage of the class, as well.

For those we don't see tomorrow for This InformationWeek, have a great weekend!

Strategist

Thanks for the great information. I learnt a lot!

Ninja

Thanks Lorna, everyone

Author

Brian   ...I'll duck that one. I know a little about Haddop, but I haven't handled the others

Author

Is only programming in Hadoop complex or working in omniture/AWstats also complex?

Ninja

Internationalizing site response is a huge challeng, adding cultural knowledge to the list of skills

Author

Deciding on optimum respose sequences is not easy, nor intuitive. That's where the Big Data Analysts come into play, with psych and retailing to add to their software skills. Looking at how sites handle these things is fascinating. There are enormous variations in response, with some playing well and some needing a lot of work!

Author

Good point, positive reinforcement.

Ninja

When you get a hit like a download, i suspect the analytics would schedule up follow-up advertizing to re-stimulate the initial hit

Author

Creating automated analytics that just requires you to attach your data streams makes sense. Verticals like retail will benefit enormously. We aren't there yet, but this will happen, and reduce the burden for the mid-tier. I can see some of the major systems vendors, such as IBM adding that to their services portfolio

Author

How can analysis deal with products that are information related? For example, if a user visits a website and downloads a whitepaper for information, shouldn't further ads be cancelled to the user, to increase ROI?

Ninja

I can well imagine IT teams being leery of automating actions that hit customers, like ad serving.

Author

You also spoke a lot about automation and a skills shortage. Automation tends to be complex, right?

Author

I'm seeing ad-postings on my email client within a minute of hitting a site.... from Yahoo who provides my email service

Author

I haven't seen anything close to an in-memory capble instance on AWS. Most have too little memory and CPU horsepower. That will get remedied, perhaps with specialist CSPs.

Author

@SaneIT - I agree that many of the concepts will be useful no matter the size of the data set -- or the company. In fact, smaller companies may be less weighed down by huge legacy data sets

Author

Lorna, I think your right about where DBs are hosted, but Oracle and others aim to offer solutions that apply to unstructured data that in itself isn't mission critical, so putting it in public clouds could work.

Author

BrianDean, I think the merchant silicon for SDN is closer to GPUs. How control is done, and whether it's granularity improves to near-real time is a function of data processing speed, and GPUs nay have a valid place as speed up tools for SDN

Author

I was hoping you'd say it would be from the analytics side.  I think a lot of the concepts will be useful no matter the size of the data set, I just hope people don't get turned off ot those concepts based on a name.

Ninja

1gig FTTP for $35 a month, that's a good deal.

Ninja

And, I suspect many companies will be wary of hosting databases remotely. DBs seem like the last bastion of in-house IT.

Author

SaneIt Fragmentation most likely is coming from the analytics side. This is especially true if data is in object storage or key/data storage.

Author

Lorna, WAN speed is a problem. Our Telcos tell us that everything is plenty fast enough, but 1GbE fibre beats the heck out of DSL. I've seen a rapid increase in speed levels recently, but not to the fibre level. Overseas, the story is different. Igig fibre in Seoul costs $35/month and is generally available.

Author

Do you think the fragmentation will come from the analytics side or the storage/IT side?

Ninja

SaneIT I suspect the concept will fragment into data classes as the Big Data concept evolves

Author

Wondering how that as-a-service model meshes with the need for speed you mentioned. If a 30 minute window is too long to get insights in action, can providers manage that given WAN limitations?

Author

Choices for services range from niche specialists to generalist research companies. Most are small today.

Oracle and NoSQL are getting most press on the subject of convergence

Author

Hey, Jim, I know the definintion of Big Data is hard to define but I see a lot of people doing "big enough" data.  Should we really be looking for a more narrow definition?

Ninja

Lorna, I think Analytics as a Service should be the preferred approach unless there is a business case for internal investment and team-building. Most mid-tier companies will need some analytics capability, even if only to get current market trends with a relevance and granularity that meets modern needs.

Author

I'm also interested in what database choices you see in smaller companies.

Author

Great time management!

Author

Jim, do you see big data analysis as a service as a good choice for midmarket companies given the many challenges you've laid out?

Author

Talent is so often the holdup

Author

The semiconductor architecture that enables SDN is closer to the general CPU architecture or closer to the general GPU architecture?

Ninja

@Curt, That sounds like a market opportunity

Author

Big data and network analysis, SDN is the easiest to analyze or can traditional networks be analyzed as well?

Ninja

@Lorna, now if you offer all this through cloud services does it level the playing field at all?

Strategist

"Expensive and rare" is bad news for midmarket companies.

Author

@Lorna, you're right: I've heard a little bit about people using big data techniques in security but most of those uses are in threat analysis rather than network/system monitoring.

Strategist

I am not sure people think of big data as usable for monitoring of network performance and security.

Author

Hi all -Audio is live! If you don't see the audio bar at the top of the screen, please refresh your browser. It may take a couple tries. When you see the audio bar, if it doesn't start automatically, hit the play button. If you experience audio interruptions and are using IE, try using FF or Chrome as your browser. Many people experience issues with IE. Also, make sure your flash player is updated with the current version. Some companies block live audio streams, so if that is the case for your company, the class will be archived on this page immediately following the class and you can listen then. People don't experience any issues with the audio for the archived version.

Apprentice

I heard that as General 0'Reilly, I might follow him into battle.

Ninja

Good Afternoon Everyone!

Ninja

@SaneIT, we're glad to see you -- and glad to be a bit of sanity in your day!

Strategist

This is not just a lecture: We have a lively classroom discussion that takes place alongside the lecture. To join in, just type your comment or quesiton into the "Your Post" box, then click on the red "Post" button. We look forward to having Jim join us after the lecture, and to having your voice in our discussion!

Strategist

Hi Curt and crew.  I feel like this is my daily dose of sanity lately.

Ninja

Hello, everyone -- we're glad you could join us! At 2:00 p.m. EDT, a player should appear just below Jim O'Reilly's biography. If it doesn't, then you might need to refresh your browser window. In some cases, users have had to refresh their browser windows several times, but I promise that Jim's lecture is worth the effort!

Strategist


The State of Cloud Computing - Fall 2020
The State of Cloud Computing - Fall 2020
Download this report to compare how cloud usage and spending patterns have changed in 2020, and how respondents think they'll evolve over the next two years.
News
Top 10 Data and Analytics Trends for 2021
Jessica Davis, Senior Editor, Enterprise Apps,  11/13/2020
Commentary
Where Cloud Spending Might Grow in 2021 and Post-Pandemic
Joao-Pierre S. Ruth, Senior Writer,  11/19/2020
Slideshows
The Ever-Expanding List of C-Level Technology Positions
Cynthia Harvey, Freelance Journalist, InformationWeek,  11/10/2020
Register for InformationWeek Newsletters
Video
Current Issue
Why Chatbots Are So Popular Right Now
In this IT Trend Report, you will learn more about why chatbots are gaining traction within businesses, particularly while a pandemic is impacting the world.
White Papers
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Sponsored Video
Flash Poll