Sponsored by:
 
Latest Comments
Blogs
Saul Sherry
6
Saul Sherry, Editor, 5/15/2013   Comment now
How Ocado uses big data to make sure vegetarians get a lean product offering.
James M. Connolly
30
James M. Connolly, US Correspondent, 5/9/2013   Comment now
Too often people who make a living with technology, whether they build it, manage it, or write about it, lose sight of what should be obvious about the constituency they serve. The people who use tech have limited knowledge or interest in that tech.
Most recent post, James M. Connolly, 5/15/2013 10:36:51 AM
@Saul. Interesting point. Data (in the form of things like mailing lists) has been...
Christian Prokopp
5
Christian Prokopp, Data Scientist, Rangespan, 5/9/2013   Comment now
RCFile (Record Columnar File), the state-of-the-art big data storage format in Hive, is about to be challenged by ORC (Optimized Row Columnar).
Lindsay Clark
16
Lindsay Clark, Freelance Writer, 5/8/2013   Comment now
Big data is promising a management transformation, with those performing best breaking away from the rest. But you need to get some perspective before jumping in with both feet.
Most recent post, Daniel Gutierrez, 5/15/2013 2:05:28 PM
@Saul, you're absolutely right, there is generational shift for younger CEOs to...
Mike Lata
12
Mike Lata, Freelance Writer, 5/7/2013   Comment now
It's time to take a look through the big data hype to see which industries are making the most from their big data initiatives.
Christian Prokopp
3
Christian Prokopp, Data Scientist, Rangespan, 5/6/2013   Comment now
Are sequence files or RCFile (Record Columnar File) the best way to store big data in Hive?
most commented last month
27
Using Big Data to Optimize Pricing
Doug Fuehne, VP Strategic Consulting, PROS, 4/12/2013
Video Blogs
Message Boards
Chat
Flash Poll
  LinkedIn     RSS
Data Visualization Showcase
We turn to data visualization tools to focus on the world's perception of big-data.
Explore this data here.
More Data Visualization Showcase
BDR in your Inbox
Like Us on Facebook
Follow Us on Twitter
Accolades
Accolades
 


Saul Sherry
Video: Ocado's Audience Insight

Part of 5   |  
See complete series
5|15|13   |   1:22   |   (6) comments


Sam Zindel, Data Strategist at iCrossing Digital Marketing, filled us in on how supermarket delivery giant Ocado uses big data to identify and serve specific content to vegetarians once they spot them on their website.

This was part of Sam's talk at The Big Data Show about putting the customer at the heart of digital marketing, as well as making the most of the data you already have.

Saul Sherry
Video: Shape Up on Small Data

Part 1 of 5   |  
See complete series
4|26|13   |   1:22   |   (15) comments


On the opening day of the Big Data Show, Mike Cornwell, CEO of The IDM, was generous enough to give us some time to discuss his afternoon panel session. He also offered a word of caution on the state of marketing data. We're all getting excited about big data, but it seems most people still can't deal with their small data in the best possible manner.

"Just knowing enough to find some insight from information and using it intelligently for marketing still seems to be beyond a lot of organizations," he said.

Does this resonate with your business? Have you got the small data figured out before you invest time in de-siloing and bringing more information together?

Saul Sherry
Big Data in Use: GoSquared

3|25|13   |   1:48   |   (7) comments


Continuing our series of interviews with businesses leveraging big data, we talk to James Gill, CEO of GoSquared.

GoSquared offers real-time web analytics, using big data technologies to surface the analytical data that counts. Marketing managers and IT departments benefit from GoSquared's ability to pick out the most actionable insights as they happen.

Saul Sherry
Big Data in Use: OpenSignal's Telecommunications Solution

3|18|13   |   1:46   |   (3) comments


In the first of a series of interviews with business leaders who leverage big data, we talk to James Robinson, CTO and co-founder of OpenSignal.

OpenSignal combines big data technologies and sensor data from mobile phones to give insight to both mobile consumers and telecommunications giants. Robinson is also a contributing writer on Big Data Republic.

Saul Sherry
Big Data Explained: What Is Hadoop?

Part of 9   |  
See complete series
3|5|13   |   1:13   |   (9) comments


Hadoop is the open-source software framework that quickly became almost synonymous with big data. But what does it actually do?

Whereas traditional data queries were run on one server, Hadoop enables you to run data queries across a large number of machines. By spreading the computational load across many servers, Hadoop enables you to deal with big data in a timely fashion.

An example:

Tobias runs an online DVD store -- and he wants to increase sales by recommending products to customers as they check out. But he doesn't just want to recommend bestsellers, he wants a smart system that recommends based on the buyer's demographics and taste.

That's where Hadoop helps out. For each customer, Hadoop enables Tobias to spot patterns across all of his customers' data, based on age, sex, genre preference, actor preference, period of production, and many other defining elements. He can access this information quickly, because different elements of the search can be carried out individually and simultaneously, instead of having to take place on a single machine.

Using MapReduce (as discussed in a previous video), these queries are then returned in a way that can guide the customer and increase Tobias's revenue.

Saul Sherry
Big Data Explained: What Is Velocity?

Part of 9   |  
See complete series
1|18|13   |   1:53   |   (13) comments


Today we're going to take a look at the V that allows big data to be immediate and reactive: Velocity.

As well as having to master the sheer volume and variety of information within big data, organizations also have to be able to contend with the speed at which all of this data is generated. Real benefit can be gained by pouncing on this data in real-time -- affecting outcomes while they are still forming.

What kind of benefit?

Well, as we've already established, data can take many different forms. How working on this stream of real-time big data will benefit you will depend on your industry. For this example I'll focus on the financial services sector.

Andy is in charge of online security for a big bank, trying to make sure his customers' money is safe. When he can detect fraud after the event, it's fairly useless, but if he can spot it as it happens, it can be priceless. If a malicious computerized attack is started on Andy's bank, it will be generating thousands of events every second -- but Andy has put the right system in place to detect these events by comparing them to the way actual, normal customers behave. And it happens in real time, so alarms are going off to let him know.

As Frank Bria told us in his Big Data Republic article, Big Data Tackles Fraud:

Many fraudsters will access online banking and go directly to the transfer section of a Website without first checking balances and transactions. That clickstream is foreign and unfamiliar to the complex event processing engine and thus gets flagged.
In this way the bank can stamp down on the illegal activity as it happens, rather than chasing up after the event.

Saul Sherry
Big Data Explained: What Is Variety?

Part of 9   |  
See complete series
11|7|12   |   2:10   |   (22) comments


There's plenty of talk about big data's three V's: volume, velocity, and variety. But what exactly do these terms mean?

We're going to take a quick trip through one of these today: Variety.

This exciting concept within big data gives you the opportunity to gain insight by combining a variety of data sets that would not traditionally sit together. By enabling you to link up your traditional analytical data sets with many different types of information, a new world of analytical possibilities is opened.

So what's so exciting about this?

Well, it allows you to collate data sets that don't obviously relate to each other. Data experts can then analyse this collated data, to spot patterns or create new insights you would previously have been blind to. Variety, when tackled well in big data, allows you to see new revelations in the data your organization already produces.

An example: Judith is a brand manager, she loves her job and is very good at it, but knows she would benefit from being able to listen even more closely to the voice of her customer.

Taking traditional financial information, Judith can already see the performance of her brand. It doesn't take a data scientist to see which week did well, and which week did badly. But it won't tell her why.

Harnessing variety in data, Judith's data team can create relations between this data and what's being said on social media about her brand, as well as in text-input fields on customer satisfaction surveys. These disparate sets of data can be brought together, contextualized, and visualized in a way that gives Judith clues as to what her brand has done to influence customer behavior.

Suddenly, Judith now has the vision to generate hypotheses on ways to amplify positive results and mitigate negative trends.

Most importantly, she can take action.