Here’s a Big Book on Big Data

Big Data: A Revolution that will Transform how we Live, Work and Think by Mayer-Schonberger and Cukier“Big data” is definitely one of the more commonly heard business buzz terms these days.

But beyond the general impression that “big data” represents the ability to collect and analyze lots and lots of information in some efficient manner, most people have a difficult time explaining with any specificity what the term really means.

Moreover, for some people “big data” isn’t very far removed from “big brother” – and for that reason, there’s some real ambivalence about the concept.  Consider these recent “man on the street” comments about big data found online:

  • “Big data:  Now they can crawl all the way up your *ss.”
  • “The scary thing about big data is knowing [that] Big Brother can know every single thing you do – and realizing your life is too unimportant for Big Brother to even bother.”
  • “Big data is what you get after you take a big laxative.”

But now we have a recently-published book that attempts to demystify the concept.  It’s titled Big Data:  A Revolution that will Transform How We Live, Work and Think, and it’s authored by two leading business specialists – Viktor Mayer-Schönberger, a professor of internet governance and regulation at Oxford University and Kenneth Cukier, a data editor at The Economist magazine.

The book explores the potential for creating, mining and analyzing massive information sets while also pointing out the potential pitfalls and dangers, which the authors characterize as the “dark side of big data.”

The book also exposes the limitations of “sampling” as we’ve come understand it and work with it over the past decades.

Authors Viktor Mayer-Schonberger (l) and Kenneth Cukier (r).
Authors Viktor Mayer-Schonberger (l) and Kenneth Cukier (r).

Cukier and Mayer note that sampling works is fine for basic questions, but is far less reliable or useful for more “granular” evaluation of behavioral intent.  That’s where “big data” comes into play big-time.

The authors are quick to note that advancements in data collection tend to come along, shake things up, and then quickly become routine.

Mayer calls this “datafication,” and describes how it works in practice:

“At first, we think it is impossible to render something in data form.  Then somebody comes up with a nifty and cost-efficient idea to do so, and we are amazed by the applications that this will enable – and then we come to accept it as the ‘new normal.’  A few years ago, this happened with geo-location, and before it was with web browsing data gleaned through ‘cookies.’  It is a sign of the continuing progress of datafication.”

Causality is another aspect that may be changing how we go about treating the data we collect.

According to Cukier and Mayer, making the most of big data means “shedding some of the obsession for causality in exchange for simple correlations: not knowing why but only what.”

So then, we may have less instances when we come up with a hypothesis and then test it … but rather just use the data to determine what is important and act on whatever information is revealed in the process.

Retail DisplayOne example of this practice that’s cited in the book is how Wal-Mart determined that Kellogg’s® Pop-Tarts® should be positioned at the front of the store in selected regions of the country during hurricane season to stimulate product sales.

It wasn’t something anyone had thought about in advance and then decided to verify; it was something the retailer discovered by mining product purchase data and simply “connecting the dots.”

Author Mayer explains further:

“There is a value in having conveniently placed Pop-Tarts, and it isn’t just that Wal-Mart is making more money.  It is also that shoppers find faster what they are likely looking for.  Sometimes ‘big data’ gets badly mischaracterized as just a tool to create more targeted advertising … but UPS uses ‘big data’ to save millions of gallons of fuel – and thus improve both its bottom line and the environment.”

One area of concern covered by the authors is the potential for using “big data predictions” to single out people based on their propensity to commit certain behaviors, rather than after-the-fact.  In other words, to treat all sorts of conditions or possibilities in the same manner we treat sex offender lists today.

Author Kenneth Cukier believes that the implications of a practice like this – focusing on the use of data as much as the collection of the data – is “sadly missing from the debate.”

This book fills a yawning gap in the business literature.  And for that, we should give Dr. Mayer-Schönberger and Mr. Cukier fair dues.  If any readers have become acquainted with the book and would care to weigh in with observations, please share your thoughts here.

Evil eye? Google’s vision for the future.

pay-per-gaze creepy disturbingTo understand where Google is heading next in the world of advertising, consider this:  The company has just been granted a patent on its “pay-per-gaze” eye-tracking system.

You might wonder what that might be.

Pay-per-gaze is an ad system that utilizes Google Glass for tracking the ads that consumers see online and elsewhere.  The gaze-tracking capability comes from another Google innovation:  a head-mounted tracking device that communicates with a server.

According to the patent documentation, the tracking devices includes eyeglasses with side-arms that engage the ears of the user … a nose bridge that engages the nose of the user … and lenses through which the user views the external scenes wherein the scene images are captured in real-time.

And it need not be limited to tracking online advertising, either; pay-per-gaze functionality could potentially extend to billboards, magazines, newspapers and other printed media, Google notes.

But the idea is even more revolutionary than that:  Not only does it aim to measure how long an individual looks at an ad, but also how “emotionally invested” the consumer is by virtue of measuring pupil dilation.

So the tracking system not only will show how long someone looks at an ad, but also will measure the emotional response.  The patent also covers a provision for “latent pre-searching” which would display search results over a user’s field of vision using Google Glass or another wearable computer.

If all of this seems like “Big Brotherism” at its worst … you may well be correct.  But Google is doing its best to downplay such sinister connotations.  It’s emphasizing that users can opt out of “pay-per-gaze” tracking, and that all data will be anonymized.

But let’s get this straight:  The world’s biggest search engine was just granted a patent for the most “sticky” form of advertising possible – ads that literally flash in front of someone’s eyes.

And when we add in aspects like measuring pupil dilation, it won’t be long before Google will be able to determine how good eats, or good looks, are affecting our emotional response.

One wonders how much farther we can go with measuring advertising engagement and buying intent. 

Then again, we already have an answer, of sorts.  As early as 2000, experiments with electromagnetic brainwaves have shown that people can literally “think” instructions and thereby cause an action.

Imagine combining Google’s pay-per-gaze and pay-per-emotion with electromagnetic brainwave tracking.  Add in a credit card number, and there’s no telling what could happen just with a fleeting thought or two!

If all of this sounds creepy and disturbing … get used to it.  With the likes of Google and the NSA at the helm, “creepy and disturbing” may well become the “new normal” for society.