Big Data, Big Confusion?

Big Data (Photo credit: Kevin Krejci)

The Problem with Our Data Obsession

however objective data may be, interpretation is subjective, and so is our choice about which data to record in the first place. While it might seem obvious that data, no matter how “big,” cannot perfectly represent life in all its complexity, information technology produces so much information that it is easy to forget just how much is missing..... life is messy, and not everything can be abstracted into data for computers to act upon

There are obvious limitations to Big Data, but overall it is a force for good. The solution to Big Data blind spots seems to be even more Big Data. No?

Related articles

• The Morning Briefing: Big Data
• Big data might slow down JTA connections
• Big Data Infographic | How Big is Big Data? | Domo | Blog
• Transforming Big Data Into Actionable Insight [Infographic]
• The Morning Download: Xerox's 'Big Play With Big Data'
• The Privacy Legal Implications of Big Data: A Primer
• Taming Big Data: Small Data vs. Big Data
• Big Data Myths Persist
• Make Intelligent Decisions With Big Data [Infographic]
• Most Businesses Moving To Big Data

Big Money In Big Data

Big Data, The Moving Parts: Fast Data, Big Analytics, and Deep Insight (Photo credit: Dion Hinchcliffe)

I do think there is big money in Big Data. A lot of people do. But here is a disagreeing thought.

Is There Big Money in Big Data?

Peter Fader says a flood of consumer data collected from mobile devices may not help marketers as much as they think. ..... Few ideas hold more sway among entrepreneurs and investors these days than "Big Data." The idea is that we are now collecting so much information about people from their online behavior and, especially, through their mobile phones that we can make increasingly specific predictions about how they will behave and what they will buy. ..... what was going on 15 years ago with CRM (customer relationship management) .... ask anyone today what comes to mind when you say "CRM," and you'll hear "frustration," "disaster," "expensive," and "out of control." It turned out to be a great big IT wild-goose chase. And I'm afraid we're heading down the same road with Big Data ..... many "big data" people don't know what they don't know. ..... the still-powerful rubric of RFM: recency, frequency, monetary value. .... Ask anyone in direct marketing about RFM, and they'll say, "Tell me something I don't know." But ask anyone in e-commerce, and they probably won't know what you're talking about. ...... Chartists are looking at the data without developing fundamental explanations for why those movements are taking place ..... Among financial academics, chartists tend to be regarded as quacks. But a lot of the Big Data people are exactly like them. They say, "We are just going to stare at the data and look for patterns, and then act on them when we find them." In short, there is very little real science in what we call "data science," and that's a big problem. .... the more data we have, the more false confidence we will have

If his point is that collecting Big Data is not enough, you also have to make sense of it. I agree. But in my definition the whole idea behind Big Data is that of course you are going to make sense of it.

One part where I agree is that Big Data enthusiasm will have plenty of accompanying froth.

What he is saying is making sense of data is going to be more important than collecting data. I agree. But that is what I thought Big Data was all about. To me it never was simply collecting.

Related articles

• Big Data For The Masses
• How C-Level Execs are Tapping into Big Data Analytics
• Big Data for the Business World: Making it Work for You
• 5 Ways To Benefit From Big Data
• Big Data Advances in Customer Experience Management
• Exploring Big Data and Procurement Leveraging McKinsey's Foundational Analysis (Part 2)
• Big Data & Ethics
• via Stowe Boyd: The Future Impact Of Big Data In 2020?
• Big Data and Cloud - Managing the Explosion of Data
• Big Data and Cloud - Managing the Explosion of Data

Facebook And Big Data

Image via WikipediaBig Data: Big News

ReadWriteWeb: Why Facebook's Data Sharing Matters

Facebook has cut a deal with political website Politico that allows the independent site machine-access to Facebook users' messages, both public and private, when a Republican Presidential candidate is mentioned by name. The data is being collected and analyzed for sentiment by Facebook's data team, then delivered to Politico to serve as the basis of data-driven political analysis and journalism. ..... Facebook could be the biggest, most dynamic census of human opinion and interaction in history. ....... Back in the middle of the last century, when US Census data and housing mortgage loan data were both made available for computer analysis and cross referencing for the first time, early data scientists were able to prove a pattern of racial discrimination by banks against people of color who wanted to buy houses in certain neighborhoods. The data illuminated the problem and made it undeniable, thus leading to legislation to prohibit such discrimination...... the relationship between data and knowledge generally in the emerging data-rich world....... David Weinberger .. "It's not simply that there are too many brickfacts [datapoints] and not enough edifice-theories. Rather, the creation of data galaxies has led us to science that sometimes is too rich and complex for reduction into theories. As science has gotten too big to know, we've adopted different ideas about what it means to know at all." ...... The world's largest social network, rich with far more signal than any of us could wrap our heads around, could help illuminate emergent qualities of the human experience that are only visible on the network level.

Google machine-reads all your Gmail emails. That is how it serves ads against them. I don't think that is a breach of privacy. I can imagine Facebook similarly machine-reading your private Facebook messages and updates. As long as individuals are not identified, that collective data is fair game. It has the potential to do tremendous good.

This also tells me Google is not the only major tech company trying to get on the Big Data train. Facebook is also well-positioned.

Curiously Yahoo's new CEO also has said he will take Yahoo into the Big Data domain. He got the vocabulary right. I hope he can deliver. Yahoo also sits on some pretty Big Data.

Big Data: Big News

@lennypruss
Lenny Pruss Those who think GOOG is a one trick search pony, checkout GFS, BigTable, MapReduce, Tenzing, etc. These are the building blocks of Big Data
Nov 30 via webFavoriteRetweetReply

I am no pioneer to this observation, neither is this guy above. But it is so obvious Big Data is in the wings. Big Data will gather buzz like social has been the buzz for a few years now.