[View the story "#CloudViews: The Rise of Big Data" on Storify ]#CloudViews: The Rise of Big Data Cloud Commons Tweet Chat Storified by Cloud Commons · Thu, Aug 30 2012 13:34:15
Welcome to the #CloudViews #tweetchat. This month's topic is #BigData.Cloud Commons
A transcript of the discussion will be posted here: http://bit.ly/Oq9gpd after the event. #CloudViewsCloud Commons
Q1. Is Big Data overhyped? #CloudViewsCloud Commons
Okay so who thinks that #bigData is overhyped? I think it is often misunderstood #cloudviewsAndrew Mueller
A1 Big Data OVER Hyped? YES – but businesses need to be aware. Awareness isnot enough. #CloudViewsAcolyst
A1. Yes, I think #BigData is over-hyped. But frequently cited as top priority by #CIO customers, in my experience & research. #CloudViewsAndi Mann
In many ways #BigData is just an extension of BI - which is itself pretty hot topic. Distinct, but enough to justify the hype? #CloudViews.Andi Mann
@AndrewMueller Agree that #BigData misunderstood... and hype natural corollary of world we live in, shortening attention spans. #cloudviewsAditya Nag
.@chris23 Yes, now #bigData is hype but the promise is real. take a look at Llooker to see the promise being realized #cloudviewsAndrew Mueller
Q2. How are companies benefiting from Big Data now and how will they benefit in the future? #CloudViewsCloud Commons
Q2. I think real outcomes from #BigData are few & far between. Still early, most are edge cases (with some exceptions) #CloudViewsAndi Mann
@CloudCommons A2 I think Big Data is both a problem (how to manage) and an opportunity (how to extract meaningful data) #CloudViewsJeff Abbott
#BigData akin to lasers: when invented, who thought they'd play music? likewise, future apps of big data are unimaginable now #cloudviewsAditya Nag
Short attention span is crazy. We go from virt, auto, cloud, to BigData - but actual IT ppl still battling legacy systems! #CloudViewsAndi Mann
I think on the technical side, big data is better understood than in business. #CloudViewsMarvin Waschke
@AndiMann Exactly.. people in the trenches sneer at the latest fad, as they see it. Truth somewhere in between? #cloudviewsAditya Nag
@JeffreyAbbott @AndrewMueller @chris23 @georgevhulme Agree - excited by #BigData opp'y, not sure what it will turn into! #CloudViewsAndi Mann
A2 as technology automates the synthesis of actionable insights from #bigdata sets, co's that act will gain comp advantage #cloudviewsAndrew Mueller
A2: #CloudViews #bigdata alone is not enough, it is the #analysis and use of the info that will provide the benefit http://ow.ly/dm6Cwpenni333
A2. Benefit large businesses in auditing, process alignment, and to Andi's point BI – resulting in Data Performance Management. #CloudViewsAcolyst
There are a lot of developers who would love to start implementing Hadoop, but they are looking for meaningful projects. #CloudViewsMarvin Waschke
Data Performance Management for Big Data - http://bit.ly/gQSQDn #CloudViewsAcolyst
@penni333 Also, the NOT-use of #bigdata. Just cause CAN be analyzed, doesn't mean SHOULD be. Privacy, legal implications scary #cloudviewsAditya Nag
A2. Best I've heard is multi-variant pattern spotting sware to better predict likely resp to direct mail campaign. #CloudViewsDan Farfan
.@DanFarfan Yes, that is a good way to see it. Give it a new name, and a new data source, see if it stick this time. #CloudViewsAndi Mann
A2: #BigData will never be name of consumer service (e.g. by Sprint) Target is biz & hope consumer not looking. #Cloud for all #CloudViewsDan Farfan
A2. Companies benefit from Big Data by gaining security, efficiency, agility, simplicity, connectivity, mobility, and autonomy! #CloudViewsHexagrid
Q3. How do you see Big Data impacting privacy regulations? #CloudViewsCloud Commons
Today #bigdata seems unwieldy like search before the search engines..Tools will tame this beast #cloudviewsAndrew Mueller
A3. Privacy implications are substantial - I think we will see some big law suits over #BigData, especially in Europe. #CloudViewsAndi Mann
A3: #CloudViews – #privacy regs will be different country by country, industry by industry. See the stats: http://bit.ly/P3TO6xpenni333
I see treaties to control #bigdata not too far away, just like UNCLOS, Berne Convention, ICCPR #cloudviewsAditya Nag
A3: pursuit of #BigData may finally create tipping point (event?) that leads to new definition of ownership of information #CloudViewsDan Farfan
Current privacy controls do not address combining data. It is all about access. Big data blows that out. #CloudViewsMarvin Waschke
A3 Companies must be very careful of the data they collect (and buy) and how they use it, especially when minors are concerned #cloudviewsAndrew Mueller
A3: #bigdata + lack of jurisdictional on internet => need for international consensus on privacy laws. #cloudviewsAditya Nag
Any Legal Professionals out there care to comment about the Legal issues that #bigdata raises? #law #cloudviewsAndrew Mueller
@snakeynag Not sure on this - many vested interests against privacy regs. Still no universal treatment of data transfer #bigdata #cloudviewsAndi Mann
@snakeynag But I do agree the *need* is there - you are spot on with that. Just not sure the *will* is there too. #bigdata #cloudviewsAndi Mann
.@AndiMann ..excellent prediction. Europe + bigdata = big lawsuits. #CloudViewsDan Farfan
A3.Need to apply processes, governance, audits & compliance especially in industries as Healthcare & Government #CloudViewsAcolyst
@georgevhulme @AndiMann Will happen in 20 years.. international law usually trails by that much. #cloudviewsAditya Nag
much damage done by then MT @snakeynag: @AndiMann Will happen in 20 years.. international law usually trails by that much. #cloudviewsGeorge V. Hulme
A3: IMO, there is a case, bigger than Tobacco, waiting for tech-savvy law firm re: information/bigdata #cloudviewsDan Farfan
Q4. Is there such a thing as having too much data? #CloudViewsCloud Commons
@CloudCommons mgt solutions for Big Data will expose breaches of privacy regulations - but not impact the regulations themsleves #CloudViewsJeff Abbott
@AndrewMueller Yes Intellectual Property Rights is issue that needs to be paid attention to here #cloudviews #bigdata #lawAcolyst
PRT @AndrewMueller: Any Legal Pros care to comment on Legal issues w/ #bigdata? (for our #cloudviews tweetchat) /cc @birlep @saprestonAndi Mann
Some of the problem can be addressed by through audit guidelines like COBIT, which are supposed to measure risks from data. #CloudViewsMarvin Waschke
A4: Like most things, there's quality/quantity tradeoff. But, before you see the light, don't discard any electrons! #CloudViewsDan Farfan
@CloudCommons A4. Got a place to store it all? And a database powerful enough to analyze it all w/out creating latency issues? #cloudviewsBrandon Butler
A4: #cloudviews –how much is too much? @librarycongress 235 #terabytes by mid-2011, 2.7B -#daily FB likes / comments http://bit.ly/P3TO6xpenni333
A4 too much data is a factor of your ability to derive actionable insights = people doing unnecessary work #cloudviewsAndrew Mueller
A4. Too much Data? Yes if you don't know what to do with it, how to interpret it, analyze it, etc #CloudViewsAcolyst
A4. Absolutely! Storage cost DC space, throughput speed all affected by volume. Also legal implication re: Record Mgmt/Retention #CloudViewsAndi Mann
A4: Situational; what are you looking for ? eg: LHC (CERN) -> no such thing as too much data; CRM system ->not necessarily true #cloudviewsAditya Nag
@CloudCommons A4: Too much data is when you fail because being thorough would have taken too long. #CloudViewsJeff Abbott
If you keep retaining all #BigData, may well expose big liability (legal, financial) in discovery for legal action. #CloudViewsAndi Mann
MT @AndiMann A4 Absolutely! Storage cost DC space, throughput all affected by volume + legal implication: Record Mgmt/Retention #cloudviewsAndrew Mueller
@AndiMann @DanFarfan No, waiting for tech-savvy judge.. complex intersection of tech+human rights+business+international law.. #cloudviewsAditya Nag
@AndiMann yes, I'm with you on caution. Challenge is #BigBalance #cloudviewsDan Farfan
@AndiMann not to mention cost of infrastructure #cloudviewsAditya Nag
BigData = Big Money... potentially wasted or gained< got to get strategic fast #cloudviewsAndrew Mueller
Q5. How should a company get started with #BigData today? #CloudViewsCloud Commons
A5: #cloudviews Google's E Schmidt in 2007 forecast Google would be able to answer questions "What shall I do tomorrow?"...Smart Enterprise
A5: Start by defining business problem(s) you want to solve, *then* look for data, not other way around. #cloudviewsAditya Nag
A5: Get started? Well, hire one of us brainiacs chatting #bigData on the Thursday :-) #CloudViewsDan Farfan
A5. I'm no expert but I would think starting with some business objectives would be a good first place to start #cloudviewsBrandon Butler
@DanFarfan LOL how nice it is that Twitter is now seen as "business-critical" #cloudviewsAditya Nag
@BButlerNWW precisely. Too many companies think #bigdata is magic that will increase profit/revenue #cloudviews.Aditya Nag
Start with defining what you want to get out of #bigdata and prioritizing the info based on business objectives #CloudViewsDenise Dubie
@CloudCommons A5: Get started with big data with big caution. Maintain strong barriers between your own data and others' data. #CloudViewsJeff Abbott
A5. Need to define a strategy road map, gap analysis – where are you headed and then work backwards. #CloudViewsAcolyst
A5: This is the $64m question! Not easy now - as @AndrewMueller said, need better tools. Right now it is too hard! #CloudViewsAndi Mann
A5. Also big staffing/skills issues. World need more statistical data scientists. (Never thought I would type *that*! ;-) ) #CloudViewsAndi Mann
PRT @BButlerNWW: Business objectives would be a good first place to start #cloudviews < Great point. IT for IT's sake is rarely the answer.Andi Mann
@CloudCommons thanks.. stumbled upon this discussion, and thoroughly enjoyed it. #cloudviewsAditya Nag
Cannot believe another houd of #CloudViews is done. Thanks all for joining in - I had fund and learned stuff too! See you next time!Andi Mann
Thank you for participating in this month's #CloudViews #tweetchat!Cloud Commons
A transcript of the event will be posted here: http://bit.ly/Oq9gpd later today. #CloudViewsCloud Commons