Transcription
2016 Big DataMaturity SurveyBrought to you by Trifacta & AtScale
IntroductionNow in its second year, the Big Data Maturity Survey 2016 (formerly the“Hadoop Maturity Survey”) delivers a wealth of insight into Hadoop as itcontinues to be the fastest growing force in Big Data.But how do you separate hype from reality? How do you find outwhat works and what doesn’t? AtScale has partnered with Cloudera,Hortonworks, MapR, Tableau, Trifacta and Cognizant to identify companiesthat are working with Big Data or about to. We asked them how they gotvalue from it, what tools they are using and the tactics they used to succeed.With answers from over 2,550 participants worldwide, this survey is thefirst global and industry’s largest study on Big Data Maturity. The studyfocuses on companies that have deployed Big Data, their best practicesand their intentions.Big Data Maturity Survey 20161
Executive SummaryBig Data is growing fastBig Data Cloud is King97% will do as much or morewith Big Data over the next3 months.72% of respondents plan ondoing Big Data in the Cloud.Governance is agrowing concernBusiness Intelligenceis #1Governance is the fastestgrowing area of concernyear-over-year (21% YOY).75% of respondents saythey planning on using BIon Big Data.Big Data Maturity Survey 20162
A Deep and Wide Viewof the MarketMore ValueMore People95% of respondents haveachieved positive value withBig Data or are anticipatingthey will.Over 2,550 answers.77 countries, over 1400companies. 76% are usingHadoop today!More ProductionMore Mature73% of respondents now inproduction (vs.65% last year).1 in 5 Have Over 100 Nodes!Big Data Maturity Survey 20163
Audience Metrics
2017: Year of Big Data97% will do as much, ormore, with Big Data overthe next 3 months.Big Data Maturity Survey 2016Same/MoreLess5
Big Data: No Longer anExperimentBig Data is StrategicTwo-thirds (66%) view Big Dataas “Strategic” or “Game Changing”,while only 19% of respondentsconsider it experimental.Big Data is No Longer anExperimentDramatically fewer described theirusage of Big Data as “Experimental”this year versus last (a 37% yearover year drop).Big Data Maturity Survey 20166
Big Data Value:“Scale-Out” is #1Best way to gain value from Big Data is to solve scale-outneedsScale-out use cases are 56% more likely to yield tangible value.Least effective way to gain value is to be motivated bycuriosity or cost savingsCompanies who use Big Data out of curiosity are least likely to succeed (29%).Primary Big Data Use CasesAchievedTangibleValue:NoYesBig Data Maturity Survey 20167
BusinessIntelligence
BI: #1 Use Case for Big DataIn 2015, BI overtook ETL as the #1 workload planned forBig Data.This trend continues in 2016. Business Intelligence is #1 workload for BigData with 75% of respondents planning on using BI on Big Data.Big Data Maturity Survey 20169
Multi-Dimensional& Visual on the RiseTableau continues to be the #1 BI Tool for Big Data.Year-over-year, visual and multidimensional vendors have increased theirshare (MicroStrategy, Cognos) over Tabular models like Microsoft Excel.BI Tools on Big Data20162015Big Data Maturity Survey 201610
Microsoft Leads onSmall DataMicrosoft Excel maintains the #1 place for BI Tool forSmall Data.New entrant PowerBI is helping Microsoft stay on top.59% are planning on using Microsoft software (Excel, PowerBI or both).20162015Big Data Maturity Survey 201611
Big Data inthe Cloud
Cloud: 72% of Big Data willbe in the CloudNow 53% are using Cloud for their Big Data deployment 14% have ALL of their Big Data in the Cloud 27% have more than half of their Big Data in the CloudTomorrow 72% plan on doing Big Data in the Cloud 42% of them plan on having more than half of their Big Data in the CloudBig Data Maturity Survey 201613
All Cloud: 34% More SuccessRespondents who have deployed all of their Big Data inthe Cloud are 34% more likely to achieve tangible value,compared to those that have none.AchievedTangibleValue:NoYesBig Data Maturity Survey 201614
Governance &Self-Service
The State of Self-ServiceAccess to Big DataSelf-Service Access to HadoopYear over year, self-service access onBig Data grew by 15%, however mostcompanies (53%) still suffer from a lackof self-service access to Big Data.AchievedTangible Value:NoYesDo Business Units Have Access to Hadoop?Self-service access is on of the best ways to drive value on Big Data.Companies who have self-service are 32% more likely to succeed.Big Data Maturity Survey 201616
Growing Concern:Governed Self-ServiceWhile skillset continues to be the top barrier to providing self-serviceaccess, fewer respondents worry about it more in 2016.Accessibility, security and governance have become the fastest growingareas of concern year-over-year, with governance growing most at 21%.2015 to 2016 ChangeBig Data Maturity Survey 201617
Spark & Spark SQL
Spark: Education &Development25% Have Spark inProduction Today85% More Likelyto Achieve ValueWhen Deployed21% Plan to Use Spark in ProductionAchievedTangible Value:NoBig Data Maturity Survey 2016Yes19
Spark SQL: TheExcitement is RealAs indicated in the latest SQL-on-Hadoop performance benchmarks, one engine doesn’t fit all. Enterprises will continue torely on more than one engine to accommodate their needs forreliability, concurrency and fast query response time on smalland big data.Planning on Using HadoopBig Data Maturity Survey 2016Using Hadoop20
Enterprise Business& IT
The CIO’s Future: A HybridData Portfolio82% are looking to Big Data for EDW Optimizationrather than a straight replacement.The future of the CIO Data Portfolio will combine traditional datawarehousing solutions (e.g. Teradata), contemporary data platforms (e.g.Hadoop) with Big Data services (e.g. Google BigQuery, Amazon Redshiftand Microsoft Azure).Big Data Maturity Survey 201622
Executives Drive moreValue for Big DataWho Was the Primary Driver Behind Big Data atYour company?IT is the primarydriver behind BigData’s adoption(57%) but whenexecutives drive BigData, companiesare 19% more likelyto achieve tangiblevalue.Drivers Behind Big Data AdoptionAchievedTangible Value:NoYesBig Data Maturity Survey 201623
share (MicroStrategy, Cognos) over Tabular models like Microsoft Excel. Multi-Dimensional & Visual on the Rise Big Data Maturity Survey 2016 10 BI Tools on Big Data 2015 2016. Microsoft Excel maintains the #1 place for BI Tool for Small Da
