WIXLIB

DB2 & Big Data Chat with the LabLeveraging Cloudsfor Small and Big Data- 6 December 2011IM Cloud Computing Center of CompetenceIMcloud@ca.ibm.com

2 Featured SpeakersLeon KatsnelsonProgram Director,IM Cloud Computing and Emerging TechnologiesIBMUri BudnikDirector,ISV Partner ProgramRightScale 2011 IBM Corporation

3Agenda DB2 and Cloud The Big Data Challenge IBM’s Approach to Big Data Big Data on Cloud RightScale Cloud Management Platform 2011 IBM Corporation

4DB2 ON CLOUD 2011 IBM Corporation

5 many reasons clients consider Cloud ComputingWe need toreduce our ITcostsNeed to supportremote teamsWe need toimprovebusinessagilityWe need tointegrate webborn dataWe are constrainedon space, energyand cooling in ourdata centerWe are alwaysconstrained onresources forproper Q&A of oursolutionsWe need toreduce ourCAPEXWe need todeliver betterresiliency 2011 IBM Corporation

6DB2 Strategy for Cloud Computing6 2011 IBM Corporation

7DB2: Ready for Any Cloud7 2011 IBM Corporation

8Free DB2-basedWebsite for a year All-in-one instance (server): DB2 Express-CWeb application server (Nginx,Ruby on Rails)Content Management System(RadiantCMS)Runs on Amazon EC2 Microinstance: 613MB of memoryUp to 2 EC2 Compute Units(for short periodic bursts)EBS storage32-bit or 64-bit platform Free for a year for new AWScustomers ng-radiant-cmson-db2-in-the-cloud/ 2011 IBM Corporation

9Dogfooding@your place, @your pace DB2skills acquisitionCommunity operated property10,500 Registered StudentsRuns on the cloud, Managedby RightSaleLeverages DB2 technologiese.g. HADRContinuous availability sincelaunch in January 20119 2011 IBM Corporation

10DB2 Galileo EarlyExperience ProgramClients get hands-on experience withthe upcoming version of DB2 in 30minutes No need to purchase, rack and cableservers No operating system patching No need to install DB2 Always use the latest drop i.e. nowasted time dealing with resolvedissuesHow: Apply for DB2 Galileo EarlyExperience on-the-cloud/ Email IMcloud@ca.ibm.com torequest 500 credit Enjoy your own private virtual DB2server in one of the data centers WW10From zero to DB2Galileo in about 30minutes 2011 IBM Corporation

11DB2 on Cloud Resources IM Cloud Computing Center of Competence– IMcloud@ca.ibm.com DB2 on Cloud homepage– www.ibm.com/db2/cloud 2011 IBM Corporation

12THE “BIG DATA” CHALLENGE 2011 IBM Corporation

13What we hear from customers . . . . Lots of potentially valuable data is dormant ordiscarded due to size/performance considerations Large volume of unstructured or semi-structureddata is not worth integrating fully (e.g. Tweets,logs, . . .) Not clear what should be analyzed (exploratory,iterative) Information distributed across multiple systemsand/or Internet Some information has a short useful lifespan Volumes can be extremely high Analysis needed in the context of existing information(not stand alone) 2011 IBM Corporation

14Big Data Presents Big OpportunitiesExtract insight from a high volume, variety and velocity of data in atimely and cost-effective mannerVariety:Manage and benefit fromdiverse data types and datastructuresVelocity: Analyze streaming data andlarge volumes of persistentdataVolume: Scale from terabytes tozettabytes 2011 IBM Corporation

15Big Data Scenarios Span Many IndustriesMulti-channel customersentiment and experience aanalysisDetect life-threateningconditions at hospitals intime to intervenePredict weather patterns to planoptimal wind turbine usage, andoptimize capital expenditure onasset placementMake risk decisions based onreal-time transactional dataIdentify criminals and threatsfrom disparate video, audio,and data feeds 2011 IBM Corporation

16Customer EngagementsUse patternsCommon requirements Customer sentiment analysis (crosssell, up-sell, campaign management) Integrated retail and web customerbehavior modeling Predictive modeling (credit card fraud) System log analytics (reduceoperational risk) Extract business insight from large volumes ofraw data (often outside operational systems) Integrate with other existing software Ready for enterprise useConsumerInsightText, Blog, WeblogClick streamsLog & transactionsBiological SequencesOperational system & streams data sourcesMulti-channelsalesNext GenFraud ModelsNew BusinessDevelopmentText AnalyticsStatistical ModelBuilding 2011 IBM Corporation

17Big DataIBM’S APPROACH 2011 IBM Corporation

18Big Data: an integral part of an enterprise data platform Manage Big Data from the instant it enters the enterprise High fidelity – no changes to original format Available for new uses, analyses, and integrations.CognosOperationalData StoreBig Data ApplicationsWarehouseApplicationsWarehouseBig Data PlatformClient and Partner SolutionsIBM Big Data SolutionsBig Data User EnvironmentDevelopersEnd UsersAdmin.Traditional data sources(ERP, CRM, databases,etc.)Big Data Enterprise rce data (Web, sensors, logs, media, etc. ) 2011 IBM Corporation

19IBM’s Platform Addresses Key Requirements1. Platform for V3 – Variety, Velocity, Volume Variety - manage data & content “As Is” Handle any velocity - low-latency streams and large volume batch Volume - huge volumes of at-rest or streaming dataBig Data Platform2. Analytics for V3 Analyze Sources in their native format - text, data, rich content Analyze all of the data - not just a subset Dynamic analytics - automatic adjustments and actions3. Ease of Use for Developers and Users Developer UIs, common languages & automatic optimization End-user UIs & visualization4. Enterprise Class Failure tolerance, Security and Privacy Scale Economically5. Extensive Integration Capabilities Integrate wide variety of sources Leverage enterprise integration technologies 2011 IBM Corporation

Platform VisionIBM Big Data SolutionsClient and Partner SolutionsRules / BPMiLog & LombardiDataWarehouseBig Data ngGeospatialTimes SeriesBlue PrintsBig Data Enterprise EnginesManagementProvisioningAdminToolsMaster DataMgmtInfoSphere ngActivityMonitorJobTrackingIdentity &Access MgmtInfoSphere MDMDatabaseDB2 & ivity Tools & OptimizationWorkloadManagement &OptimizationIBM & non-IBMMathematicalApplicationsInfoSphere nInformation Server20Cognos & SPSSMarketingUnicaData GrowthManagementInfoSphere Optim 2011 IBM Corporation

21BigInsights Summary BigInsights analytical platform for persistent “Big Data”– Based on open source & IBM technologies– Managed like a start-up . . . . Emphasis on deep customer engagements,product plan flexibility Distinguishing characteristics– Built-in analytics . . . . Enhances business knowledge– Enterprise software integration . . . . Complements and extends existingcapabilities– Production-ready platform with tooling for analysts, developers, andadministrators. . . . Speeds time-to-value; simplifies development andmaintenance IBM advantage– Combination of software, hardware, services and advanced research 2011 IBM Corporation

22InfoSphere BigInsightsPlatform for volume, variety,velocity -- V3 Enhanced Hadoop foundationAnalytics for V3Enterprise EditionLicensed Text analytics & toolingUsability Integrated install Spreadsheet-style tool Ready-made “apps”Enterprise Class Storage, security, clustermanagementIntegrationEnterprise class Web consoleBusiness process accelerators (“Apps”)Text analyticsSpreadsheet-style analysis toolRDBMS, warehouse connectivityIntegrated Web-based consoleBasic EditionFlexible job schedulerPerformance enhancementsFree downloadEclipse-based toolingIntegrated installLDAP authenticationOnline InfoCenter.BigData Univ.ApacheHadoop Connectivity to DB2, Netezza,JDBC databasesBreadth of capabilities 2011 IBM Corporation

23Big DataON CLOUD 2011 IBM Corporation

24 Hadoop is great at getting the value out of large volumes of data“94% of Hadoop users perform analyticson large volumes of data not possiblebefore; 88% analyze data in greaterdetail; while 82% can now retain more oftheir data”Ventana Research Benchmark Study “Hadoop and Information Management” 201124 2011 IBM Corporation

25 but it requires large scale compute clusters and lots of storage Yahoo! Has over 40000 nodes running Hadoop managing180-200 petabytes of data. Facebook has 2000 compute nodes with 20 Petabytes ofdata. Average cluster size is 200 servers but most clusters around30 servers Most companies can’t make upfront capital investment incompute, storage and networking resources:– Makes it hard to evaluate and pilot– Difficult to develop real hands on skill– Impractical for non continuous needs 2011 IBM Corporation

26VALUE: The Fourth V of the Big Data StoryWhat insight couldyou gain if you hadfull use of a 100node Hadoop clusterfor an hour?What if one hour ofthis 100-node clusterwould cost 34?26 2011 IBM Corporation

27BigInsights Strategy for Cloud Computing27 2011 IBM Corporation

28IBM BigInsights: Ready for Any Cloud28 2011 IBM Corporation

29IBM BigInsights on CloudHadoop for everyone no upfront investment Your own Hadoop cluster on the cloud in less than 30minutes No need to buy install, patch, maintain hardware Deploy on Amazon, IBM, Rackspace or your private cloudinfrastructure Pay as you go for your infrastructure starting at 0.34/node/hour and only pay for what you actually use Use BigInsights Basic Edition at no charge, available low costsupport. Seamlessly transition to BigInsights EnterpriseEdition when ready 2011 IBM Corporation

30IBM BigInsights and RightScale.comHadoop on Amazon, Rackspace, Private & Hybrid CloudInfrastructure Your own Hadoop cluster on thecloud in less than 30 minutes Deploy to Amazon, Rackspacecloud DCs or on your private cloud Pay as you go for yourinfrastructure starting at 0.34/node/hour Sophisticated cloud resourcemanagement by RightScale Use BigInsights Basic Edition seamlessly transition toBigInsights Enterprise Editionwhen ready Take a free course onBigDataUniversity.com30 2011 IBM Corporation

31Available Now!Deploy BigInsights on IBM SmartCloud Enterprise Your own Hadoop cluster on theIBM cloud in less than 30 minutes No need for hardware, install,patch, maintain Locate your Hadoop cluster in oneof IBM Cloud data centers WW Low hourly charges starting at 0.30/cluster/hour. Explore using BigInsights Basicseamlessly transition toBigInsights Enterprise when ready Take a free course onBigDataUniversity.com31 2011 IBM Corporation

32Evaluating Big Data TechnologyIBM IM Demo Cloud (in limited beta) IBM representative initiates theproject, invites customer to participate. Types of projects: Demos, Proof ofTechnology, Proof of Concept: Also great for Beta, ProductIntroductions, Technology Previews Skip construction and go straight toevaluation. No need to get hardware,install/patch OS, BigInsights software,write MapReduce jobs, data sets BigInsights sandbox:– Dedicated cluster of virtual systems. Not ashared sandbox– Customer operates the systems as if local– Ability to bring large data sets– Data centers in NA, EU and AP32 2011 IBM Corporation

33BigInsights on the CloudMaking Learning Hadoop Easy and Fun Flexible on-line deliveryallows learning @your placeand @your pace Free courses, free studymaterials. Cloud-based sandbox forexercises – zero setup 10500 registered students. Hadoop ProgrammingChallenge - 3 students sentto IOD 2011 in Las Vegas,all expenses paid!33 2011 IBM Corporation

34 in Summary Big Data analytics using technologies such as Hadoop can delivergreat value but its appeal is somewhat diminished by the extensivecapital requirements Cloud is a great way to sidestep the CAPEX challenges IBM InfoSphere BigInsights, enterprise-ready distribution ofHadoop is available for cloud deployment on Amazon, IBMSmartCloud Enterprise, Rackspace and on private clouds IBM helps clients leverage the power of Hadoop and ease ofdeployment of the cloud. Contact IM Cloud Computing Center ofCompetence IMCloud@ca.ibm.com. BigDataUniversity.com is a great place to start skills acquisitionwhen budget, time or travel is an issue.34 2011 IBM Corporation