Transcription
IBM PureData System for AnalyticsN3001 Overview 2015 IBM Corporation
INTRODUCTION TO NETEZZATECHNOLOGY2 2015 IBM Corporation
IBM PureData System for AnalyticsThe Simple Data Warehouse Appliance for Serious AnalyticsPurpose-built analytics applianceIntegrated database, server and storageStandard interfacesLow total cost of ownershipWhat makes it different?Speed - 10-100x faster than traditional custom systems1Simplicity - minimal administration and tuningScalability - petabyte scale user data capacitySmart - high performance, advanced analytics13Based on IBM customers' reported results. "Traditional custom systems" refers to systems that are not professionally pre-built, pre-tested and optimized. Individual results may vary. 2015 IBM Corporation
Traditional Data Warehousesare just too complexThey do NOT meet the demands of advanced analytics on big data. Too complex an infrastructure Too inefficient at analytics Too complicated to deploy Too many people needed to maintain Too much tuning required Too costly to operateToo long to get answers44 2015 IBM Corporation
Appliances Make It Simpletransforming the user experience. Dedicated device Optimized for purpose Complete solution Fast installation Very easy operation Standard interfaces Low cost5 2015 IBM Corporation
Evolution of Netezza & PureData System for AnalyticsPureDataSystem forAnalyticsN300xWorld’s Firstappliance with nocost encryptionPureDataSystem forAnalyticsN200xWorld’s Fastest andGreenest AnalyticalApplianceWorld’s FirstAnalytic DataWarehouseApplianceWorld’s FirstPetabyte DataWarehouseApplianceTwinFin World’s First100 TB DataWarehouseApplianceNPS 10000SeriesWorld’s FirstData WarehouseApplianceNPS 8000 Series20036TwinFin with iClass AdvancedAnalytics20062009201020122014 2015 IBM Corporation
Bon-Ton Optimizes Their Customer’s Experience UsingIBM PureData System for AnalyticsUnderstand what customers want,when they walk into a Bon-Ton storeTargeted advertisingto promote products that customerswant at the price they want themFreeing the time of Bon-Tonbuyers and plannersfrom the mundane task of gathering &compiling customer data so they can spendtheir time making informed decisions todrive the business“I need some way to understand what they'rethinking, what they're feeling, without having tohave contact with them. PureData for Analyticsis what's going to help us understand what thecustomers want when they walk into mystores”- Paula Post, Vice President Merchandising Optimization.Video: https:/www.youtube.com/watch?v 0gsWOL6gciw7 2015 IBM Corporation
Carphone Warehouse Increases Profitability Through New RevenueStreams & Reduced CostsUp to 1200Xfaster performance; reports that oncetook an hour to run now take seconds50% reductionin time to market for new businessintelligence services“The PureData System, powered byNetezza technology, provided hugetechnical advantages & big businessadvantages. We can now insure devices onbehalf of a bank in the UK, which wecouldn’t have done before.”- Paul Scullion, Head of Business IntelligenceCase Study: synkey M183113U13038J588 2015 IBM Corporation
eHarmony Attracts New Members by Understanding Behavior andFine-tuning Matching Algorithm100% increasein subscriber base96% decreasein query run times(from 1 hour to 2 minutes)Reduced spendingOn low-return promotional activities"Through the entire subscription lifecycle, thecompany tracks everything members do onthe website. This process generates anenormous amount of data, which would becompletely wasted without the ability to extracthidden insights about how members behave.”- eHarmony C-Level executiveVideo: https://www.youtube.com/watch?v 0wffNyHn8s9 2015 IBM Corporation
Canadian National Railway Company leverages the power ofpredictive analytics to run trains on timeEnhanced confidencein data driven decision-makingReduction in timespent on running reports, somereports that took 10-20 minutesearlier now run in 5 secondsAccelerated analyticsfor faster insight, the company ismoving to near real time reportgeneration compared to monthlyreports earlier“The performance of PureData is very good,most reports we have are running in less than5 seconds where as with other databases wehad reports running for 10-20 minutes”- Philippe Chartier, BI Team Lead, Information Delivery,Canadian National Railway CompanyVideo: https://www.youtube.com/watch?v yyZu5seKbLI10 2015 IBM Corporation
Seattle Children’s Optimizes Business Intelligence & Insight intoNew Treatment Protocols to Enrich Patient Care98% reductionin time spent on some queriesPromotes self-servicebusiness intelligence& insights throughout the hospitalMore effectivediagnosis & treatmentby enabling faster, more accurate insights,on-demand“We’re getting deeper into the data inmultiple ways . . . When we see newcommonalities in treatments for children,we can design new protocols to providethe best possible care”- Wendy Soethe, Enterprise Data Warehouse ManagerVideo: https://www.youtube.com/watch?v bjGWIectvkI11 2015 IBM Corporation
THE NEW PUREDATA SYSTEMFOR ANALYTICS N300112 2015 IBM Corporation
Announcing the PureData System for Analytics N3001Changing the game for data warehouse appliances (again)Big Data and Business Intelligence readywith capabilities to unlock data’s true potentialAdvanced security in an insecure worldat no extra costAn even broader family of appliance modelsto fit a broad range of data capacity needsand yes, simple is STILL better!13 2015 IBM Corporation
Big Data and Business Intelligence ReadyUnlocking Data’s True PotentialIncluded with the PureData System for Analytics N3001Data Warehouse Appliance Advanced security New rack-mountableappliance for midsizeorganizations New 8-rack systemfor Petabyte capacityData Integration & TransformationInfoSphere DataStage 280 PVUs,2 concurrent Designer Client licenses andInfoSphere Data ClickExceptionalvalueprovidedBuilt-in, In-Database analyticcapability and integration witha variety of 3rd party toolsFor additionalvalue14Business IntelligenceCognos software, 5 Analytics User licenses,plus 1 Analytics Administrator licenseIndustry Process & Data ModelsModels for Banking, Financial Markets,Healthcare, Insurance, Retail, TelcoHadoop Data ServicesInfoSphere BigInsights Software licenses tomanage 100 TB of Hadoop dataReal-time AnalyticsInfoSphere Streams Developer Edition2 users, non-production licensesIBM InfoSphere Data Privacy andSecurity for Data Warehousing 2015 IBM Corporation
IBM Netezza AnalyticsIncludedIn-database Analytics For Every Role in Your EnterpriseUse cases Reduce hospital admissions or personalizedisease treatmentsBring the analytics to the datanot the data to the analytics Achieve an order of magnitude improvement inmanufacturing quality Better understand the risk of catastrophic events and many moreFeatures Built-in, in-database analytic functions- Data mining, prediction, transformations, statistics,geospatial, data preparation Full integration with tools for BI & visualization- IBM Cognos, Microstrategy, Business Objects,SAS, MS Excel, SSRS, Kognitio, Qlikview Full integration with tools for model building alAnalyticsAdvancedStatistics- IBM SPSS, SAS, Open Source R, Fuzzy Logix Full integration for custom analytics- Open Source R, Java, C, C , Python, LUA15 2015 IBM Corporation
Business IntelligenceIncludedThe Power of IBM Cognos with PureData System for AnalyticsUse cases Reporting, analysis, scorecards, dashboardsRapid deployment of answersto key business questions Data visualization Mobile business intelligence and many othersFeatures Leading Business Intelligence- Interactive analysis- Compelling visualizations - web, mobile or email- Enterprise scalability Optimized for PureData for Analytics- Offers high performing OLAP over relationalexperience- Cognos Dynamic Query Mode extends benefits ofPureData by adding in-memory & caching on top ofalready fast appliance performance- Exploits Netezza analytic in-database functions161PureDataSystem for Analytics N3001 must be the data source for Cognos.Included with PureData for Analytics:IBM Cognos Business Intelligence 10.2.15 Analytics User licenses,1 Analytics Administrator license1 2015 IBM Corporation
Data Integration & TransformationIncludedInfoSphere DataStage, Designer Client and Data ClickUse cases Integration, transform and deliver trustworthyinformation to your data warehouseRich capabilities fordata integration Analysts, data scientists or even line-of-businessusers can easily retrieve data and populate thePureData System for Analytics Move data from the data warehouse into asubject area data martFeatures Ease of Use- Provides an easy-to-use, top-down, work-as-youthink design interface that enables users todesign once and deploy anywhere—batch or realtime; extract, transform, load (ETL); or extract,load, transform (ELT)- Self-service data integration to enhance businessagility Accelerate time to value- Includes a comprehensive library oftransformation components for easily definingcommon integration processes171PureDataSystem for Analytics N3001 must be the source or target database.Included with PureData for Analytics:IBM InfoSphere DataStage 11.3 (280 PVUInformation Server Engine Tier)1,Designer Client (2 concurrent users),InfoSphere Data Click1 2015 IBM Corporation
Hadoop Data ServicesIncludedIncluded Capability with IBM InfoSphere BigInsightsUse cases Federated SQL access across Hadoop andyour PureData System for AnalyticsBringing the power ofHadoop to your enterprise Pre-processing and landing zone for all datatypes prior to loading to data warehouse Queryable backup for cold dataFeatures Big data analytical platform- Best of open source IBM technologies- Big SQL- High performance SQL access of Hadoop- Federation across many data sources combine information from Hadoop andPureData for Analytics- BigSheets visualization tool Built-in analytics- Text analytics, Big R181BasedIncluded with PureData for Analytics:InfoSphere BigInsights 3.0 softwarelicenses for 5 enterprise nodes tomanage up to 100 TB of Hadoop data1on 4 data nodes 1 master node. 12 TB uncompressed per data node with 4 TB drives. 12 TB x 4 nodes 48 TB uncompressed. 2015 IBM CorporationUsing 2-2.5x compression yields 96-120 TB compressed data. Capacity will depend on hardware configuration selected.
Real-Time AnalyticsIncludedIncluded Capability from IBM InfoSphere StreamsUse cases Fraud detection Predict customer churn Telco real-time mediation and analysisDeploy analytic models ondata-in-motion to enable real-timedecisions and land data in thewarehouse to build the analytic models Real-time monitoring of medical sensors to improvehealthcare outcomes Defect detection in manufacturing Traffic pattern analysis and managementFeatures Analyze data in motion- Provides sub-millisecond response times,allowing you to view information and events asthey unfold- Analyze all kinds of data: simple & advanced text,geospatial, acoustics, images, video, sensors- Eclipse-based development environment19Included with PureData for Analytics:InfoSphere Streams Developer Edition 3.2.12 developer users, non-production licenses 2015 IBM Corporation
Accelerating Industry Specific Business AnalysisAvailableAccelerate Time to Value with IBM Industry ModelsUse casesFeatures Comprehensive with Built-in Expertise Risk Management- Data Warehouse design models, businessterminology models and analysis templates Wealth and InvestmentManagement- Experience from 500 client engagements Customer Intelligence Solution bundles including data model, dataappliance, ETL & Business Intelligence Regulatory Reporting Health Care Analytics Banking, Healthcare, InsuranceIndustry Vertical ModelsBankingFinancialMarketsHealthcare InsuranceRetailTelcoCustomer InsightHorizontalModel PacksMarket & Campaign InsightSupply Chain Insight20 2015 IBM Corporation
IBM InfoSphere Data Privacy and Security forData WarehousingInfoSphereData Securityand PrivacyInfoSphere Data Privacyand Security for DataWarehousingAvailableDefine and Share Define a warehousing glossary Share sensitive data definitions andpolicies Create project blueprintsDiscover and Classify Discover / profile data Explore lineage and relationships Classify sensitive dataPurpose-BuiltCapabilitiesDefine and ShareDiscover and ClassifyMask and RedactMonitor Data Activity21 Achieve and enforcecompliance Secure and Protect sensitivedata in appliances Reduce costs of attainingenterprise securityMask and Redact De-identify sensitive data within thewarehouse Apply obfuscation techniques to bothstructured and unstructured dataMonitor Data Activity Monitor data warehouses Real-time alerts Centralized reporting of audit data 2015 IBM Corporation
What’s New in PureData System for Analytics N3001Security Improved security with Self Encrypting Drives Kerberos supportPerformance Faster performance with upgraded CPUs with morecoresNew appliance models New rack mountable, ultra lite/mini appliance formidsize businesses New 8-rack, Petabyte capacity applianceNew Netezza Platform Software (NPS) 7.2 Faster load rates Performance Portal enhancements and more22 2015 IBM Corporation
Introducing PureData System for Analytics NPS 7.2New Database Features, Improved Performance and ResiliencyDatabasefeatures Enhanced securityenables single sign-onand centralizedmanagement New built-in functionsand SQL updates Portal enhancements23Better performanceand reliability Faster load rates up to10 TB/hr Faster restore rates WLM throughput andlatency optimizationImproved resiliencyand fault tolerance Enhanced HealthCheck capabilities Enhanced storagetopology andcommunication fabric Call Home via httpsand SOAP 2015 IBM Corporation
Introducing PureData System for Analytics N3001-001:The Mini-ApplianceBringing speed and simplicity to midsize organizations for big outcomes Simple Same user experience as all PureData System forAnalytics appliances Full function Netezza Platform Software with IBMNetezza Analytics Support tools and Netezza Performance Portal ODBC/JDBC/OLE-DB/SQL Driver integration Load and go with no tuning or administration Speed 10-100x faster than traditional custom systems1 Smart Rich set of in database analytic functions Protection of all data from unauthorized access Includes starter kits for Big Data and Business Intelligence Agile Easily incorporated into the data center with simplifiedinstallation into an existing rack Affordable Purchase or lease241BasedSolution Highlights Rack mountableProduction readyFull function applianceUser data capacity 16 TB*High availability - All redundanthardware, 4 disk spares, hot swappower supply Self encrypting drives, Kerberossupport, LDAP/Active directory*Assumes 4x compressionon IBM customers’ reported results. “Traditional custom systems” refers to systems that are not professionallypre-built,pre 2015IBM Corporationtested and optimized. Individual results may vary.
Introducing PureData System for Analytics N3001-0808-rack System 251.5 PB of user data capacity1Hosts: 2x x3750M4 and 600 GB Self Encrypting DrivesBlades: 56x HS23 with 20 core IvyBridge processorsStorage: 96 EXP2524 disk enclosures with 24x 600 GB Self Encrypting Drives1Assumes4x compression 2015 IBM Corporation
IBM DB2 Analytics AcceleratorAvailableEnhanced with PureData System for Analytics N3001A high performanceappliance that integratesNetezza technology withzEnterprise technology todeliver dramatically fasterbusiness analysisHighlights – What’s New?The PureData System for Analytics N3001provides additional benefits to DB2 AnalyticsAccelerator customers:Benefits Extreme performance for complex queries- Up to 2000x performance improvements Cost Savings- Offload complex queries and eliminatecostly query tuning- No need to create or maintain indices- Improves access to and lowers the cost ofstoring, managing and processing historicaldata Advanced security through encryption of dataat rest with self-encrypting disks Integrated with DB2 z/OS and inheritsmission critical features such as security andrecoverability Performance improvements for analyticworkloads Access to DB2 Analytics Accelerator istransparent to applications and users Improved serviceability with the recentlyintroduced automatic call home capability Broader range of SQL compatibility Fast deployment and time to value- Installation is non-disruptive- Plug it in, load data and go in 1-2 days26 2015 IBM Corporation
PureData System for Analytics FamilyN2002N3001-xxxDB2 AnalyticsAccelerator for z/OS(now with N3001)N3001-001 10-100x faster thancustom systems1 3.3x faster I/O scanrate2 Load and go, no tuning Designed to runcomplex analytics inminutes, not hours Rich set of in-databaseanalytics1Based27.plus Entitled software capability forreal-time analytics, Hadoopdata services, data movementand business intelligence Advanced security Partial rack to 8-rackconfigurations plus Rack mountableappliance Ideal for small andmedium business withup to 16 TB of user data The hybrid computing platformintegrating Netezza technology withzEnterprise technology Supports transaction processing andanalytic workloads concurrently,efficiently & cost effectively Accelerates complex queries, up to2000x faster Required security compliance withData-at-Rest Encryptionon IBM customers' reported results. "Traditional custom systems" refers to systems that are not professionally pre-built, pre-tested and optimized.Individual results may vary. 2015 IBM Corporation2Comparing N1001 scan rate of 145 TB/hour to N2002 scan rate of 478 TB/hour
The PureData System for Analytics N3001 FamilyMultiple rack systemsSingle rack 01-010N3001-020N3001-040N3001-080Racksn/a, 2 x 2U1 (1/4 full)1 (1/2 full)1248Active SBladesn/a247142856CPU cores4040801402805601,120User data(TB) *1632961923847681,536Linear Scalability!28* Assuming 4x compression 2015 IBM Corporation
WHAT MAKES THE N3001BETTER?29 2015 IBM Corporation
What are the Demands of a Modern Data Warehouse?InsightAgilityCostFaster Insight Fast response times areexpected People are used to anexperience as easy asGoogle Users do not want to waitfor query results30Lower cost Initial acquisition Ongoing operation andadministration Total cost of ownershipAdded Agility Ability to respond quickly tothe needs of the business By simplifying operations,more time is provided forinnovation Better business outcomesby utilizing more datasources 2015 IBM Corporation
PureData System for Analytics Delivers on the Demands of aModern Data WarehouseInsightFaster Insight“we tested PureData Systems latelast year on a set of very complexuse cases and we found,compared to earlier architectures, itwas performing 2-3 times fasteron batch processes and anywherefrom 3-10 times better on ourconcurrent workload”- John Naduvathusseril, Chief Data Architect,Nielsen Company31CostLower cost“That simplicity cannot beunderrated. It is justamazingly simple to do very,very large scale things that inany other environment takesengineering, just to pull off.”- David Birmingham, SeniorConsultant, Brightlight ConsultingAgilityAdded Agility“BCBSMA has combined IBM CognosBusiness Intelligence with an IBMNetezza data warehouse appliance toprovide lightning-fast analysis ofmedical and financial data. Thesolution creates sophisticated reportson clinical and financial risk andoperational efficiency.”- Shashikanth Vangala, Manager & ChiefSolutions Architect of Business Intelligence,Blue Cross Blue Shield of Massachusetts 2015 IBM Corporation
What do the Best-in-class Data Warehouses Deliver1?99%Faster information deliveryof users are satisfied w
want at the price they want them Understand what customers want, . SAS, MS Excel, SSRS, Kognitio, Qlikview . Information Server Engine Tier)1, Designer Client (2 concurrent users), InfoSphere Data Click1 1PureData System f
