WIXLIB

Fred Ho Informix DevelopmentSept 4, 2013IBM Informix Warehouse Accelerator (IWA)1 2013 IBM Corporation

Informix 12.1Agenda Data Warehouse Trends IWA Technology Overview IWA Customers and Partners IWA Reference Architecture and Competition IWA Roadmap and 12.10 Features 2013 IBM Corporation

Informix 12.1Database and Data Warehousing IndustryTRENDS3 2013 IBM Corporation

Informix 12.1Data Warehousing Workload & Optimizations Data Warehousing/OLAP workloadare inherently more complex thanOLTP transactions and reasons arewell-documented. Ways to overcome that include:–––––Building IndexesPartitioning of dataBuilding cubes, MOLAP / ROLAP / HOLAPQuery tuningAppliances that add a new layer of hardwareto perform I/O for DBMS Mixed-Workload always a challenge DBMS needs to be built to handlesuch a workload4 2013 IBM Corporation

Informix 12.1Third Generation of Database TechnologyAccording to IDC’s Article (Carl Olofson) – Feb. 2010 1st Generation:– Vendor proprietary databases of IMS, IDMS, Datacom 2nd Generation:– RDBMS for Open Systems– Dependent on disk layout, limitations in scalability and disk I/O 3rd Generation: IDC Predicts that within 5 years:– Most data warehouses will be stored in a columnar fashion– Most OLTP database will either be augmented by an in-memory database(IMDB) or reside entirely in memory– Most large-scale database servers will achieve horizontal scalability throughclustering5 2013 IBM Corporation

Informix 12.1Data Warehouse Trends for the CIO, 2011-2012 Data Warehouse Appliances:– DW appliances are not a new concept.– Most vendors have developed an appliance offering or promote certified configurations.– Main reason for consideration is simplicity. The Resurgence of Data Marts:– Data marts can be used to optimize DW by offloading part of the workload, returninggreater performance to the warehousing environment. Column-Store DBMSs:– CIOs should be aware that their current DBMS vendor may offer a column-store solution.– Don’t just buy a column-store-only DBMS because a column store was recommended byyour team. In-Memory DBMSs:– IMDBMS technology also introduces a higher probability that analytics and transactionalsystems can share the same database.Source:TheState of DataWarehousing in 2011; 1/31/2011; GartnerMarkBeyer,Roxane Edjlali,Donald Feinberg(IDNumber: G00209643)6 2013 IBM Corporation

Informix 12.1In-Memory DBMSs (IMDBMS) Have Plenty of Promises Promise that they will transform the way data is provisioned and consumed The extreme performance enable true real-time decision making on any shapeand volume of data Powers unique business innovation and competitive differentiation in today’shigh-speed business environment Gartner estimates that IMDBMS will replace 25% of traditional data warehouseand OLTP systems by 2016 Examples are: Real-time pricing for airlines or banks evaluating assets forrebalancing of portfolio Lower TCO by reducing the need for separate OLTP and data warehouse copiesof data and by eliminating need for cubes, aggregates and indexes.Gartner ID Number: G002215735, Publication Date: 8 Sept 2011, Authors: Roxane Edjlali, Donald Feinberg7 2013 IBM Corporation

Informix 12.1IDC WW RDBMS 2012-2016 Forecast “ As a result of the near-ubiquitous adoption of 64-bit processors,precipitous declines in the price of main memory, and the need for greatertransaction throughput, database technology is migrating from a diskbased paradigm to a memory-based one. Data is increasingly “stored” in memory, protected by redundantreplication and asynchronous logging (for recovery), and organized forhighly efficient retrieval and update.”8 2013 IBM Corporation

Informix 12.1Does the 21st-Century "Big Data" Warehouse Meanthe End of the Enterprise Data Warehouse?Key Findings: Organizations that deploy an EDW almost all create second and third datawarehouses or marts to support additional user needs (judging from up to90% of the data warehouse inquiries received from Gartner clients),despite strict instructions to use the EDW. The architectural style of a data warehouse is usually determined by theavailable skills and tools, and secondarily by time-to-delivery.Source: Gartner; Mark Beyer, Donald Feinberg (ID Number G002130819 2013 IBM Corporation

Informix 12.1Market Research on IWA: What do the Analysts Say? White Paper by Bloor Research: “IBM Informix in HybridWorkload Environments”, August 2012“ for hybrid environments, Informix has a number of unique capabilities thatcannot be matched by either conventional data warehouse vendors ortraditional data warehouses ” White Paper by Ovum Research: “Informix AcceleratesAnalytic Integration into OLTP”, July 2012“ Supporting both operational and analytic workloads with the same system isa relatively unique idea that is also being pursued by rivals such as Oracle.Ovum believes that IBM now has a strong story to tell with IWA”. Magic Quadrant for Data Warehouse Database ManagementSystems by Gartner, Jan 2013“IBM has a vast number of products that use in-memory computing, includingsolidDB, but its only in-memory solution for the data warehousing andanalytical market is Informix Warehouse Edition.”To download these and other papers, go to: ouse/10 2013 IBM Corporation

Informix 12.1IBM Informix Warehouse Accelerator (IWA)IWA TECHNOLOGY OVERVIEW11 2013 IBM Corporation

Informix 12.1Informix Warehouse Accelerator (IWA):Overview and Seamlessly Integration with Informix/IDSSQL Queries (from apps)Informix Warehouse AcceleratorInformixQueryProcessorSQLResultsQuery Router(via DRDA)TCP/IP64-bitIDS DatabaseInformix:Routes SQL queries to the AcceleratorUser need not change SQL or applicationsCan always run query in Informix if not acceleratedCompressedDB partitionLinux x86 64Bulk LoaderInformix Warehouse Accelerator:Connects to Informix via TCP/IPAnalizes, compresses and loads In-Memory a copy of (portion of) Informix warehouseProceses routed SQL queries with extraorinary speedReturns results/answer back to Informix/IDSInformix Warehouse Accelerator (IWA) transparentlyaccelerates Informix warehouse/analytic queries up to100 times or more! 2013 IBM Corporation

Informix 12.1IWA Technology Innovations provide:Extreme unparallel analytics speed for fast business decisions64 bit Intel/AMDPrcessorsCompresionTB ofRAM MemoriaNo Need forAggregate TablesNumber ofoccurrencesRow and Column StoreCommonValuesRareValuesIntelligent Frequence ParitioningSIMDPredicates Evaluationon Compressed Data 2013 IBM Corporation

Informix 12.1IWA: Breakthrough Technologies for Extreme PerformanceExtreme CompressionRow & Columnar DatabaseRequired because RAM is the limiting factor.Row format within IDS for transactional workloadsand columnar data access via accelerator forOLAP queries.Multi-core and VectorOptimized AlgorithmsIn Memory Database3rd7Avoiding locking or synchronization1625Predicate evaluation oncompressed datageneration database technology avoidsI/O. Compression allows huge databasesto be completely memory resident34Frequency PartitioningEnabler for the effective parallel access ofthe compressed data for scanning.Horizontal and Vertical PartitionElimination.Often scans w/o decompressionduring evaluationMassive ParallelismAll cores are used within used for queries14 2013 IBM Corporation

Informix 12.1How Fast is IWA?Columnar In-Memory Analytics with Unprecedented Performance15 2013 IBM Corporation 2013 IBM Corporation

Informix 12.1IBM Informix 12.10 editions:New Value-Added Software Bundles16 2013 IBM Corporation

Informix 12.1Informix Warehouse Accelerator (IWA)CUSTOMERS AND PARTNERS17 2013 IBM Corporation

Informix 12.1Some IWA Customers by Sector:Retail, Government, Transportation, E&U18 2013 IBM Corporation

Informix 12.1Some IWA Customers by Sector:Telecommunications, Insurance, Financial, IT Services19 2013 IBM Corporation

Informix 12.1Real-Life Productive IWAin Government Agency in LATAM20 2013 IBM Corporation

Informix 12.1IWA Architecture and Use (same Government Agency in LATAM)Sources/OLTPIDS 10.00 - 11.70.FCxAIX on pSeriesBI ToolsETL: Consolidate andaggregate data in IDS to latersource and build MSAS cubesETLReal-timeAnalyticsIWACubes built inMicrosoft (MSAS)IWA 11.70.FCxLinux x86 6437x to 456x faster !!21 2013 IBM Corporation

Informix 12.1Europe’s Largest Power company tackles the Smart Meter Big Datachallenge with Informix TimeSeries In-Memory Accelerator (IWA) E.ON Metering (EMTG) is the centre of excellence for the development andcommercialization of smart energy solutions and technologies and part of Europe’s largestPower and Gas company E.ON EMTG operates a sophisticated Smart Meter data infrastructure based on IBM InformixTimeSeries technology in combination with Informix In-Memory Warehouse Accelerator IBM Information Management products currently used:– Informix 11.70 Ultimate Warehouse Edition– Cognos Business Intelligence 1022 2013 IBM Corporation

Informix 12.1Some of our IWA Business Partners23 2013 IBM Corporation

Informix 12.1Informix Warehouse Accelerator (IWA)REFERENCE ARCHITECTURE& COMPETITION24 2013 IBM Corporation

IBMInformixPresentation12.1Template Full VersionCurrent Customer BI Architecture with InformixProd AData Mart 1Prod BProd CETLInformixDWETLData Mart 2BIData Mart 3Prod DSun T3SolarisIUE v11.50Prod EIntel serversMS WindowsMS SQLserverCubesIUE : Informix Ultimate EditionSource If Applicable25 2013 IBM Corporation

IBMInformixPresentation12.1Template Full VersionTarget Referenced Architecture with IWAProd AWarehouseAcceleratorProd BProd CProd DETLInformixDWBISun T3SolarisIUWE v11.70Prod EIUWE : Informix Ultimate Warehouse EditionSource If Applicable26 2013 IBM Corporation

Informix 12.1IWA’s Industry Positioning and CompetitorsDW ApplianceColumnar DatabaseDataAllegro (Microsoft)CalpontExasolInfobrightParAccelSand TechnologyVertica (HP)Sybase IQ (SAP)DataupiaGreenplum (EMC)KognitoNetezza (IBM)In-Memory OLAP ToolsQlikTech/QlikViewApplix TM-1 (IBM-Cognos)Exalytics (Oracle)PALO27In-Memory DataWarehouseHANA (SAP)IWA (IBM) 2013 IBM Corporation

Informix 12.1Informix Warehouse Accelerator (IWA)ROADMAP & NEW FEATURES28 2013 IBM Corporation

Informix 12.1IBM Informix Warehouse/Analytics Present Roadmap201120122013Informix 11.70.xC2Informix 11.70.xC5Informix 11.70.xC7 IWA 1st Release On SMP Partition Refresh Load from Secondary Solaris on Intel Partition Refresh Load from Secondary node in Cluster Solaris on IntelInformix 11.70.xC6Informix 12.10.xC1 Partition Refresh Load from Secondary Solaris on Intel Bundled Cognos BI & SPSS Automatic incremental refresh Trickle feed (continuous refresh) Accelerate new SQL & OLAP queries Admin IWA using OAT & built-in functions Right/Real-Time In-Memory Analytics Big Data on Sensor data (TimeSeries IWA)Informix 11.70.xC3 Workload Analysis Tool More Locales Data CurrencyInformix 11.70.xC4 IGWE IWA on Blade Server Informix 12.10.xC2 Coming soon 2013 IBM Corporation

Informix 12.1Summary: Key Value Propositions for the InformixMarket State-of-the-art query accelerator for current OLTP customers Ideal for an embedded database in a single machine environment Leverage partner-based solutions & sales Fully compatible with existing Informix architecture Deploy in HA configurations Integration with OAT Ideal for SMB Commodity based hardware, configurable memory size, noexpensive interconnect required Low cost entry, scaling via cluster Appliance not always a fit Seamless integration with TimeSeries for Big Machine data 2013 IBM Corporation

Informix 12.1Informix 12.10: Simply Powerful28 2013 IBM Corporation