RDP300 - Real-Time Data Warehousing With SAP .

2y ago

129 Views

1 Downloads

5.13 MB

36 Pages

Report/dmca

Download PDF

Transcription

RDP300 - Real-Time Data Warehousing with SAPNetWeaver Business Warehouse 7.40October 2013

DisclaimerThis presentation outlines our general product direction and should not be relied on in making apurchase decision. This presentation is not subject to your license agreement or any other agreementwith SAP. SAP has no obligation to pursue any course of business outlined in this presentation or todevelop or release any functionality mentioned in this presentation. This presentation and SAP'sstrategy and possible future developments are subject to change and may be changed by SAP at anytime for any reason without notice. This document is provided without a warranty of any kind, eitherexpress or implied, including but not limited to, the implied warranties of merchantability, fitness for aparticular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in thisdocument, except if such damages were caused by SAP intentionally or grossly negligent. 2013 SAP AG or an SAP affiliate company. All rights reserved.2

Session AbstractReal-Time Data Warehousing with SAP NetWeaver BusinessWarehouse BW 7.40This lecture will outline best practices, tips, and tricks for a successful enterprise data warehouseimplementation for SAP NetWeaver Business Warehouse (SAP NetWeaver BW) in regards toreal-time aspects for data provisioning and agility aspects during design time. Key learningpoints of this session will include understanding the available set of functions and capabilities for anagile and real-time data warehouse implementation scenario for SAP NetWeaver BW. You will learnwhich tools you will have to use in the best way. This session will include system demos and anoutlook to SAP's strategy for the SAP HANA enterprise data warehouse. 2013 SAP AG or an SAP affiliate company. All rights reserved.3

BW 7.4 – OverviewPlanned with BW 7.4, SP5/SP6 on HANAEnhanced Data Modeling New overall reference Architecture LSA BW/HANA Smart Data Access providing the logicalEDWBW Queries, ODATA, MDX, SQL Easy integration of external data models withOpen ODS Layer Composite Provider for enhanced support of“Mixed Scenarios” Common Eclipse based Modeling environmentBW Virtual Datamart LayerArchitected DatamartLayerTransformationsPush down further processing logic to HANAEDW LayerTransformationsOpen Operational DataStore LayerHANA tables, views(Field based) DSOBW SchemaHANA SchemaAgileDatamartsBWWorkspaces BW Analytic Manager HANA Analysis Processes BW TransformationsNew class of Data Provisioning BW enhancements for Operational DataProvisioning (ODP) and Operational DeltaQueue(ODQ) PSA layer obsolete during Data Acquisition Simplified SLT handling in BWExternal Sources 2013 SAP AG or an SAP affiliate company. All rights reserved.4

BW 7.4 – Real-time Data Warehousing AspectsPlanned with BW 7.4, SP5/SP6 on HANAEnhanced Business Flexibility byproviding “the logical EDW”Real-time Data AccessBW Queries, ODATA, MDX, SQL Direct Data Access across different sourcesystems Direct Meta Data Access during design time forfield based modellingBW Virtual Datamart LayerArchitected DatamartLayerLightweight Evolution options intostaging scenarios for the EDW layerTransformationsEDW LayerTransformationsOpen Operational DataStore LayerHANA tables, views(Field based) DSOBW SchemaHANA SchemaAgileDatamartsBWWorkspaces BW enhancements for Operational DataProvisioning (ODP) and Operational DeltaQueue(ODQ) Real-time Staging Scenarios Reduced latency Reduced footprint (PSA obsolete) RDA Real-time Data Acquisition improved bychange notification Direct Delta from SAPI-Extractors Real-time Replication into BW via SLTExternal Sources 2013 SAP AG or an SAP affiliate company. All rights reserved.5

Real-time DWH - Virtual Access vs. Persistent StagingOverviewVirtual AccessPersistent StagingQueryQueryLegendpersistentOpen ODS LayerOpen ODS LayerOpen ODS ViewOpen ODS ViewField based DSOvirtualreadBW onHANABW onHANADataSourceDB/Virtual TableODP DataSourceDTP w/o PSAreplicateSAPI/DBConnect DS, SDAOperational Delta Queue(ODQ), SLT, SAPITable / ViewTableOpen ODS View as the very modeling object ofthe Open ODS Layer allows direct access via DataSources, DB tables or views,and HANA Virtual Tables (Smart Data Access – SDA) Acts as InfoProvider and can be part ofCompositeProvidersOperational Delta Queue (ODQ) as part of ODPcovers the main services offered by the PSAtoday DTP runs with full set of options directly against ODP/ODQwithout PSA layer (InfoPackages) Recovery in case of DSO load issues can be achieved ondata packet level Monitoring the PSA replaced by monitoring the ODQ (TAODQMON) Recovery for more than latest delta loadTableERP / BW / HANA / anyDB* Source System 2013 SAP AG or an SAP affiliate company. All rights reserved.6

BW 7.4 – New Options to realize real-time Data WarehousingScenarios covered in this lectureSourceERPDirect Access Open ODS View(SAPI)Type: SAPI DataSourcesReal-time Staging Field Based DSO derived fromOpen ODS View SAP HANAanyDB*HANA Schema (e.g.COPA Accelerator)HANA instance (e.g. HANAApplication) Open ODS ViewType: SAP HanaTable/ViewOpen ODS ViewType: Smart DataAccessData Staging via ODQ/RDA(SAPI ODP DataSource) Field Based DSO derived fromOpen ODS View ODP DataSources withInfoPackage and DTP(SLT ODQ-Replication)Open ODS View DB Connect/SAP HANA Smart Data Access 2013 SAP AG or an SAP affiliate company. All rights reserved.7

1. BW 7.4 Real-time DWH Aspects for SAP ERP Sources1. Direct Access1.Open ODS Views2.ServiceAPI DataSources2. Persistent Staging1.Field based DSO derived out of Open ODS View2.Operational Data Provisioning (ODP) Framework / Operational Delta Queue (ODQ)2. BW 7.4 Direct Access to HANA DB3. BW 7.4 Real-time Staging for HANA DB4. Summary

Flexible consumption of external data modelsPlanned with SAP BW 7.4, SP5 on HANAFlexible and easy consumption of external datamodels building a BW Open ODS Layer usingfield-based modelingBW Queries, ODATA, MDX, SQLConsume & combine external data models forBW Virtualization Layer Direct query access (w/o replication) Staging scenarios Switch between both optionsArchitected Data MartLayerAgile modeling Field based modeling via Open ODS View and DSO(with fields *) Complementing InfoObject modelingTransformationsEDW Core LayerTransformationsOpen Operational DataStore LayerHANA tables, viewsDataStore ObjectsBW SchemaHANA SchemaExternal Sources 2013 SAP AG or an SAP affiliate company. All rights reserved.AgileData MartsBWWorkspaces Integrate with existing BW models Gradually build up models and architectures based onrelational schemas Possibility to start modeling from facts developingtowards the dimensions Enables rapid prototyping – quick ROIDirect query access Integrated with BW authorization concept Combine with existing InfoObjects / DSOs* Pilot only(Note 1922533)9

Open ODS View – Direct Access to SAP ERP Data from BWAvailable with BW 7.4, SP5/SP6 on HANAVirtual AccessQueryOpen ODS LayerOpen ODS ViewDataSourceBW onHANASAPI/ODP-DataSources / ExtractorsTableERMTableERP Source System 2013 SAP AG or an SAP affiliate company. All rights reserved.Open ODS View offers Metadata object as abstraction layer for underlying sourceobject HANA virtual tables as supported source objects via SDA Querying on field level Supported for Teradata, Sybase ASE/IQ, Hadoop Optimized Query execution by pushing down to HANA Supported scenarios:- Virtual Access- Persistent Access *o Switch from Virtual to Persistent *o The possibility to generate structure identical Fieldbased DSO including DTP and Transformationo Direct staging into DSO bypassing PSAo No need to adjust existing queriesEasy assignment of semantics Underlying object (Table, DB View, DataSource) can betagged as Text, Master data or Facts Single fields of the object can be linked to already existingOpen ODS Views or InfoObjects* Pilot only(Note 1922533)10

Given SAP ERP Business Content DataSource with Direct AccessExample: Financials - Customer Balances (0FI AR 20)BCT DataSource 2013 SAP AG or an SAP affiliate company. All rights reserved.1.ODP Source System –SAP Extractors2.DataSource3.Fields4.Extractor Capabilities11

Create Open ODS ViewNew Metadata object as abstraction layer for underlying DataSourceCreate Open ODSView 2013 SAP AG or an SAP affiliate company. All rights reserved.1.Name2.Semantics3.Type4.Source System5.DataSource12

Open ODS View – Field List and proposed view categorizationCreate Proposal forOpen ODS View 2013 SAP AG or an SAP affiliate company. All rights reserved. Arrange Source Fieldswith view structure forSemantic Facts Preview Option forQuery given13

1. BW 7.4 Real-time DWH Aspects for SAP ERP Sources1. Direct Access1.Open ODS Views2.ODP DataSources2. Persistent Staging1.Operational Data Provisioning (ODP) Framework2.Operational Delta Queue (ODQ)2. BW 7.4 Direct Access to HANA DB3. BW 7.4 Real-time Staging for HANA DB

HANA BW – Operational Data Provisioning (ODP) InfrastructurePlanned with BW 7.4, SP5/SP6 on HANASubscriber /ConsumerProviderSLTBO DataServicesSAP ERP ExtractorsOperationalDataProvisioningODQTarget BWHANA ViewsSource BW 2013 SAP AG or an SAP affiliate company. All rights reserved.Unified infrastructure for data provisioningand consumption Enables extract once deploy many architecturesfor sources Unified configuration and monitoring for allprovider and subscriber types Time stamp based recovery mechanism for allprovider types with configurable data retentionperiods Highly efficient compression enables datacompression rates up to 90% in Operational DeltaQueue (ODQ) Quality of service: „Exactly Once in Order“ for allproviders Intelligent parallelization options for subscribers inhigh volume scenariosEmbedded Analytics18

Simplified data provisioning from SAP ERP and SAP BWPlanned with BW 7.4, SP5/SP6 on HANAProvider ERP Extractors DTP w/o PSADSOSAP BWProvider BW SAP BWODP DataSource Operational Delta Queue (ODQ)Extractor(BW SAPI DataSources) DTP w/o PSADSOODP DataSourceInfoCubeOperationalDelta QueueMasterDataERMEnables direct staging between InfoProviders of sourceand target BW systemsPSA not requiredConsumption of ODQ by multiple BW subscribers and SAPData ServicesBenefitsSLT TableDirect Update to BW InfoProviders – PSA not required Scheduled or real – time daemon Automatic change notification for daemonConsumption by multiple subscribersTableSAP ERP Sources 2013 SAP AG or an SAP affiliate company. All rights reserved. Simplified data flowPSA no longer requiredFlexible recovery optionsStream lined system communication Synchroneous RFC replaces ALE/IDoc20

Evolution from Direct Access into Persistent StagingAvailable with BW 7.4, SP5/SP6 on HANAPersistent StagingQueryOpen ODS LayerOpen ODS ViewField based DSODTP w/o PSAODP DataSourceBW onHANAOpenODS Layer Supports the evolution from view based - to alightweight persistence base mode– The possibility to generate structure identicalField based DSO including DTP andTransformation– No InfoObject creation necessary– No need to adapt query Querying on field level possible Optimized Query execution by pushing down to HANA Switch to persistence in case of harmonization needs(quality of source), semantical transformations, datalookups Query keeps stable if no incompatible changesOperational Delta Queue (ODQ)SAPI/ODP DataSources / ExtractorsERMTableTableERP Source System 2013 SAP AG or an SAP affiliate company. All rights reserved.22

1. BW 7.4 Real-time DWH Aspects for SAP ERP Sources2. BW 7.4 Direct Access to HANA DB1. Direct Access to HANA Schema on BW2. Direct Access to separate HANA DB3. BW 7.4 Real-time Staging for HANA DB

BW 7.4 – Flexible consumption of external data modelsPlanned with BW 7.4, SP5/SP6 on HANAFlexible and easy consumption of external datamodels building a BW Open ODS LayerBW Queries, ODATA, MDX, SQLAgile modelingBW Virtual Datamart Layer Integrate external data models for– direct query access– staging scenarios– switch between both options Field based modeling complementing InfoObjectmodeling Integrate with existing BW models Gradually build up models and architectures based onrelational schemas Possibility to start modeling from facts developing towardsthe dimensions Enables fast prototyping – quick ROIImmediate light weight querying Integrated with BW authorization conceptAccelerated Loads 2013 SAP AG or an SAP affiliate company. All rights reserved.Architected DatamartLayerTransformationsEDW LayerTransformationsAgileDatamartsBWWorkspacesOpen Operational DataStore LayerHANA tables, viewsHANA Schema(Field based) DSOBW SchemaExternal Sources24

Smart Data AccessPlanned with BW 7.4, SP5/SP6 on HANAEnhanced Business Flexibility byproviding “the logical EDW”QueryData Federation in diverse EDW landscapesBW on HANA Smart data access – read access to relational andnon-relational sources via ODBC Enables access to remote data access just like“local” table Supports data location agnostic development No special syntax to access heterogeneous datasources Non-disruptive evolution BW based Analytic Services on external dataBW Virtualization LayerComposite Provider, Open

Real-Time Data Warehousing with SAP NetWeaver Business Warehouse BW 7.40 This lecture will outline best practices, tips, and tricks for a successful enterprise data warehouse implementation for SAP NetWeaver Business Warehouse (SAP NetWeaver BW) in regards to real-time aspects for data provisioning and agility aspects during design time. Key learning