Lecture @DHBW: Data Warehouse - DHBW Stuttgart

Transcription

Lecture @DHBW: Data Warehouse00 Course introAndreas BuckenhoferEin Unternehmen der Daimler AG

Contact/ConnectAndreas BuckenhoferSenior DB ProfessionalSince 2009 at Daimler TSSDepartment: Machine Learning SolutionsBusiness Unit: AnalyticsxingDOAGDHBWvcard Over 20 years experience with Oracle ACE Associatedatabase technologies DOAG responsible for InMemory DB Over 20 years experience with Data Lecturer at DHBWDaimler TSS GmbHWarehousing CertifiedData Vault Practitioner 2.0Wilhelm-Runge-Straße 11, 89081 Ulm / Telefon 49 731 505-06 / Fax 49 731 505-6599tss@daimler.com/ Internet: www.daimler-tss.com Internationalproject experience Certified Oracle ProfessionalSitz und Registergericht: Ulm / HRB-Nr.: 3844 / Geschäftsführung: Martin Haselbach (Vorsitzender), Steffen Bäuerle Certified IBM Big Data Architect Daimler TSS I Template Revision

We make Daimler themost innovativemobility provider.We don‘t build cars, but we designinnovative, holistic IT solutions forDaimler.

MobilityDigital ProductionStaying agile with newmobility conceptsCreating optimum production processeswith continuous data analysisCyber SecurityDigital VehicleCreating customized, holisticsolutions for IT securityDesigning reliable softwaredevelopment for a sophisticatedautonomous driving experienceDaimler TSSSales & CareStrategic InitiativesEnabling brilliant customer journeysthrough customer interaction andmeasurable customer proximityDeveloping new topics and ideas as well asemerging technologies for Daimler4

Integrated, innovativeand always close tothe issue.Methodological expertise and solutionscoupled with technological excellence and amaximum degree of security are ourspecialties.Acutely aware of this special position oftrust, we bear responsibility through marketleading IT solutions for the success andfuture of a globally active group.Driven by innovative ideas, we alwaysventure across borders to find the bestsolutions and generate impressive results.Daimler TSS

4 locations / 1203 employees*:Our Locations &Project HubsDaimler TSSDUlm (Headquarters), Stuttgart, Berlin, KarlsruheKLProject hub Kuala LumpurCHProject hub China*As of January 20196

We attach greatimportance to bothhuman and digitalnetworking.Passion for IT and a still veryintimate start-up culture unite us inthese endeavors, ensuring a senseof community and creative freedomin everyday working life.

About youWho are you?-Knowledge or experience:DatabasesSQLDWHBig DataYour expectations?Daimler TSSData Warehouse / DHBW8

DWH Lecture – topics with learning targets Understand the importance of a data-driven cultureKnow tools relevant for DWH and Big DataName DB technologies and techniques that are well-suited for DWHsDescribe different DWH and Big Data architectures in detailExplain DWH data modeling (physical models)Explain Data integration/engineering (ETL) processesUnderstand Streaming technologiesSpecify visualization & metadata & security & PM requirementsName current DWH and Big Data trendsDaimler TSSData Warehouse / DHBW9

OLTPMap deoSensorsGeospatialDaimler TSSGraph ModelsDaimler TSSMDMCubeData MartVirtualizationFile Formats(SQL) EnginesCloudApplianceODSStagingData ManagementStar SchemaTextReal timeMicro BatchCleansing3NFData VaultMobileBatchData ickstreamDocumentsSocial MediaData FlowLoggingMPPRDBMSError HandlingReportingDashboardingSearchData MiningData LakeLambdaData HubCore Warehouse SDData InfrastructureOn rddiskAnalyticsSchedulingMonitoringData SecurityGDPRData QualityDomain ModelInformation DesignLawEthicsData GovernanceGlossaryMetadataAutomationProject ManagementStreamingData CatalogLogsData elf ServiceData Warehouse / DHBW10

Many employment opportunitiesDWH department in every (bigger) end user company, also in manymedium-sized or small-sized companiesDWH department in every (bigger) consulting companyDWH-only specialized consulting companiesDWH tool vendorsDaimler TSSData Warehouse / DHBW11

Many employment opportunities – challenging JOBrequirementsDWHs are complex, much more complex compared to most OLTP systemsChallenging job profiles with comprehensive requirements Data Architecture Data Integration / ETL Data Modeling (not only 3NF) Data Visualization Data Quality Data Security Requirements Engineering Project ManagementDaimler TSSData Warehouse / DHBW12

Job description examplesDaimler TSSData Warehouse / DHBW13

Job description examplesDaimler TSSData Warehouse / DHBW14

About the lecture 36 semester periods per week (Semesterwochenstunden) Structure of the lecture Review of the preceding lecture Presentation of content with (group) tasks Group exercise ExamDaimler TSS 1h Questions in GermanData Warehouse / DHBW15

Course material Download slides fromhttp://wwwlehre.dhbw-stuttgart.de/ buckenhofer/Daimler TSSData Warehouse / DHBW16

Course contact Who is the class representative? Do you have a class email address? Daimler TSSPlease send me an email so that I have your contact dataData Warehouse / DHBW17

LiteratureDaimler TSSData Warehouse / DHBW18

de/slidesandpapers/Tutorial/SDM slides.pdfDaimler TSSData Warehouse / DHBW19

FinallyQuestions?Any timeDaimler TSSFeedbackAfter lecture or byemailData Warehouse / DHBW20

Daimler TSS GmbHWilhelm-Runge-Straße 11, 89081 Ulm / Telefon 49 731 505-06 / Fax 49 731 505-65 99tss@daimler.com / Internet: www.daimler-tss.comSitz und Registergericht: Ulm / HRB-Nr.: 3844 / Geschäftsführung: Martin Haselbach (Vorsitzender), Steffen Bäuerle Daimler TSS I Template Revision

Daimler TSS Data Warehouse / DHBW 9 DWH Lecture -topics with learning targets Understand the importance of a data-driven culture Know tools relevant for DWH and Big Data Name DB technologies and techniques that are well-suited for DWHs Describe different DWH and Big Data architectures in detail Explain DWH data modeling (physical models)