Transcription
#TC18Hot, Hotter, HyperHow to Handle Big DataMarius KaiserErwin van LaarSolution ConsultantTeam Lead, Product ConsultancyTableauTableau
Session Overview
#TC18Hot, Hotter, HyperHow to Handle Big DataMarius KaiserErwin van LaarSolution ConsultantTeam Lead, Product ConsultingTableauTableau
#TC18Hot, Hotter, HyperHow to Handle Big DataMarius KaiserErwin van LaarSolution ConsultantTeam Lead, Product ConsultingTableauTableau
Introduction
Marius KaiserErwin van LaarSolution Consultant, TableauTeam Lead, Product Consultancy, Tableau
What is Big Data anyway?VolumeVelocityVariety
What is Big Data?
What is Big Data?
People
Agenda Tableau’s Big Data Focus Hyper Big Data Framework Practical Example Summary
Tableau’s Big Data Focus
Big Data FocusConnectivityPerformanceDiscoveryAccess to alldataFastinteractionwith all dataFinding theright data
Hybrid Data Strategy A combination of in-memory and live query engines Designed for adaptability and flexibility Unified user experience for full range of data stores
Live Query Engine Supports the world’s largestdatabases Attaches directly to enterprisedata stores Pushes down workload Leverage your Big adoopFastdatabases
In-Memory Engine Extremely fastcomputationalability Fast performancewith large data sets Optionallyaggregate databefore extractingData Extract API& Web Data ConnectorDatawarehousesHadoopFastdatabases
HyperFast analysis on data of all sizes*Hyper replaces TDE in all of our products
ScalabilityHyper’s parallelism fullyutilizes large amounts ofcores ( 120)
HyperKey benefits Up to 5x faster query performance with large or complex datasets Fresher data with up to 3x faster extract creation Support for larger extracts
Caution! It’s not the WIN Button!
Data Strategy Selection of Technology Align Technology to BusinessUse and Data What questions do we wantto answer?
cloud-netflix-original-64442
Big Data FrameworkHot, Warm, Cold
PerformanceData Size
STOREANALYZESPEED UPCONSUME
Let me introduce Air Tableau
Air Tableau New, technology driven airline Data of hundreds of millions of flights and their performanceGoals Analyse the data and identify gaps Monitor Flights performance going forward - Performant Dashboards for everyone!
Cold - Store
Flights Performance Data in the Data LakeAmazonS3
STOREANALYZESPEED UPCONSUMEAmazonS3AnalystData Scientist
The Data LakeSQLFilesHDFS
Hive is too slow for InteractivityFiles
Warm - Analyze
Faster ways to query the Data LakeFiles
Hive is too slow for Interactivity
STOREANALYZEAmazonAthenaAmazonS3SPEED UPCONSUME
Hot - Let’s Speed It Up
STOREANALYZESPEED UPAmazonRedshiftAmazonAthenaAmazonS3CONSUME
Leverage TableauSecret weaponsAggregated ExtractsPrep
SW#1 Aggregated, Optimized ExtractsPre-aggregateOptimizeAdvantage:Same results, vastly es
SW#2: Prep
Human Scale of DataYearYearQuarterQuarterMonthMonthWeekWeekDayRaw Data
Consume
STOREANALYZESPEED IT ngData Science
Leverage TableauSecret weapons:Aggregated ExtractsPrepCross-Datasource ActionsHybrid Data Strategy
Leverage TableauSecret weapons:Aggregated ExtractsPrepCross-Datasource ActionsHybrid Data Strategy
Human Scale of DataYearYearQuarterQuarterMonthMonthWeekWeekDayRaw Data
SW3: Cross-Datasource Raw Data
Questions?
Summary
Summary Big Data needs to be for the peopleTableau enables people to use Big DataTableau is a Leader in Big Data Analytics Tableau’s Hybrid Data Engine is a secret weapon!Tableau enables Big Data agilityUse the Hot, Warm, Cold framework
Over to you! Use the Hot, Warm, Cold framework Remember Tableau’s Secret Weapons Aggregated ExtractsPrepCross-Data Source ActionsHybrid Data Strategy
ConclusionTableau is great for Big DataUse the right technology for the rightuse case
R E L AT E D S E S S I O N SAdvancing your big data strategyDay Time – Time LocationExpedia Big data self-service analyticswith Tableau and AWSDay Time – Time Location
Please complete thesession survey from theSession Details screenin your TC18 app
Thank you!Marius KaiserErwin van Laarmkaiser@tableau.comevanlaar@tableau.com
Tableau #TC18 Erwin van Laar Team Lead, Product Consultancy Tableau. Session Overview. . Hadoop Hadoop Fast databases Data warehou ses Data warehouses. In-Memory Engine . aggregate data before extracting Data Extract API & Web Data Connector Hadoop Fast databases Data warehouses. Hyper F
