Transcription
Bring Location Analysis to YourBig Data Workloads Using OracleBig Data Spatial and GraphBig Data Showcase TheaterJean IhmDavid LappOracle Spatial and Graph TechnologiesSeptember 2016Copyright 2016, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal/Restricted/Highly Restricted
Agenda1Why Location Analysis for Big Data2Use Cases3Features4DemoCopyright 2016 Oracle and/or its affiliates. All rights reserved. Oracle Confidential – Internal2
Spatial Analysis – It is about relationships Are things in the same location? Who is thenearest? What tax zone is this in? Wherecan we deliver in 35 minutes? What isin my sales territory?flood zone?Is this built in aCopyright 2016 Oracle and/or its affiliates. All rights reserved.
Motivation for Oracle Big Data SpatialEmergence of Hadoop for spatial analysis inbusiness and spatial workflowsExisting Hadoop-based Spatial technologies areGeospatial-centric, not Application-centricNo significant commercial offeringsCopyright ffiliates.AllAllrightsrightsreserved.reserved. Copyright
Big Data ChallengesRequires more development resourcesand data scientistsBuild your own environmentfrom commodity hardware andopen source software.Copyright ffiliates.AllAllrightsrightsreserved.reserved. Copyright
Big Data SolutionMake developers and datascientists more productiveOptimized, pre-configuredBig Data Appliance and CloudplatformsPre-built, parallel,MapReduce and SparkSpatial AlgorithmsRaster and Vectorprocessing FrameworksBig DataCopyright ffiliates.AllAllrightsrightsreserved.reserved. Copyright
Oracle BI EE Data VisualizationA Complete Big Data PortfolioOracle Big DataDiscoveryOracle DataIntegratorOracle GoldenGateOracle Big DataPreparationBIG DATAINTEGRATIONOracle Big Data Spatialand GraphBIG DATAANALYTICSOracle Advanced AnalyticsCREATE VALUEFROM DATAOracle Data-as-a-ServiceOracle ApplicationsOracle Big Data SQLOracle Big DataConnectorsOracle NoSQLDatabaseBIG DATAMANAGEMENTBIG DATAINFRASTRUCTUREOracle Big Data ApplianceOracle Big Data CloudOracle Public CloudCopyright ffiliates.AllAllrightsrightsreserved.reserved. Copyright
Oracle Big Data Spatial and GraphCopyright ffiliates.AllAllrightsrightsreserved.reserved. Copyright
Data Harmonization:: Linking information by locationAre these data points related? Tweet: sailing by #goldengate Instagram image subtitle: 골든게이트 교* Text message: Driving on 101 North , just reached borderbetween Marin County and San Francisco County GPS Sensor: N 37 49′11″ W 122 28′44″ Now find all data points around Golden Gate Bridge .* Golden Gate Bridge (in Korean)Copyright 2016 Oracle and/or its affiliates. All rights reserved.
Use Case: Linking Information by LocationInsurance IndustryActuarial and AccidentDemographic data dataCall data CustomerdataEnrich withPostal CodeCategorize by RegionData Products for Rate StructuresUnderwriting/Risk Analysis86%88%Of Insurancecompanies agreethat analyzingmultiple datasources together is crucial tomaking accurate predictionsAgree that linkinginformation bylocation is key tocombining disparate sources ofBig DataSource: “The big data: How data analytics can yield underwriting gold.”Survey conducted by Ordnance Survey and Chartered Insurance Institute, 25 April 2013.Copyright ffiliates.AllAllrightsrightsreserved.reserved. Copyright
GeoSocial Analysis Use Cases: “Nearest Friends”“It’s 11:30. Want to meet Jon, Melli, andAlbert for lunch @Milano’s today atNoon?”URGENCY WITH LIMITED AVAILABILITY:Lunch promotion to targeted potential “table of4” who know each other within 1 km.“Great seats @ Cinema 18 for 7:30 show ofnew Avengers movie tonite. Free popcornand soft drink for you and Mary. Text herat 555-1234.”TIME CONSTRAINED: Target people within 20minute drive 30 minutes before the show.“We know you and your old collegebuddies love Elton John. Get together withTom, Dick and Hari and the rest of the fratnext month.”BROADER SOCIAL REACH; WIDER DISTANCE. NOTIME CONSTRAINT: Concert promotion.Copyright ffiliates.AllAllrightsrightsreserved.reserved. Copyright
What problems can Big Data Spatial analysis address?Data Harmonization usingany location attribute(address, postal code,lat/long, placename, etc).Preparation, validation andcleansing of Spatial andRaster dataCategorization and filteringbased on location andproximityVisualizing and displayingresults on a mapSpatial querying andanalysis of Hadoop datawith SQLCopyright ffiliates.AllAllrightsrightsreserved.reserved. Copyright
What features does Big Data Spatial have?MapReduce routines fordistance calculations,PointInPolygon, buffercreation, Categorization,KMeansClustering, BinningData enrichment service APIusing GeoNames andgeometry hierarchy dataSpatial processing of datastored in HDFS or NoSQL.Raster processing operations:Mosaic and sub-setoperations. Geodetic andCartesian dataHTML5 Map VisualizationAPIHive SQL APIQuery from Oracle DB withBig Data SQL & Oracle SQLConnectors for HadoopCopyright 2016 Oracle and/or its affiliates. All rights reserved.
DemoDiscovering location patterns in social media andglobal incidentsUsing Big Data Spatial Analytics and Big Data DiscoveryCopyright 2016 Oracle and/or its affiliates. All rights reserved. Oracle Confidential – Internal16
SummaryOracle Big Data Spatial and Graph Commercial, supported software Componentry to boost efficiency of data scientists and developers – savetime on custom development Bring location context to big data – harmonize and offer new insight intocustomers, assets, organizations Extend existing Big Data applications, complement relational environments Oracle Big Data Spatial and Graph offers– Dozens of built-in algorithms/enrichment services, and map visualization– Scaleable storage and parallel processing on Hadoop /Oracle NoSQL– Runs on commodity hardware or BDA, both on-premise or in the CloudCopyright 2016 Oracle and/or its affiliates. All rights reserved. 17
Big Data Spatial and Graph at OOW 2016View this list at http://bit.ly/FODSpatialGraph, http://bitly.com/2bRrLpbDate/TimeTitleLocation8:30 a.m. - 10:30 a.m.Building a Java Recommender System in 15 Minuteswith Graph Technologies [TUT5289]Parc 55 - Cyril Magnin II/III4:15 p.m. - 5:00 p.m.Graph and Link Analysis: Discovering NetworkRelationships in Big Data [CON6445]Park Central - Olympic4:00 p.m. - 6:00 p.m.Apply Location Intelligence and Spatial Analysisto Big Data with Java -- Hands On Lab [HOL6255]Hilton - Franciscan RoomC/D1:00 p.m. – 1:20 p.m.Bring Graph Analysis to Relational and Hadoop Data [THT7821]Moscone South ExhibitionHall - Big Data Theater4:00 p.m. – 5:00 p.m.High-Speed Video and Image Processing with Java andHadoop [CON5543]Parc 55 - Mission6:15 p.m. - 7:00 p.m.Meet the Experts: Oracle’s Big Data ManagementSystem [MTE7224]Moscone South - 3067:15 p.m. - 8:00 p.m.Meet the Experts: Spatial and Graph Technologiesfor Database, Big Data, and the CloudMoscone South - 306Monday, Sept 19Tuesday, Sept 20Copyright 2016 Oracle and/or its affiliates. All rights reserved.
Big Data Spatial and Graph at OOW 2016View this list at http://bit.ly/FODSpatialGraph, d Applications on Spark, Hadoop, and NoSQL withOracle Big Data Spatial and Graph [CON6585]Park Central - OlympicThursday, Sept 2210:45 a.m. - 11:30 a.mShowcase Theater PresentationsDate/TimeTitleLocationTuesday, Sep 201:00 - 1:20 p.m.Bring Graph Analysis to Relational and Hadoop DataWednesday, Sep 211:00-1:20 p.m.High Speed Video and Image Processing Using Oracle BigData PlatformWednesday, Sep 212:30 - 2:50 p.m.Bring Location Analysis to Your Big Data Workloads UsingSpatialBig Data Showcase TheaterBig Data Showcase TheaterBig Data Showcase TheaterCopyright 2016 Oracle and/or its affiliates. All rights reserved.
Big Data Spatial and Graph at OOW 2016View this list at http://bit.ly/FODSpatialGraph, nMonday - WednesdayOracle’s Spatial Technologies forDatabase, Big Data, and the CloudMoscone South Exhibition Hall – 101Oracle Database Showcase (left side)Monday - WednesdayOracle’s Graph Database and Analytics forDatabase, Big Data, and the CloudMoscone South Exhibition Hall– 101Oracle Database Showcase (left side)Monday - WednesdayDiscover and Analyze Relationships withOracle Big Data Spatial and GraphMoscone South Exhibition HallBig Data Showcase (SBD-016)PartnersDate/TimeTitleLocationMonday – WednesdayTom Sawyer SoftwareMoscone South Exhibition Hall - Booth #436Monday – WednesdayDataNinja (DocomoInnovations)Moscone South Exhibition Hall - Booth #1741Monday – WednesdayinterRel ConsultingMoscone South Exhibition Hall - Booth #3208Copyright 2016 Oracle and/or its affiliates. All rights reserved.
Upcoming Events Oracle Spatial Summit at BIWA 2017Oracle HQ, Redwood Shores, CAJan. 31-Feb. 2, 2017www.biwasummit.org*Call for speakers now open!Copyright 2016 Oracle and/or its affiliates. All rights reserved. 21
Resources Oracle Big Data Spatial and Graph OTN product technologies/bigdata-spatialandgraph– White papers, software downloads, documentation and videos Oracle Big Data Lite Virtual Machine - a free sandbox to get a-appliance/oracle-bigdatalite-2104726.html Hands On Lab for Big Data Spatial: tinyurl.com/BDSG-HOL Blog – examples, tips & tricks: blogs.oracle.com/bigdataspatialgraph @OracleBigData, @SpatialHannes, @JeanIhmOracle Spatial and Graph GroupCopyright 2016 Oracle and/or its affiliates. All rights reserved. 22
Q&ACopyright 2016 Oracle and/or its affiliates. All rights reserved.
Discovery Oracle Big Data Spatial and Graph Oracle Advanced Analytics Oracle Big Data Appliance Oracle Big Data Cloud Oracle Public Cloud . -White papers, software downloads, documentation and videos Oracle Big Data Lite Virtual Machine - a free sandbox to get started:
