Transcription
OpenXREcosystem UpdateBringing to Life theDream of Portable Native XRJuly 2020This work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 1
Khronos Standards for XRCreate and deploy 3Dassets and scenesVision and sensor processing,inferencing accelerationHigh-performance,low-latency 3D GraphicsPortable access tonative XR runtimesThis work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 2
OpenXR Ecosystem UpdatesKhronos open sources conformance tests and launches Adopters ProgramFirst officially conformant runtimes shipping from Microsoft and OculusPreview implementations from Valve, Varjo and CollaboraHand and eye tracking cross-vendor extensions for advanced UIOpenXR being used by key games and open source softwareMinecraft! Blender! WebXR!Virtual RealityNow is the time for applicationdevelopers to leverage OpenXRfor widespread deployment!VAAugmented RealityThis work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 3
XR PortabilityXR App/ExperienceXR App/ExperienceGameEngineXR App/ExperienceWebXRApplication InterfaceAndMore!OpenXR provides cross-platform, high-performance accessdirectly into XR device runtimes across multiple platformsThis work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 4
Widespread Industry SupportCompanies publicly supporting OpenXROpenXR is a collaborative design that integrates many lessons from proprietary‘first-generation’ XR APIs to create a new generation API with cutting-edgecapabilities and a flexible, extensible, future-proof architectureThis work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 5
Broadening OpenXR 1.0 AvailabilityOpenXR 1.0 Adopter Program ReleasedEnable Officially Conformant ImplementationsSignificant CommunityFeedbackImproved Input subsystemGame engine editor supportLoader and Layers ProvisionalSpecificationGDC, March 2019Conformant OpenXR 1.0 for WindowsMixed Reality headsets and HoloLens 2PLUS extensions to support HoloLens 2 hand tracking,eye tracking, spatial mapping and spatial anchorsConformant OpenXR 1.0 for Oculus Rift and QuestSDK Oculus PC SDK & Android SDK V19 include OpenXR native C/C developmentDevelopers can now submit their OpenXR apps to the Oculus StoreValve OpenXR 1.0 Developer PreviewNew SteamVR features will ship through OpenXR, rather than OpenVRRatify and ReleaseOpenXR 1.0SIGGRAPH, July 2019‘Monado’ OpenXR 1.0 open source implementationSupports variety of HMDs, including Project Northstar AR HMDVarjo OpenXR 1.0 Developer PreviewFor Varjo headsetsOpenXR 1.0 plugin for Unreal Engine v4.2.5Enhanced support for late stage reprojection, mixed reality capture froma 3rd person camera view, optimized rendering by up to 2ms/frameHand and eye tracking cross-vendor extensions for advanced UIShipping on HoloLens 2. Ultraleap hand tracking developer previewThis work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 6
First Conformant OpenXR DevicesOpenXRImplementerUse tests to pen sourceConformance TestsContribute test fixesand enhancementsTestResultsReviewSubmit Test ResultsA conformant OpenXR can use theOpenXR logo and has patentprotection under the Khronos ptersWebsiteOpenXRWorkingGroupTest Results Approved.Khronos grantsTrademark and Patent LicenseConformant DevicesOculus Rift SOculusQuestThis work is licensed under a Creative Commons Attribution 4.0 International LicenseHoloLens 2Windows MixedReality Headsets The Khronos Group Inc. 2020 - Page 7
OpenXR Architecture FlexibilityVROculus QuestARVRWindows Mixed RealityMicrosoftHoloLens 2All In OneThis work is licensed under a Creative Commons Attribution 4.0 International LicenseOculus Rift STethered The Khronos Group Inc. 2020 - Page 8
Advanced UI Cross-Vendor OpenXR ExtensionsDevelopers can build cross-platform applications that useadvanced UI solutions from different technology vendorsOpenXR API layers can be used implement extensionsHand TrackingEye Tracking26 unique joints per hand for fullyarticulated hands visible to the userEye gaze interaction for intuitive interfaces2-Step InteractionHand-eye coordinationNatural aimingShipping on HoloLens 2and Microsoft Hand Mesh Extensionfor HoloLens 2 layers over itUltraleap developer preview availableThis work is licensed under a Creative Commons Attribution 4.0 International LicenseShipping on HoloLens 2 The Khronos Group Inc. 2020 - Page 9
OpenXR and MinecraftMicrosoft is excited to announce thatMinecraft’s new RenderDragonrendering engine is building its desktopVR support using OpenXR!This work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 10
OpenXR and Open SourceMicrosoft open sourceOpenXR Samples forMixed Reality Developers,shows how to use OpenXRto access the fullcapabilities of HoloLens 2Blender 2.83 integrates OpenXR to deliver native VRscene inspection capabilitiesThis work is licensed under a Creative Commons Attribution 4.0 International LicenseGoogle Chromium 81 uses OpenXR as itsdefault backend for WebXR, enabling GoogleChrome and Microsoft Edge browsers to useany OpenXR-compatible hardware The Khronos Group Inc. 2020 - Page 11
OpenXR is used with a 3D APIApplication or EngineHigh-performance, low-latency3D rendering and composition*MultiviewContext priorityFront buffer renderingTiled rendering (beam racing)Variable rate renderingDisplay,composition andoptical correctionparameters* OpenXR can be used with other 3D APIssuch as Direct3D, OpenGL and OpenGL ESThis work is licensed under a Creative Commons Attribution 4.0 International LicenseCross-platform access to XRHMDs and sensorsXR application lifecycleInput device discovery and eventsSensor tracking and pose calculationFrame timing and display compositionHaptics ControlOpenXR is strongly influenced by Vulkan with ashared spec toolchain and support for API layers.OpenXR is a “lower-frequency” API than Vulkanand is a much smaller spec The Khronos Group Inc. 2020 - Page 12
Bringing XR to the WebNative XR AppsWeb XR AppsLifting OpenXRfunctionality intothe Web stackNative 3DEnginesClose cooperationbetween WebXRand OpenXRWeb 3DEnginesKhronos provides thefoundation for nativeand Web-based 3D/XRThis work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 13
Structure of an OpenXR App Get started- Create an Instance- Choose extensions, layers, bind to graphics API Find out where/how to run- Get HMD characteristics - mono/stereo, form factor etc. Set up interaction/input handles- Bind physical inputs to actionsgrab object, teleport etc. Prepare your immersive experience- Create Session- Create Swapchain to drive the display/user/hand/left/input/a/click(/interaction profile/ControllerCorp/fancy controller/input/a/click)OpenXR TeleportXrAction: “Teleport” Participate in the frame loop- Handle input and haptics- Manage swapchain to driveimagery to the display- Poll for eventsThis work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 14
Cloud XR with 5G and OpenXROpenXR will enable ARapplications to run portablyon edge server architecturesLow latencySensor DataSignificant industryeffort in developingthis use caseRuntime using 5G implementedacross device and server andaccessed through OpenXR APISensor handlingDisplay compositionWireless mobile devicewith display and sensorsGeneratedAugmentations &ScenesThis work is licensed under a Creative Commons Attribution 4.0 International LicenseMEC (Multi-access EdgeComputing) Server1. Processes sensor data, can includemachine learning for environmentallighting, occlusion, scene semantics,object reconstruction and UI2. Generates imagery from 3Dmodels, can include stereo, fovealrendering, ray-tracing, optics predistortion, varifocal processing The Khronos Group Inc. 2020 - Page 15
OpenXR Win-Win-WinXR End-UsersCan run the apps they want ontheir system – reducing marketconfusion and increasingconsumer confidenceXR VendorsCan bring moreapplications onto theirplatform by leveragingthe OpenXR contentecosystemNow is the time for applicationdevelopers to leverage OpenXR forwidespread application deployment!www.khronos.org/openxr/XR ISVsCan easily ship on moreplatforms for increasedmarket reachThis work is licensed under a Creative Commons Attribution 4.0 International License The Khronos Group Inc. 2020 - Page 16
Android SDKV19 include OpenXR native C/C development . First Conformant OpenXR Devices. Use tests to aid development. OpenXR. Open source. Conformance Tests . OpenXR. Adopters. Website . Contribute test fixes and enhancements. Submit Test Results. Test Results Approved. Khronos grants. Trademark and Patent License. OpenXR.
