WIXLIB

Changes to Near Real-time ProductGeneration and DistributionGeof GoodrumGeoffrey.P.Goodrum@noaa.govNOAA/NESDIS Office of Satellite Ground ServicesWith content from Solers, Inc., ESPDS PMO and OSPOSustain Enable Create –OSGS11

Operations TodayS-NPP,GCOM-W1SvalbardJPSS CGS IDPSBlock 1.2NPP Data Exploitation (NDE)IngestProduct GenerationProduct DistributionProduct ManagementProduct Distribution:- S-NPP xDRs- NESDIS Unique Products (NUPs)- Tailored Products- GCOM-W L1/L2 ProductsProduct andAncillaryData FilesNDE StorageSDRs, TDRs, EDRsEnvironmental Satellite Processing Center(ESPC)Ancillary DataGCOM-W1 L1B (via NASA)ESPC DataDistributionServices (DDS)2NASA VIIRS ImageExternal/Internal UsersArchive – CLASS (NUPs only)Sustain Enable Create –OSGS22

Operations in Block 2.0Svalbard/Fairbanks/McMurdoJPSS CGS IDPSBlock 2.0S-NPP,JPSS-1/2,GCOM-W1Environmental Satellite Processing and Distribution System(ESPDS) Common Infrastructure PlatformRDRs, SDRs, TDRs, EDRsIngestProduct GenerationProduct ManagementProducts File AvailabilityNotifications:- S-NPP/JPSS xDRs- NESDIS Unique Products (NUPs)- Tailored Products- GCOM-W L1/L2 ProductsProduct andAncillaryData FilesAncillary Data FileAvailabilityNotificationsProduct Distribution (PD) ServicesProduct Distribution to ConsumersAncillary Data AcquisitionProduct andAncillaryData FilesEnterprise Shared StorageProduct Generation (PG) Services(NDE 2.0)3NASA VIIRS ImageExternal/Internal UsersArchive – CLASS (NUPs only)Sustain Enable Create –OSGS33

Product Generation (PG) NPP Data Exploitation (NDE) in operations since July 2014 and has beendistributing critical S-NPP data since soon after launch (November 2011) Established and mature process for efficiently transitioning new andupdated science algorithms from the NOAA Center for SatellitesApplications and Research (STAR) - in place since 2011 Well defined, documented, and simple interface for modular algorithmintegration allowing for a repeatable process and small integration team Data agnostic, execute algorithms for any platform/instrument (“algorithmas a service” concept) NDE 2.0 provides an Enterprise Product Generation (PG) frameworkimplemented within the ESPDS common infrastructure platform Established solution for product generation for S-NPP, JPSS-1/2, GCOM-W1,and can be leveraged for other NOAA or non-NOAA missionsSustain Enable Create –OSGS44

NOAA PG Transition toOperations Process1Define Requirements (JPSS Level 1)2Develop Algorithm Preliminary Design Review Critical Design Review Unit Test Readiness Review System (Algorithm) Readiness Review3Prepare Delivered Algorithm Package (DAP) for each Science Algorithm for delivery to NDE Algorithm Delivery Standards, Integration, and Test (DAP document acts as ICD) Configuration management of DAP45678Develop/test in NDE DEV Environment NDE operating system/compilers Science libraries VPN access Initial integration activitiesKEYOffice of Satellite and Product Operations (OSPO) performs software code reviewIntegrate DAP into NDE DEV Environment Configuration management Production rules Unit testingSystem Test Algorithm in NDE TESTEnvironment Full contention, live data flow Performance testingSTARDevelop Algorithm Enhancements, BugFixes, and Updates Redeliver DAPProductQualityValidationOSGSOSPOSatellite Products and Services Review Board (SPSRB) approves product for operationsGenerate Operational Product in NDE Production Environment Operations 24/7 MonitoringSustain Enable Create –OSGS55

NOAA Product umentNDE 1.0 OperationsStatusESPDS PG (NDE 2.0)Operations StatusMicrowave Integrated RetrievalSystem (MiRS)S-NPP/ATMSOperational 2014Operational 2016Advanced Clear-Sky Processorfor Oceans (ACSPO)S-NPP/VIIRSOperational 2014Operational 2016NOAA Unique CrIS/ATMSProcessing System (NUCAPS)S-NPP/CrISOperational 2014Operational 2016VIIRS Polar Winds (VPW)S-NPP/VIIRSOperational 2014Operational 2016Green Vegetation Fraction (GVF)S-NPP/VIIRSOperational 2014Operational 2016S-NPP Tropical CycloneS-NPP/ATMSOperational 2015Operational 2016Vegetation Health (VH)S-NPP/VIIRSOperational 2015Operational 2016GCOM-W1 AMSR2 AlgorithmSoftware Processor (GAASP)GCOM-W1/AMSR2Operational 2015Operational 2016Active Fires (AF)S-NPP/VIIRSOperational 2016Operational 2016Sustain Enable Create –OSGS66

ESPDS Product umentNDE 1.0 OperationsStatusESPDS PG (NDE 2.0)Operations StatusOMPS-Limb Profiler SDRS-NPP/OMPS-LPN/APost ORROMPS-Limb Profiler EDRS-NPP/OMPS-LPN/APost ORRJPSS Risk Reduction (Clouds,Aerosols, Cryosphere)S-NPP/VIIRSN/AOperational 2016GCOM-W1 AMSR2 SDRGCOM-W1/AMSR2N/AOperational 2016Sustain Enable Create –OSGS77

NDE Product GenerationOperational Science ApplicationsTotal Precipitable WaterSea Surface TemperatureMicrowave Integrated Retrieval System (MiRS)Advanced Clear-Sky Processor for Oceans (ACSPO)Sustain Enable Create –OSGS88

NDE Product GenerationOperational Science ApplicationsVIIRS IR ImageAWIPS2 NUCAPS Temperature/Moisture ProfilesNOAA Unique CrIS/ATMS Processing System (NUCAPS)Sustain Enable Create –OSGS99

NDE Product GenerationOperational Science ApplicationsGreen Vegetation Fraction (GVF)VIIRS Polar Winds (VPW)Sustain Enable Create –OSGS1010

NDE Product GenerationOperational Science ApplicationsVegetation Health (VH)Tropical Cyclones (TC)Sustain Enable Create –OSGS1111

NDE Product GenerationTailoringFilteringAggregationNDE VIIRSImageNDE ACSPO SSTRemappingResampling375 mNDE VIIRSRGB3 kmNDE VIIRSRGBNDE VIIRS RGBSustain Enable Create –OSGS1212

NDE Product GenerationTailoring (NWS AWIPS Alaska Region)Funny River Fire, AlaskaVIIRS I1 (Visible)VIIRS I3 (Fire)Sustain Enable Create –OSGS1313

NDE 2.0 Product GenerationOperational Science ApplicationsJPSS Risk Reduction ProductsCloudsSnow/IceAerosolsGCOM AMSR2 Day 2 ProductsWindsCloudsSoil MoistureSustain Enable Create –OSGS1414

Product Distribution (PD) Product Distribution and Access (PDA) provides an Enterprise ProductDistribution (PD) framework implemented within the ESPDS commoninfrastructure platform using virtual machines Initially supporting GOES-R, HRIT/EMWIN and JPSS Block 2.0, Legacy inplanning. Obtains and distributes ancillary data for NESDIS product generation Implements specialized services for NWS Advanced Weather InteractiveProcessing System (AWIPS) use only Implements additional security features required by Government policy X.509 certificate authentication via NOAA OCSP required for servers In-line malware scanning Secure file transfer protocols: ftps, sftp, https (NFSv4 with CLASS, GOES-R) Backup PG/PD site (Fairmont, WV) for distribution of JPSS primary sensorproducts only to selected data consumers Web-based portal allows data consumer management of OSPO-approveddata subscriptionsSustain Enable Create –OSGS1515

Data Access No change to the NESDIS data access request process Near Real-time Subject to Office of Satellite and Product Operations (OSPO) review Policy on Access and Distribution of Environmental Satellite Data andProducts .html Retrospective Available through the National Centers for Environmental Information(formerly known as NOAA National Data Centers) Subset of operational products are archived Comprehensive Large Array-data Stewardship System http://www.class.noaa.gov/ Caveat: CLASS delays delivery of xDRs by 4 hours for completeness. NUPs inCLASS are near real-time products that use initial delivery xDRs as input.Sustain Enable Create –OSGS1616

OSPO Timeline(subject to change)Sustain Enable Create –OSGS1717

Questions?Sustain Enable Create –OSGS1818

NASA VIIRS Image . Environmental Satellite Processing and Distribution System (ESPDS) Common Infrastructure Platform . Product Distribution (PD) Services . Product Distribution to Consumers . Ancillary Data Acquisition . Enterprise Shared Storage. Product and Ancillary Data Files Product and Ancillary Data Files External/Internal Users