NSIDC Distributed Active Archive Center (DAAC) Update

Transcription

NSIDC Distributed ActiveArchive Center (DAAC) UpdateUWG 2015 Annual Meeting

Outline OverviewSetting DAAC prioritiesFocus Areas for 2015Highlights and key accomplishmentsData Center moveLooking aheadNSIDC Distributed Active Archive Center

What we do NASA NSIDC DAAC is responsible for maintaining andcurating cryospheric and related environmental datadatasets created from EOS satellites, NASA field andairborne campaigns, and other non-EOS data ensuring thatthese datasets are preserved, well-documented, accessibleand data quality and integrity are preserved.Data products and information Snow Sea Ice GlaciersNSIDC Distributed Active Archive Center Ice Sheets Soil Moisture Permafrost

Overview of Activities17.86%administra eit securitymission supportopera ons31.79%2.33%In our 3rd (option year 2) year of a five year contractNSIDC Distributed Active Archive Centeruser services

4.79%4.28% 2.21%3.84% 0.22%0.37% All remote sensing andin-situ dataLiaison with scienceand user communitiesScience support fordata usersData 28%NSIDC Distributed Active Archive tICESat-2Legacy DAAC DataMEaSUREs 2006MEaSUREs 2012MODISNimbusOpera on IceBridgePassive MicrowaveSMAPVIIRS

March 2015 – NSIDC data users6NSIDC Distributed Active Archive Center

Data ArchiveECS – EOSDIS Core SystemV0 – NSIDC heritage system7NSIDC Distributed Active Archive CenterTotal of 25.3 millionfiles in the archive

NASA EOSDIS components & initiatives Earthdata login – centralized and simplifiedmechanism for user registration and profilemanagement for all EOSDIS system components Common Metadata Repository (CMR) – newmetadata system merging all existing capabilities andmetadata from ECHO and GCMD Big Earth Data Initiative (BEDI) – NASA’s effort toimprove discovery, access and use of Earthobservations by broader communityNSIDC Distributed Active Archive Center

Other ESDIS and community activities Earthdata Search Client – a new client underdevelopment for discovering, searching, visualizing,and retrieving Earth science data Virtual Collections Cloud Services/High performance ComputingNSIDC Distributed Active Archive Center

Setting sNewdirectedprojectsNSIDCUWGGuidanceUser Servicesfeedback &ACSI resultsNew tatement of workDAAC review and directionESDIS review and eate tasksSet PrioritiesCreate WorkPlanDo work/reprioritizeDAACMGMT TeamDAAC ProductTeamsDAACMGMT TeamDAACMGMT TeamDAACTeamTechnicalService GroupFocus areas for the year NASA ESDIS Priorities Key mission milestones NASA CryospherePriorities Operations performance User community priorities UWG RecommendationsNSIDC Distributed Active Archive CenterWork Priorities Data operationsUser supportDevelopmentOutreachSustainment & evolutionScienceComm. GroupSoftware Dev.Group

Focus Areas for 2015Focus areas intended to guide work because they arepriorities within NASA ESDIS, have key milestones inthe year and/or align with DAAC strategic direction: SMAP mission support and data management Earthdata login implementation (CY2015) BEDI/OPeNDAP/GIBS project (FY2015/2016) Operation IceBridge support and OIB portal Data center UPS replacement or moveNSIDC Distributed Active Archive Center

Focus Areas – 2nd tier Common Metadata Repository (CMR) support DAAC Data Access and Services project (DAS) Virtual collection & Data analytics Increasing level of data science support- SMAP postdoc support- Passive microwave and sea ice productsNSIDC Distributed Active Archive Center

HIGHLIGHTS &ACCOMPLISHMENTSNSIDC Distributed Active Archive Center

SMAP launches Public release: SMAP L1A Radiometer TimeOrdered Parsed Telemetry SMAP L1B Radiometer HalfOrbit Time-Ordered BrightnessTemperatures SMAP L1C Radiometer HalfOrbit 36 km EASE-GridBrightness Temperatures Ingesting approx. 47 GB/dayNSIDC Distributed Active Archive Center

Operation IceBridge – ARISE campaign With many data providers usingMetGen and reformatting data toconform to NASA standards ECSfor data management ARISE campaign: data to NSIDC andASDC DAACs 2 new campaigns: ARISE and meltseason with focus on mid-seasonsnow and ice dynamicsCAMBOTNew FLIR imageryNASA LVISNSIDC Distributed Active Archive Center

Operation IceBridge – the portal development Development focused ondata products (rather thanflight lines)Flight linegranule browse image Driven by user feedback Enabled by “rich” metadata Exploring DropBox andGoogle-drive deliverymethod“Schwab socks”Data orderDigital Mapping System (DMS) exampleNSIDC Distributed Active Archive Center

Passive Microwave – code updateAdditions toice masksReducemissingdataaroundpoleCode updates to improve stabilityand maintenance, and providegreater consistency across multiplesea ice data setsNSIDC Distributed Active Archive Center

SOAC: added Sea Ice AgeNSIDC Distributed Active Archive Center

Accomplishments/highlights ICESat-2-Hosted 2 ATDB meetings-on-going testing with SIPS and EDOS using GridFTP transfer protocol MODIS Collection 6 Sea Ice reprocessing began on 19 Feb 2015 (data2000 to 2011) Migrating MEaSUREs data sets to ECS to access richer data services,easier for long term management- Improved self-describing metadata for snow and sea ice for GIS Nimbus 4 Image Dissector Camera System satellite data recovered &added to the timeline (spans April 1969 - Apr 1971) Our use of virtual machines and servers continues to bring greaterstability to core operations, and gain efficiencies in maintenance anddeployment of software applications In past year, average 515 user request each month & 91 notices forupdates to/releases of 129 data setsNSIDC Distributed Active Archive Center

NSIDC Data Center StudyProblem: Data center uninterruptible power supply (UPS) hasbeen in operations for 17 years and is nearing its end of lifein June 2016. Manufacturer no longer supportingmaintenance & repair. Challenges: Already at the weight limit of floor (limits solutions, growth) Costly to replace and maintain new unit ( 150K; 20k peryear) Requires some asbestos remediation (schedule and costrisk)What we’re doing: An alternative solution to move theNSIDC data center has costs advantage over replacing theUPS.20NSIDC Distributed Active Archive Center

LocationsCU Space Science Data CenterNSDIC21NSIDC Distributed Active Archive Center

Data Center Move - scheduleSchedule Evaluate costs and riskJan. to Apr. 2015 Preliminary decisionMay 2015 University agreements finalizedJuly 2015 Begin facility preparationAugust 2015 Readiness reviewNov. 2015 Non-ECS hardware moveJan. 2016 ECS hardware moveFeb. 2016NSIDC Distributed Active Archive Center

Looking Ahead SMAP release of higher-level data products ICESat-2 pre-launch preparation- Start of ground readiness testing- Data services/tools definition & development- Launch planned for late-2017 2 new OIB missions in Greenland and Antarctica Distribution of SNPP VIIRS snow and ice products- Expected Feb. 2016 for snow products Contingency plan for DMSP SSMIS F17 F19 JPSS J1 VIIRS snow products (launch 2nd QTR FY 2017? Other areas?NSIDC Distributed Active Archive Center

Earthdata login - centralized and simplified mechanism for user registration and profile management for all EOSDIS system components Common Metadata Repository (CMR) - new metadata system merging all existing capabilities and metadata from ECHO and GCMD Big Earth Data Initiative (BEDI) - NASA's effort to