Transcription
IceCube A-333 Fieldwork PlansKael Hanson and the IceCube M&O TeamIceCube Management and OperationsNSF Field Work Planning March 18, 2020
Outline The IceCube detector online systems. Remote operation needs for / benefits of 24/7 medium B/W satellite(Iridium NEXT) Detector maintenance activities Scintillator / surface / ARA detectors Description of field seasons Gen2 preparations – see Albrecht’s presentationNSF Site Visit IceCube M&O2
The IceCube DetectorNSF Field Planning 2021-2026 IceCube M&O3
Online Systems Overview (J. Kelley)NSF Site Visit IceCube M&O4
IceCube Live / IceCube Remote Access IceCube online systems designed to be as autonomous as possible tofacilitate remote operation. Continuous automatic monitors of data flow / automatic crash detection Automatic recovery from many serious hardware failure modes possible Winter-over paging / detector ops team alerts automated. Login via ssh to Linux (most developers use this channel) IceCube Live: South Pole near-real-time mirror in North Status dashboard – what is currently going on? Are there problems? Database of historical detector metadata Detector monitoring tool Run info (good/bad/etc); individual channel historical info including channelhardware issues; history of alerts; weather information; much more .NSF Field Planning 2021-2026 IceCube M&O5
NSF Site Visit IceCube M&O6
Detector monitoringexample fromrecent runNSF Site Visit IceCube M&O7
IceCube Detector Uptime FractionKPP for IceCube. Blueline typically 99.8%represents fraction oftime some (usuallymost) of IceCube online.Green line indicatesfraction of perfect 100%online run time.NSF Field Planning 2021-2026 IceCube M&O8
Field Maintenance Activities ofthe IceCube DetectorDaily Monthly YearlyNSF Site Visit IceCube M&O9
Inside the ICLNSF Site Visit IceCube M&O10
Implications of 24/7, medium B/W Satellite 24/7 internet connectivity limited to 2.4 kbit/sec/modem Iridium link. Makes rapid development / debugging from North nearly impossible. Faster 24/7 link could reduce required population at Pole DAQ development / maintenance / WO training Detector calibration runs (e.g., flasher runs) Perhaps other science groups would also be able to reduce pop overall significant station population reduction Other, beneficial side effects: IceCube Live becomes even more live /w/ richer more interactive content Easier communications with Winter-Over operators.NSF Field Planning 2021-2026 IceCube M&O11
Ancillary IceCube DetectorElementsScintillators, ARA, Surface RadioNSF Field Planning 2021-2026 IceCube M&O12
Scintillators and Cosmic Ray Radio 2014 support contractor ceasedsnow maintenance aroundIceTop tanks. Agreement tomitigate snow coverage byinstallation of scintillators. Snow accumulation leads toincreased energy threshold andgreater systematic errors forIceTop cosmic ray vetoperformance.NSF Field Planning 2021-2026 IceCube M&O13
Scintillator Installation Plan Map at left shows installation plan. Plan has changed – no installation ofnew equipment in 20/21 season. Otherseasons rolled into next cycle of IceCubeM&O and stretched out over moreseasons to alleviate logistics.NSF Field Planning 2021-2026 IceCube M&O14
ARA Station Maintenance As of 2019 IceCube M&O has subsumed operations of the 5 Askar’yanRadio Array (ARA) stations in de minimis fashion. In description of field seasons that follow, there is no dedicated cargonor personnel for ARA maintenance activities, rather rolled into somecombination of Winter-Overs and/or DAQ/Engineering.NSF Field Planning 2021-2026 IceCube M&O15
Field Season 2020-2021IceCube (333)Types/items of fieldworkWork ItemnumberEnter here what is absolutely needed (in black) for the subject season, "good to beaccomplished" (in blue), or what the project envisions (in red - even not yet fundedactivtities)123456Southbound cargo projectionWeight (lbs)Cubic FeetAustral summer season FY 2021 (2020-2021)3550384WinteroversComputing and hub maintenanceCalibrationDAQ / Engineering supportScintillator / radio maintenanceIceACT maintenance20001501501000250128323212864Projected Population Profie (max per day in a half-month)Nov 1-15 Nov 16-30 Dec 1-15 Dec 16-31Jan 1-15 Jan 16-31 Feb 1-15457767221211123112311222131311Minimal M&O season – scintillator plan to deploy 4 stations cut to maintenance of 1 station. Retro /cleanup of major computing lifecycle replacement in 19/20 season.NSF Site Visit IceCube M&O16
Field Season 2021-2022IceCube (333)Types/items of fieldworkWork ItemnumberEnter here what is absolutely needed (in black) for the subject season, "good to beaccomplished" (in blue), or what the project envisions (in red - even not yet fundedactivtities)Austral summer season FY 2022 (2021-2022)12345678WinteroversComputing and hub maintenanceCalibrationDAQ / Engineering supportM&O Upgrade supportScintillator installationRadio installationIceACT maintenanceSouthbound cargo projectionWeight (lbs)Cubic 314064Projected Population Profie (max per day in a half-month)Nov 1-15 Nov 16-30 Dec 1-15 Dec 16-31Jan 1-15 Jan 16-31 Feb : Scintillator station installation Minor ICL infrastructure upgrade to support integration of Upgrade instrumentationNSF Site Visit IceCube M&O17
Field Season 2022-2023IceCube (333)Types/items of fieldworkWork ItemnumberEnter here what is absolutely needed (in black) for the subject season, "good to beaccomplished" (in blue), or what the project envisions (in red - even not yet fundedactivtities)12345Southbound cargo projectionWeight (lbs)Cubic FeetAustral summer season FY 2023 (2022-2023)4300384WinteroversComputing and hub maintenanceCalibrationDAQ / Engineering supportM&O Upgrade support3500150150500256323264Projected Population Profie (max per day in a half-month)Nov 1-15 Nov 16-30 Dec 1-15 Dec 16-31Jan 1-15 Jan 16-31 Feb 1-1557777722121212222111313113113113M&O activities cut to bare minimum to provide room for Upgrade population which is at maximumduring this season for drilling and Upgrade string installation.NSF Site Visit IceCube M&O18
Field Season 2023-2024IceCube (333)Types/items of fieldworkWork ItemnumberEnter here what is absolutely needed (in black) for the subject season, "good to beaccomplished" (in blue), or what the project envisions (in red - even not yet fundedactivtities)12345678Southbound cargo projectionWeight (lbs)Cubic FeetAustral summer season FY 2024 (2023-2024)229001212WinteroversComputing and hub maintenanceCalibrationDAQ / Engineering supportScintillator installationRadio installationIceACT maintenanceDOMHub 64Projected Population Profie (max per day in a half-month)Nov 1-15 Nov 16-30 Dec 1-15 Dec 16-31Jan 1-15 Jan 16-31 Feb : Begin major upgrade of IceCube readout computers (some in operation for 20 years!) Calibration runs / data processing for new calibration instrumentation installed in Upgrade. Scintillator installNSF Field Planning 2021-2026 IceCube M&O19
Field Season 2024-2025IceCube (333)Types/items of fieldworkWork ItemnumberEnter here what is absolutely needed (in black) for the subject season, "good to beaccomplished" (in blue), or what the project envisions (in red - even not yet fundedactivtities)123456789Southbound cargo projectionWeight (lbs)Cubic FeetAustral summer season FY 2025 (2024-2025)3586921535WinteroversComputing and hub maintenanceCalibrationDAQ / Engineering supportScintillator installationRadio installationIceACT maintenanceDOMHub replacementGen2 Construction PS1 3237125264400Projected Population Profie (max per day in a half-month)Nov 1-15 Nov 16-30 Dec 1-15 Dec 16-31Jan 1-15 Jan 16-31 Feb 41122010Activities: Finish hub upgrade Scintillator install Gen2 pre-season #1NSF Field Planning 2021-2026 IceCube M&O20
Minor ICL infrastructure upgrade to support integration of Upgrade instrumentation: Field Season 2022-2023 NSF Site Visit IceCube M&O 18 IceCube (333) Types/items of fieldwork . Calibration runs / data processing for new calibration instrumentation installed in Upgrade. Scintillator install: Field Season 2024-2025
