Transcription
Update on Happenings inInternet2 Network ServicesProgress in evolving to a next generation R&E network for USResearchersDale Finkelson and Matt ZekauskasNetwork Services, Internet2April 21, 2020
AgendaWelcome:Intros / WelcomeNGI UpdateService Model2020 SAACCMeeting[2]
WHAT IS THE INTERNET2 NEXTGENERATION INFRASTRUCTUREPROGRAM ?The Next Generation Infrastructure Program is a full set of activities to review and update theservices, value and supporting technology of the Internet2 infrastructure portfolio (andrelationships in the larger ecosystem)–––Includes the services and service models through which the community adopts Internet2 infrastructure servicesIncludes a number of infrastructure upgrade projectsIncludes new features, primarily driven by software, automation and systems virtualization to allow the infrastructure to be morereadily integrated into the broader campus, regional and cloud environment around us.[3]
5 Solutions R&E Value Support the Data Intensive Researcher Support Software Driven Infrastructure Support Cloud for Research & Administration Readily Enable Ecosystem-Wide Solutions Reset Economics for Scale[ 4[ 4] ]
How we think about the NGI Work Effort / Where are we now?Listen Service Model Optical Packet Orchestration (service) TelemetryDefineIdeatePrototype& ShowImplementProcurement& Prototyping[5]
Cloud Services & Rapid Private Interconnect (RPI) Cloud Connect - national resilient footprint for: AWS Direct Connect (Hosted Interconnect 500Mbps) Support for Jumbo Frames Google Dedicated Interconnect Microsoft Azure Express Route Automated Cloud Connect Portal Provides API-based provisioning at Layer2 & Layer3 RPI – incremental 10G and 100G portsrapidly provided at the 7 peering points perfSONAR support for the cloud[6]
Internet2 Cloud Connect StatsCloud ProviderSubscribers(Campus)58Regional ProvidersMicrosoft Express Route7015Google DedicatedInterconnect94AWS Direct ConnectThere are an additional 75 Subscribers in the Queue17As of 1/22/20[7]
Peering & Cloud Capacity AugmentsInternet2 Network Total PetaBytesCarried Per Year (Calendar Year)6,000I2-PX Peering Capacity2019980 Gbps20203110 GbpsR² 1.8575.4694.51099.61294.91836.82108.94,000CY 08CY 09CY 10CY 11CY 12CY 13CY 14CY 15CY 16CY 17CY 18CY 19YTD 20CY 21CY 22CY 23CY 240Peta Bytes per yearPoly . (Peta Bytes per y ear)[8]
Services PortfolioWhat we have done: Lifted “caps” on I2PX Increased peering capacity New Cloud Connect PortalFeatures Pre-provisioning vlans & OESS accountsa key enabler for rapid deploymentBetter coordinate training & relatedmaterials for operators and users Secure Routing of our networksand membersQoS / 10G support / new GUIFinish MANRS across communityLayer 2 & 3 VPN’s on demandAccelerate Routing Registry ActivitiesJumbo Frames for AWS What we can do: Improve cloud-connect workflowBeginning to Introduce I2-RUSHesports peersMANRS Office Hours More office hours, staffdevelopment in software,automation, telemetry, securityInvestigate a “last resort” internetoption in platform package[9]
INFRASTRUCTURE IMPROVEMENTS[ 10 ]
What’s new in Protocol? We’re moving towards Simple – Scalable – SeamlessUnified Forwarding – Traffic Engineering –On Demand Next Hop – Failure Protection –Service ChainingStandards-Based (MP-BGP) control plane toadvertise MAC or IP addresses & vlan tagReplaces/Simplified MPLS L2 TunnelsOpportunities for some future L3 services as well[ 11 ]
OESS / Cloud Connect Portal Features Additions Up to 10G for AWS, Google, Azure Jumbo frames for AWS Transition to new UI for L2 and L3completed Ready for Trusted Identity integrationsoon. Allow self-provisioning of users withinworkgroups.[ 12 ]
Telemetry - Community thZKafkaTIERAuthNAuthZMessage buspub/subInternet2Portal/DashboardsUtah / Penn State Prototype – Others strongly encouraged to ”opt in”
Open Science Grid / Internet2 Collaborationexpands with new 100G science data cachesLeveraging the OSG HTC stack and cloudpeering adjacency to enable useMinneapolisEugeneAlbanyBostonBoiseNew amentoSalt Lake CityDenverSV1/5Kansas CityIndianapolisAshburnWashington DCCincinnatiSt. LouisLouisvilleSan Louis IbsiboRaleighLas VegasLos AngelesNashvilleTulsaSan DiegoCharlotteMemphisAlbuquerque1 WilshireAtlantaJacksonTucsonEl Paso& 56 tonBaton RougeTallahasseeNew OrleansSan AntonioNew 100G backbone nodes coming online: Kansas City (Thanks GPN!)SunnyvaleChicagoNew YorkHoustonAmsterdam - soon (Thanks SURF!)[ 14] ][ 14
ICECUBE / Open Science GridDemonstrate Massive Cloud Burst forMulti-messenger astronomy at SC’19Internet2 assisted staging/moving 26 TB of data to providersOn demand for 2 hours: GPU’s equivalent to 90% of thecapacity of the largest supercomputer in the world3 Continents3 Cloud Providers51,000 GPU’s350 petaflops capacity26 TB moved2 Hours[ 15] ][ 15
NGI Optical UpgradeProgram HighlightsSeattle7 Nationwide Upgrade of Optical Kit–Olympia/Lacy77PortlandOpen Line SystemFiber upgradedoutside of project7Eugene–Flex Grid ( 100 Ghz channels)7Albany Upgrading to SMF28 ULTRA Fiber–On most paths / some new hutsNew York 111 8th48RenoEureka JunctionSunnyvaleU244SacramentoSalt Lake City44New 400-800G transponders for Internet2backbone circuitsSan Luis lsaLos Angeles1010Approximately 2.75m/yr in savings resulting from “upgrade”Phoenix10TucsonBirmingham551299No roll pairAtlantaJackson12El PasoImplementation underwayDallas12AustinROADM555Houston I-45San AntonioorFiber Segment EndpointorOptical Installation Phase Boundary (ROADM or DGFF)Intermediate City (no optical add/drop facilities)1Phase 9MemphisAlbuquergueNilandWashington DC3Kansas CityPueblo66Mobile6Baton RougeHouston Hardy95Pensacola6Tallahassee6New OrleansPhiladelphiaAshburn9St. Louis3New York 32 AoAFrederick3Las VegasSan Diego New RouteCincinnati1210Substantially greener profile (space, power)–4DenverPittsburghBaltimore9Goodland4 aOmaha?U1Rawlins8 Cheyenne?11Detroit350 n3SyracuseBoiseTionestaJacksonville
NGI Packet UpdatePacket RFP responses receivedCommunity/Staff Evaluation underway Protocol Support Hardware Form Factors/Power Security/Telemetry/etc TCO 5/8 Years PartnershipTestbed and / or field Testing likelyAlso:New Secure Management Network being deployed with OpticalResponsesReceived
Simplify operations,coordination and serviceactivities across Atlantic andPacific Exchange Points Initiative of PacificWaveand Internet2 to moreclosely align operations,capabilities and servicesat MANLAN, WIX andPacificWave Includes dedicated 100GInterconnect and sharedbackup paths Upcoming activitiesinclude:– Develop a shared portal– Upgrade perfSONARinfrastructure[ 18 ]US-IX Collaboration
rtfordNew YorkDetroitChicagoInternet2 & Partners awarded“Spirit of Innovation Award” at sburghSacramentoBaltimoreAshburnSalt Lake CityIndianapolisDenverKansas CityWashington DCCincinnatiSt. LouisLouisvilleLouis IbsiboRaleighLas VegasLos AngelesNashvilleCharlotteTulsaMemphis for the collaboration delivering over2Tbps of capacity and a “first in R&E”400G link from Chicago to Denver.San DiegoAtlantaPhoenixJacksonTucsonEl PasoInfoMartMobileDallasJacksonvilleAustinBaton RougeTallahasseeNew OrleansHoustonSan Antonio[ 19] ][ 19
THANK YOU!An enormous communityeffort across manycollaborations is showingprogress and promise![ [2020] ]
[ 6] Cloud Services & Rapid Private Interconnect (RPI) Cloud Connect -national resilient footprint for: AWS Direct Connect (Hosted Interconnect 500Mbps) Support for Jumbo Frames Google Dedicated Interconnect Microsoft Azure Express Route Automated Cloud Connect Portal Provides API-based provisioning at Layer2 & Layer3 RPI -incremental 10G and 100G ports
