Ethernet-Attached SSDs Brilliant Idea Or Storage Silliness? PDF Free Download

1y ago

18 Views

1 Downloads

2.46 MB

30 Pages

Report/dmca

Download PDF

Transcription

Ethernet-Attached SSDsBrilliant Idea or Storage Silliness?Live WebcastMarch 17, 202010:00 am PT

SNIA Legal NoticeThe material contained in this presentation is copyrighted by the SNIA unless otherwisenoted.Member companies and individual members may use this material in presentations andliterature under the following conditions:Any slide or slides used must be reproduced in their entirety without modificationThe SNIA must be acknowledged as the source of any material used in the body of any document containing materialfrom these presentations.This presentation is a project of the SNIA.Neither the author nor the presenter is an attorney and nothing in this presentation is intendedto be, or should be construed as legal advice or an opinion of counsel. If you need legaladvice or a legal opinion please contact your attorney.The information presented herein represents the author's personal opinion and currentunderstanding of the relevant issues involved. The author, the presenter, and the SNIA do notassume any responsibility or liability for damages arising out of any reliance on or use of thisinformation.NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK. 2020 Storage Networking Industry Association. All Rights Reserved.5

AgendaBrief history of storage access modelsBrief history of Ethernet as a storage networkNVMe over Ethernet to drive – opportunitiesDisaggregation & solution managementNVMe over Ethernet to drive – use casesNVMe over Ethernet to drive – challenges / work to be doneDebate: NVMe over Ethernet to drive:Next step in evolution or solution looking for a problem to solve 2020 Storage Networking Industry Association. All Rights Reserved.6

The Evolution of Storage NetworksDirect attached storage: Single host owns storageStorage Area Networks: Multiple hosts share storageAvoid “silos” of storage and enables storage efficienciesExamples include Fibre Channel & iSCSI storage networksBut require “Storage Controllers” to front storageHyperscale: DAS storage on commodity systemsSpecial software manages many hyperscale nodes in a solutionIndustry moving to NVMe / NVMe-oF technologyNow, systems AND devices on native Ethernet as a Storage Network 2020 Storage Networking Industry Association. All Rights Reserved.7

The Ethernet as a Storage NetworkInitially, just a transportEnd points performed all the storage services (iSCSI)Use of Ethernet matured: Specialized protocolsKey/value protocol to access data in mainframe contextObject protocol to access massive amounts of unstructured dataNow, NVMe over Ethernet: Storage in a queuing paradigmHigh performance / low latency / few or no processing blockagesNo longer gated by transaction paradigm (wait for ACK)Next step, NVMe over Ethernet to the driveRemoves “Storage Controller” processing blockage 2020 Storage Networking Industry Association. All Rights Reserved.8

NVMe over Fabrics (NVMe-oF)Sharing NVMe based storage across aNetworkBetter utilization: capacity, rack space, powerBetter scalability: management, fault isolationNVMe-oF standard at NVMe.org50 contributorsVersion 1.0 released in 2016Fabrics: Ethernet, InfiniBand, Fibre ChannelProducts now in the market from mostmajor storage system vendors 2020 Storage Networking Industry Association. All Rights Reserved.9

NVMe-oF Storage Targets TodaySystems terminate the NVMe-oFconnection and use PCIe based SSDsinternallySSDs behind an array/JBOF controllerPerformance LimitsSSD performance increasing fasterthan CPU NVMe-over-Ethernet-to-driveuse casesNIC performanceLatency - Store and ForwardarchitectureCost – CPU, SOC/rNICs, Switches,Memory don’t scale well to matchincreasing SSD performance 2020 Storage Networking Industry Association. All Rights Reserved.Scaling unit10

NVMe-oF Ethernet SSDsWith NVMe-oF termination on the driveitself, controller functionality is nowdistributedScaling point becomes a single drive in aninexpensive enclosureEnables eBOFs (Ethernet-attached BunchOf Flash)Small CPU forswitch OS &chassismanagementPower, cooling, SSDs, and an Ethernet SwitchDoes this make each drive moreexpensive?Maybe initially, but now customer buystheir “controller” incrementally, as neededfor new capacityEfficiencies of scale now are applied tocontroller functionalityLower cost/bandwidth and cost/IOPS 2020 Storage Networking Industry Association. All Rights Reserved.Scaling unit11

JBOF CPU/NIC Complex can be a BottleneckSSD throughputincreasing fasterthan networkbandwidthSSD throughputwill tripleNetwork speedonly doublesEthernet 2020 Storage Networking Industry Association. All Rights Reserved.

eSSDsDifferent eSSD designs todaySome will support multiple interfaces andprotocolsEthernet, PCIe, SAS, SATARoCE, TCP25/50GSFF-8639 connector 2020 Storage Networking Industry Association. All Rights Reserved.13

Use Case: Behind the ControllerScale storage capacity with large pools of disksMany NVMe SSDs in many enclosuresPCIe only scales so far and at JBOF incrementsUsing eSSDs allows much higher scalingStill hiding individual SSD management from usersData services in the storage controllers èvalue addOrchestration between hosts and large pools ofdisksWhole disks or slices of disks that provide massivepools effectivelyRobust data protection schemes / distributedsolution controllers 2020 Storage Networking Industry Association. All Rights Reserved.14

Use Case: Disaggregated SSDStorageToday: Arraycontroller handlesconversion fromNVMe-oF to PCIebased drivesWith eSSD:Ethernet drivesonly require anEthernet Switchand fit into aneBOF for powerand cooling 2020 Storage Networking Industry Association. All Rights Reserved.15

Use Case: DAS Capacity ExpansionToday:Server’s SAS controller hasexpansion port to externalSAS JBOFOr external PCIe port toNVMe JBOFJBOFNVMe(PCIe)ExpansionWith eSSD:Unlike SAS, it is difficult toextend PCIe, but easy toextend EthernetCost savings by removingSAS infrastructure from theServer 2020 Storage Networking Industry Association. All Rights et) 16

SNIA Native NVMe-oF DriveSpecificationDiscover and Configure: the drives, their interfaces, the speeds, themanagement capabilitiesConnectorsSome connectors may need to configure the PHY signals based on the type ofdrive interfaceSurvivability and mutual detection is importantPin-outsFor common connectors and form factorsNVMe-oF integrationDiscovery controllers / Admin controllersManagementThrough Ethernet/TCP for Datacenter-wide management 2020 Storage Networking Industry Association. All Rights Reserved.17

ManagementScale out orchestration of 10’s of thousands of drives possible byusing a RESTful API such as DTMF Redfish Redfish/SNIA Swordfish follow a principal that each elementreport it’s own management informationFollow links in higher level management directly to the drive’s managementendpointHTTP/TCP/Ethernet basedNVMe-oF Drive Interoperability ProfileMock up to startPush new models through Swordfish contributionsPublish Interoperability Profile at DMTFMap the profile to NVMe & NVMe-MI properties and actions 2020 Storage Networking Industry Association. All Rights Reserved.18

Data ServicesModern storage system controllers also implement dataservicesDedup, Compression, Replication, Encryption, etc.Data services software (SDS) can be run anywhere in thenetwork on commodity hardwareHyperscaler approach: roll your ownEnterprise approach: licensed softwareSome of these services are envisioned to move into drivesComputational Storage 2020 Storage Networking Industry Association. All Rights Reserved.20

Computational Storage FutureOpportunity to move the computational tasks to the datawhere it livesQueries and searches can be parallelized across multiple devicesBut limited if just offloading a single host (i.e. by PCIe)High likelihood that NVMe will be extended to accommodatethe Computational Storage functionsDistributing computational storage across the network viaEthernet allows it to be globally sharedPerhaps via CXL in the futureSNIA is a first mover in Computational Storage standards 2020 Storage Networking Industry Association. All Rights Reserved.21

But Wait Concerns?Where is the storage software?How do I provision the storage?Does my application need to be modified?Where is the data protection?ApplicationSwitch OSStorageManagementChassisManagementSSDManagement 2020 Storage Networking Industry Association. All Rights Reserved.23

eSSD Use Case is KeyBack-end scale-out: No problem!Features/management still on controllerDistributed storage software: Probably fineLarge, controlled and closed environmentStorage features distributed across many serversIdeal for key-value store or computational storageStandard enterprise storage: Not ready yet!Infrastructure not ready yet to consume eSSD safelySoftware to provision, manage, secure, and protect mustlive somewhere 2020 Storage Networking Industry Association. All Rights Reserved.24

Areas of DebateWhat are Pros/Cons of NVMe over Ethernet to the drive?Next logical step or just another experimentWhat are Pros/Cons of NVMe over Ethernet to the drivesolutions?Problems solved vs. inhibitorsUltimately, is this a pervasive or niche solution?What will be the “killer App” for NVMe over Ethernet to the driveSimply a better storage model, or needs computational storage,etc. to make sense? 2020 Storage Networking Industry Association. All Rights Reserved.26

SummaryEthernet as a storage network continues to matureNVMe over Ethernet continues to matureNVMe over Ethernet to drive offers new capabilitiesFlexibility, massive scaling, elimination of solution “choke” pointsNVMe over Ethernet to drive has some current challengesOrchestration, baseband drive functionsDebate over the vision vs actual customer valueFirst movers will clear the “fog” 2020 Storage Networking Industry Association. All Rights Reserved.27

SNIA Technical WorkObject Drive Technical Work Grouphttps://www.snia.org/object-drivesScalable Storage Management Technical Work Grouphttps://www.snia.org/tech activities/standards/curr standards/swordfishComputational Storage Technical Work Grouphttps://www.snia.org/computational 2020 Storage Networking Industry Association. All Rights Reserved.28

After This WebcastPlease rate this webcast and provide us with feedbackThis webcast and a PDF of the slides will be posted to theSNIA Networking Storage Forum (NSF) website and availableon-demand at www.snia.org/forums/nsf/knowledge/webcastsA full Q&A from this webcast, including answers to questionswe couldn't get to today, will be posted to the SNIA-NSF blog:sniansfblog.orgFollow us on Twitter @SNIANSF 2020 Storage Networking Industry Association. All Rights Reserved.29

But limited if just offloading a single host (i.e. by PCIe) High likelihood that NVMe will be extended to accommodate the Computational Storage functions Distributing computational storage across the network via Ethernet allows it to be globally shared Perhaps via CXL in the future SNIA is a first mover in Computational Storage standards 21