Transcription
Enabling the journey to the Hybrid Multi Cloud with StorageTechnologyAndy WallsIBM FellowCTO Flash StorageOld Geezer with lots of experience
Critical areas of Storage Design Focus for IBMHybrid Multi Cloudand AIDifferentiated FlashHigh and consistentperforming DataReduction QLC everywhere Accelerators forsoftware stacks SCM Exploitation NVMe End to Endand fabric leadership Virtualize in thePublic Cloud Spectrum Scale ContainerizeSimple, Simple, SimpleAI Empowered StorageDetermine the rightoptions instead ofasking IBM Storage Insights Best Practice Insights Simple to manage Simple everythingTroubleshoot toughnetwork issuesAnalysepatternsPerformanceDataPredict andprevent issuesSupportIntegrationBest PracticeInsightCapacityPlanning
It is a Hybrid MulticloudWorld85%Companies average5Private and Publiccloudsof companies operate aHybrid multicloud environmentMigrate from publiccloudSecurity,Performance,Cost,ControlIDC Survey91%of public cloud adopters useTprivatecloudinternal80%companies movedapplications ordata from PublicCloud in 2018IDC SurveyIDC; IBM IBV C-Suite Study; Rightscaleof98% ofcompanies will useHybridMulticloudsin three years§3
Hybrid and multicloud are the new normalUSD 438 billion in 2020USD 609 billion in 20202018–2020 CAGR 15%2018–2020 CAGR 18%PrivatecloudsPublic cloudsand SaaSDedicatedcloudsTraditional ITUSD 640 billion in 20202018–2020 CAGR -9%Movementbetween clouds73%Sources: IDC Cloud Forecast; BCG & McKinseypriorityconcernConnectivitybetween cloudsA real-world look at multicloud94%67%82%priorityconcernShare of enterprises using amix of cloud modelsShare of enterprises using morethan one public cloud providerConsistencyof management67%priorityconcern
Key customer value drivers that are driving cloud adoption in themarket1. BUSINESS TRANSFORMATION:SHIFT CLOUD STRATEGY FROM ‘UTILIZATION & COST2. APPLICATION MODERNIZATION:ADD CLOUD SERVICESIMPROVEMENTS’ TO ‘DELIVERING STRATEGIC BUSINESSTO EXISTING APPS4. BIG DATA: SHIFT & SCALE BIG DATA FROM5. SECURITY: THE MODERN DAYVALUE’ON-PREMISE TO CLOUD TO EXPLOIT HIGH VALUETECHNOLOGIES LIKE AI,IOT & BLOCKCHAINBUSINESS WORKPLACE CREATES A NEWSET OF SECURITY CONSTRAINTS FORTHE HERITAGE DATA CENTER3. IT OPTIMIZATION:OPTIMIZE THE IT THAT CUSTOMERS OWN& RUN6. ECOSYSTEM: GAIN ACCESS TOECOSYSTEMS WHERE DATA, APPS,SERVICES, AND IPCAN BE EXPANDED, LEVERAGED, ANDSHARED
Storage challengesOld65% Cut infrastructure costsNewStorage connectivity in thehybrid multicloud era matters. Storage must connectto a hybrid multicloud world59% Avoid vendor lock-in Storage location in hybrid Avoid data stored with different vendors'technologies in silos across the enterprise.multicloud matters depending on data security,regulatory environments, performance, andavailability requirements.59% Improve latencySpeed of adoption matters.NVMe, storage class memory (SCM),software-defined storage (SDS)Source: IBM Institute for Business Value, 2018 Copyright IBM Corporation 2019Source: IDC, 2018 and 2019
With red hat, IBM cannow deliver the nextchapter of digitaltransformation,innovation, and growthwith a consistent stackfor open hybridmulticloud withcontainers asits underpinningContainers area fundamentaltechnology for clientsmoving to the cloudEase containermanagement andcontainer orchestrationwith kubernetesContainers are usedto create new cloudnative apps andto modernizeexisting onesIt’s fundamentalto the experience
Differentiated Flash NVMe Based Right mix of software andhardware accelerators Sophisticated flash controllers SCM Enablement Connect with the cloud High Availability
A Simple, Robust NVMe PlatformCustom DifferentiatedFlash Controller 2 Rack Units Up to 378TB of Useable Storage Up to 865TB of Effective storage withhardware compression Up to 1.8 PB (or so) after software DR Full suite of storage services SCM Enabled Cloud connections provided9150 NVMe based dual controller Storage System
The kePCH CompPCH Comp Ths software stack isSpectrum Virtualize But nothing is virtualized! Each Controller connectedover NVMe to the Flash The controllers areconnected over PCIe to eachother The Flash does theCompression in band This a fully self contained AllFlash ArrayNVMe SwitchNVMe MFCMFCMFCMFCMFCMFCMFCMFCMFCM10
Building a World Class Flash Controller – Starts with the Flash! Develop characterization platforms Test tens of thousands of flash blocks Work across the industry and partners to stayahead of and help establish trends Invent techniques to extend flash endurance Use flash “knobs” to extend performance Validate with application use models to reducewrite amplification in real life use cases. Teams of researchers, semiconductor and flashexperts across the Industry
IBM’s Write Amplification Reduction Comparing write amplification reduction of Circular Buffer GCGreedy Window GC (i.e., always selecting the block with the most invalid pages for GC)FlashSystem N-bin GC, no heat segregationFlashSystem N-bin GC, with heat segregation12
Inline, At Speed, Hardware CompressionThe FlashSystem data compression/decompression algorithm is a Modified Dynamic GZIPalgorithmTakes advantage of already existing LSA mappingThere is less data to transfer in backend making up for small added latency (7uS)Decompression done in line with hardly any extra latencyData is decompressed along side compression and checked bit by bit. Never any corruption!Data protection (ECC) is implemented on top of compressed data.– Allows garbage collection and other background data transactions to operate on compresseddataCompression and Decompression completely transparent above the Flash module except formanagement of space. Copyright IBM Corporation 201813
Other Key Technologies in Flash Core ECC that never has to reread (Hard decision) Calibration algorithms that adjust voltage thresholds according toCharacterization findings. Health Binning Write Heat Segregation. (Read Heat coming) Smart Data Placement Synergies and accelerators for the Software stack14
Use Cases for IBM Spectrum Virtualize for Public Cloud Optimize Public CloudBlock StorageBusiness Continuity onPublic CloudProtection of Data inPublic Cloud Add cloud capabilities toexisting Storage on Prem Create a DR site in thepublic cloud For workloads movedto cloud Thin-ProvisionedVolumes, Space EfficientSnapshots, AI basedAuto Tiering Temporary or permanentdata migration to/fromPublic Clouds, andbetween Public Cloudproviders. Synchronize local storagedata with sync or asyncstorage replication Use Sync or AsyncMirror to protectcloud data centerdeployments Increase Scalability ofPublic Cloud Storage forEnterprise Apps Move data to cloudresources, such ascontainers, VMs. Lower Cost, ImprovePerformance of nativePublic Cloud IaaSZaaS 2019Extend On Premises toHybrid MultiCloud Consistent Management Protect on prem data forvirtualized,containerized, or baremetal applications Supported within andbetween disparateCloud Provider datacenters15
IBM Spectrum Virtualize for Public Cloud on AWSArchitectureon AWSOn AWS, IBM Spectrum Virtualize for Public Cloud is built onElastic Compute Cloud (EC2) instances, with EBS storageEC2HostHostiSCSI/FCiSCSIEC2IP replicationIBM Spectrum Virtualizefor Public CloudClusteringEC2IBM Spectrum Virtualizefor Public CloudFC, NVMe or iSCSI storageAmazon EBSAmazon EBSOn-premisesAWS
Public Cloud Storage for Enterprise Apps Add cloud capabilities to existing Storage on Prem Temporary or permanent data migration to/from . On AWS, IBM Spectrum Virtualize for Public Cloud is built on Elastic Compute Cloud (EC2) instances, with EBS storage Host IBM Spectrum Virtualize for Public Cloud Host On-premises AWS iSCSI IP .
