Transcription
Enterprise Storage – Storage EfficiencyPRESENTATION TITLE GOES HERELeah Schoeb, Vice Chair, SNIA Technical CouncilSNIA EmeraldTM TrainingSNIA Emerald Power EfficiencyMeasurement Specification,for use in EPA ENERGY STAR June 24-27, 2013
Topics! Optimization!!!!!ChallengesDrivers and InitiativesEconomicsOptimization Initiatives to Meet DemandsStorage Perspective – Trends and Dynamics! Increasing Storage Efficiency!!Capacity efficiencySolid State TechnologySNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com2
Topics Not Covered! Data Protection and /2012/spring/data! Cloud Archive!http://www.snia.org/cloud/archiveSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com3
Challenges in IT! Meeting capacity demand—————Unstructured Data – 90%Structured Data- 10%Capital expenditures for systemsSpace, power, and cooling issuesInfrastructure expansionData protection – expanding oncurrent practicesAdministration! Budgets——Increases not parallel with demandExpected services greater than budgetallowanceSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com6/23/1344
IT ChallengesData Growth (%) Projections by Industry(Tier 1, 7years average)23%do no capacityplanning85%have noshow backcapabilitiesAirline23%Banking and Finance31%Computer hardware/Computer 25%Conglomerates21%Dairy26%Distribution70%do not use astorage catalog90%have little to noprocessdocumentation25%Education25%Food nce70%do not usestoragevirtualization70%do not havearchive processes28%Media & Entertainment17%Mining & chemicals21%Oil & Gas20%Others19%Paper Products20%Professional services68%are not using deduplicationSource: IBM Storage Infrastructure Optimization (SIO) study25%Publishing22%Retail40%Revenue Services47%Semiconductor ionUtilitiesSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com23%26%27%6/23/1355
Challenges in IT! External inputs: “Why aren’t you doing this?”—Cloud implementations!!!!Public clouds – buzzwords and confusionPrivate cloud – data center transformation to IT As A ServiceSoftware As A ServiceBig data analytics! Mobility—Continued use expansion of tablets and notebooks!——BYOD ( A change in the “B”)Security concerns for informationAdministrative efforts – where is the lineSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com6/23/1366
Top CIO Priorities for 20121. Consolidation / Optimization!Server, Desktop, Storage, Services2.3.4.5.6.Cloud Services for IT – IT as a ServiceSecurityMobile services / mobilityBudget and cost controlShared services – charge back and utility-basedservices7. Health care - insurance issues8. Legacy modernization9. Interoperable networksUS government NASCIO survey 11/13/1210.Disaster recovery / Business continuitySNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com77
Drivers in Optimization andEfficiency! Expansion of business / organization!!!Greater needs for capacity, availabilityRapid deployment requirementsNew demands in server virtualization and VDI! Return on investment into IT – compared to alternatives!!Optimize the IT investmentIT as value - not a tax! Continued advancement !!!Remain competitiveAdapting to changing demands“Technology as a competitive advantage”SNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com88
Optimization - Economics! Practical Usage!Costs – assessed, profit center, fixed budget!!!!!FacilitiesAdministrative staffEquipmentExternal / contract / consultantUse of metrics!!!Measure for improvementComparison against industry – defend costsRequires a discipline to collect and calculateSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com99
Optimization – Efficiency! Utilization of resources!!Effectively using what was paid forExamples:!Using processor cycles in a server– Limitations preventing effective usage– Effort to improve!Storage space– What is the utilization– Limitations – inherent architectural considerations– Technology changes that have an impact! Green storage technologies use less raw capacity tostore and use the same data set!Power consumption falls accordinglySNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com1010
Optimization – Efficiency! Delivery of services!!Measurement is time: how longExamples:!!!!6/23/13Time for application deployment: software, server, storage,physical space, power, cooling, infrastructureTime for connectivity: network, userids, privilegesTime for storage – expansion: how long, conversion/movement required, protectionTime for more compute cyclesSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com1111
Storage Perspective – Trends& Dynamics! Virtualization (Server & VDI)!!!Reduce number of physical serversGreater use of resourcesSecurity drivenHypervisor! Storage efficiency!!ConsolidationNew features / technologies!!!!TieringSSD’sThin provisioning & reclamationData reduction! Future - Software DefinedStorage!!!Streamline storage consumptionMonitoring, management, and meteringProtection framework for highly scalablestorage servicesSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com12
Storage EfficiencyOptimized Capacityfor a GreenerDatacenerSNIA EmeraldTM Training June 24-27, 201380%40%www.sniaemerald.com13
Enterprise Storage OptimizingFeatures! Thin Provisioning!Use of disk virtualization! Data Reduction!!DeduplicationCompression! Using Solid State Storage! Auto Tiering using solid state storageSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com14
Thin ProvisioningSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com15
Before Thin Trappedandunavailablefor otherusesUsedCapacityTraditional AllocationSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com1616
Thin Provisioning!Allocate space when data is written!!!!!PG&E adds thin provisioning to their energy-saving incentive programMore effective use of capacity and space efficiencyCuts down or eliminates over provisioningNotifications when space consumption reaches thresholdsSpace Reclamation§ Cansaveupto75%inenergycosts§ Caneliminateupto70%oflegacycapacitySNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com17
Disk Virtualization for ThinProvisioning! New storage system architecture to only assign capacityas it was written! Created storage pools!!!Set of chunks of data – size of chunk could be specified at timeof configurationVolumes were created without assigning real capacityAs data written, chunks were assigned! For newer architecture, chunks were distributed acrossphysical disks to match data protection choices!!Different RAID levelsAdvanced data protection techniquesSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com18
Thin Provisioning from Storage PoolsThin Provisioned LUNChunks added as requiredChunks.Storage PoolRAIDGroup.SNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.comPhysical Disks1919
Thin Provisioning from Storage Poolswith Data ProtectionThin Provisioned LUNDataProtectionof ChunksNew DesignsChunks added as required.ChunksChunksmapped tospecificphysicaldevicesStorage PoolSNIA EmeraldTM Training June 24-27, 2013.www.sniaemerald.comPhysicalDisks6/23/13 20 20
Data Reduction TechnologyDeduplication and CompressionDATA REDUCTIONSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com2121
What is Deduplication?! Top-level definition: storing only a single instance of data!!!At block level: look for redundant blocksAt byte offset level (also called bit-level sometimes): look forstream of bytes that are duplicateAt a file level: look for duplicate files! Redundant data is replaced with a pointer (index) to theunique copy! Streaming (in-band) and offline techniques! Makes a greener disk-to-disk backup! Up 90% of data capacity saved! Different than compression! Store more data in less spaceSingleInstanceStoreSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com22
What is Compression?! Involves encoding information using fewer bits that theoriginal representation.! Lossless Compression – reduces bits by identifyingand eliminating redundancy.!represent data more concisely without losing data! Lossy Compression - reduces bits by identifyingunnecessary information and removing it! Decompression comes at a performance cost whichvaries!!!Degree of compressionAmount of distortion introduced when using lossy compressionComputational resources required to compress and uncompressdataSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com23
Data Reduction Technologies! Reduce amount of data!!Data compressionData deduplicationBackup tapes – compressionBackup to disk – typically deduplicationBackup to cloud – compressionPrimary or secondary storage – deduplication /compression! Archive – compression!!!!SNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com2424
Green Storage technologysavings calculation! Every TB of disks you don’t buy saves you!!!CAPEX for equipment and footprintCAPEX and OPEX for power conditioningOPEX for power (spinning media), cooling, and storagemanagementSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com25
3 Major HW Design Approachesfor Datacenter! Storage System!General purpose storagesystem that can dedup data! Gateway!Hardware capable of dedupdata on external storagehardwareStorage System! Appliance!Hardware capable of dedupand storing data in anappliance for this specificpurposeGatewayApplianceSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com26
3 Major SW Design Approaches! Appliance!HW for dedup and storingdata in an appliance for thisspecific purposeAgent! Agents!Client-side SW for aspecific application! Software Appliance!Host-side SW for storingdedup data fromapplication agentsClient-sideAgentsSW ApplianceSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com27
Benefits – Deduplication andCompression!!!!!!Satisfy ROI/TCO requirementsManage data growthIncrease efficiency of storage and backupReduce overall cost of storageReduce network bandwidthReduce operational cost including!!Infrastructure costs required space, power and coolingMovement toward a greener datacenter – carbon footprintfriendly! Reduce administrative costs6/23/13SNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com28
Deduplication Summary! Reduces physical data storage requirements byremoving duplicate data! Allows data to be retained on disk for longer periods,using less physical space! Involves tradeoffs relating to degree of physical spacereduction and performance considerations (somedesigns are better than others)! Can be used with primary storage or as part of a backupsolution.! Thoughtful deployment allows users to benefit from agreener datacenter.6/23/13SNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com29
Solid State TechnologySNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com3030
Solid State Device Usage! Justifications for SSDs!!!!Rugged – no moving partsPerformance – no rotationallatency or actuator movement aswith HDDsReliability: MTBF – typically 6xover HDDOperational costs – powerrequirement is typically 1/4th ofHDDSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com31
Solid State Technology! Performance is primary gain withsolid state! Focus on NAND Flash today! General Usages!PCIe Flash CardsSSD: Solid-state device, Solidstate disk or drive!Flash memory cards for servers!Tiering in storage systems!Caching in storage systems!All solid state storage systems!ConsumerNAND Flash DrivesSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com32
Solid State TechnologyPCIe-Extender AdapterPCIe-SSDFlash CardSNIA EmeraldTM Training June 24-27, 2013SAS, SATA-SSDwww.sniaemerald.com33
Solid State Technology Host SideStorageDifference betweenuse of SSD’s andcustom solid statedesignsSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com3434
Solid State Technology Storage Arrays! Solid state in existing design storagesystem!SSDs as a storage tier!!!!!Software RAIDHighly active data keep in SSDsMay be separate read and writeValue over DRAM is cost – non-volatility simplicitySAS/SATA DriverSAS/SATA ControllerAll-SSD array (existing design with onlySSDs)!!!DataSystem manages data and accelerates operationsEmbedded software to migrate data based onaccess patternsSSDs as cache tier!!SAS/SATA based SSDFundamental architecture still based on spinningdisksConfiguration difference only3rd PartyFlash ControllerFlash MediaStorage system use of internal Flash cards!Typically as cacheSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com3535
Solid State Technology Storage –New All Flash Arrays! New storage system architectures for all solid state!!Internal design to handle memory speedManage technology characteristics – writes, cell sparing!!!Done with custom Flash controllersDifferent types – SSD, Flash card, next generationKey characteristics to look for:!!!!!!6/23/13Data reduction – reduces number of writes requiredSnapshot as a mapped technologyRemote replicationSelf-healing techniquesLifespanScale-out capability – usually clusteringSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com36
Efficiencies w/ Solid State Storage! SSDs do not require special cooling and can toleratehigher temperatures than HDDs.! Resistant to shock and vibration! Small and light weight leads to higher capacity density! Trend – data reduction with SSDs!!Compression & deduplication to multiply capacity and reducenumber of writes requiredNew techniques will drive towards price parity with HDDsSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com37
Factors to Consider in SSS! Unique Performance behavior!!No moving parts (no rotational latency or seek times)Access time in the microseconds! Wear Leveling Algorithms!Not all algorithms are created equal! Misalignment!!Performance degradations as high as 30% in some casesShortened SSS lifespan! SLC vs. MLC Flash!!!!!Single-Level Cell Flash stores one unit of information in a single cell.Multi-Level Cell Flash stores multiple units of information in a singlecell.SLC access times are faster than MLCMLC is less expensiveTLC is coming on the market – Good for archive solutionsSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com38
Tiered StorageSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com3939
Storage System Tiering2-4%Solid State Devices§ Major performance boost§ Limit economic impact ofcosts of higherperformance drives§ Utilizes resources better§ Economic advantageSNIA EmeraldTM Training June 24-27, 2013Data Movement§ In-the-box sniaemerald.com4040
Tiered Storage & Auto TieringSolid State Technology can work well in TieredStorage DesignsSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com41
Tiering vs. Caching! Storage tiers!!!!!!!PersistenceImplies a particular price and performance metricProvides actual capacityAll content resides on mediaPerformance is limited only to media speedMay be improved with cachingMajor gain: storage consolidationActuallocationfor data! Caching!!!!!Not considered actual storageNot persistentAll capacity must be backed by non-volatile mediaPerformance limited to size of cacheLimited use for random workloadsSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.comData istransient42
Gains from Optimization andEfficiency! Greater storage efficiency - !!Space, power/cooling, utilizationDirect economic gains! Consolidation!!!Lower datacenter footprintHigher densityMore effective use of current storage! Provable optimization savings!!Results – TCO and ROIInitiatives – show improvements in incremental stepsSNIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com43
Thank YouLeah NIA EmeraldTM Training June 24-27, 2013www.sniaemerald.com44
SNIA EmeraldTM Training SNIA Emerald Power Efficiency Measurement Specification, . — Continued use expansion of tablets and notebooks ! . US government NASCIO survey 11/13/12 7 . SNIA Em
