WIXLIB

Storage on AWSDominique RegaladoWWPS Solutions Architectregaladd@amazon.comApril 7, 2021 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Agenda IntroductionStorage PrimerBlock StorageShared File SystemsObject StoreOn-Premises Storage Integration 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

0Storage Primer 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Block vs File vs ObjectBlock StorageRaw StorageData organized as an array of unrelated blocksHost File System places data on diskEx: Hard Disks, Storage Area Network (SAN) Storage ArraysFile StorageUnrelated data blocks managed by a file (serving) systemNative file system places data on diskEx: Network Attached Storage (NAS) Appliances, Windows File ServersObject StorageStores Virtual containers that encapsulate the data, data attributes, metadata and Object IDsAPI Access to dataMetadata Driven, Policy-based, etc.Ex: Ceph, OpenStack Swift 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Storage - CharacteristicsSome of the ways we look at storageDurabilityMeasure ofexpected datalossAvailabilityMeasure ofexpecteddowntimeSecuritySecuritymeasures forat-rest and intransit data 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.CostAmount perstorage unit,e.g. / GBScalabilityPerformanceUpwardflexibility,storage size,number lity tointeract via APIor with otherservices

Understanding DurabilityStandard IAGlacierTwo copies on one siteCopies on two sitesdesigned fordesigned urability 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.copies in three AZdesigned for

More choice for more applicationsBlock storageFile storageGeneral Purpose SSDEFS StandardProvisioned IOPS SSDThroughput-Optimized HDDAmazon EC2Cold HDDAmazon AWS StorageGateway FamilyEFSFSx for WindowsFSx for LustreAmazon FSxfor WindowsFile ServerAmazon EBSBackupEFS Infrequent AccessAmazon FSxfor LustreObject storageS3 StandardS3 Standard-IAS3 One Zone-IAS3 Intelligent-TieringAmazon S3S3 GlacierS3 Glacier Deep Archive 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

1Block Storage 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

What is Amazon EBS?EC2instanceEBSvolume 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Block storage as a service Create, attach volumes through an API Service accessed over the network

AWS EBS FeaturesDurableSecureScalableDesigned for 99.999reliabilityIdentity andAccess PoliciesCapacity whenyou need itRedundant storageacross multiple deviceswithin an AZEncryptionEasily scale upand downPerformanceBackupLow-latency SSDPoint-in-time SnapshotsConsistent I/O PerformanceCopy snapshots across AZand RegionsStripe multiple volumes forhigher I/O performance 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon EBSNetwork attached block device Independent data lifecycleMultiple volumes per EC2 instanceOnly one EC2 instance at a time per volumeCan be detached from an instance and attached to a different oneRaw block devices Unformatted block devicesIdeal for databases, filesystemsMultiple Drive Types SSD (gp2 & io1) and HDD (st1 & sc1) 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon EBS volume typesSSDHDDgp2General PurposeSSDio2Provisioned IOPSSSD 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.st1Throughput Optimized HDDsc1Cold HDD

Amazon EBS volume types: General Purpose SSDBaseline: 100 to 16,000 IOPS; 3 IOPS per GiBBurst: 3,000 IOPS (for volumes up to 1,000 GiB)Throughput: Up to 250 MiB/sgp2General Purpose SSDLatency: Single-digit msCapacity: 1 GiB to 16 TiBGreat for boot volumes, low-latency applications, and bursty databases 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon EBS volume types: Provisioned IOPSBaseline: 500–64,000 IOPSThroughput: Up to 1,000 MiB/sLatency: Single-digit msio2Provisioned IOPSCapacity: 4 GiB to 16 TiBIdeal for critical applications and databases with sustained IOPS 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon EBS volume types: ThroughputProvisionedBaseline: 40 MiB/s per TiB up to 500 MiB/sBurst: 250 MiB/s per TiB up to 500 MiB/sCapacity: 500 GiB to 16 TiBIdeal for large-block, high-throughput sequential workloadsst1Throughput Optimized HDD 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon EBS volume types: Cold HDDBaseline: 12 MiB/s per TiB up to 192 MiB/sBurst: 80 MiB/s per TiB up to 250 MiB/sCapacity: 500 GiB to 16 TiBIdeal for sequential throughput workloads, such as logging and backupsc1Cold HDD 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

EBS Snapshots Point-in-time snapshots of volume blocks Stored in Amazon S3 and accessed via EBS APIs Key Features: Immediate access to EBS volume data Resizing EBS volumes Sharing EBS Snapshots Copying EBS Snapshots across AWS regions 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

EBS Snapshots – Delta Block ChangesAWS CloudEC2 Availability ZoneEBSEBSEBSEBSEBSAmazon S3Create SnapshotEBS SnapshotEBSClone FromSnapshotEC2EC2EC2Internet 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.EBS SnapshotEBS Snapshot

How Do EBS Snapshots Work?TimeSnapshot ASnapshot BSnapshot CChunk 1Chunk 2Chunk 1Chunk 2Chunk 1Chunk 2Chunk 3 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

What is Amazon EC2 instance store?EC2 instancesInstance StoreorPhysical Host 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Local to instance Non-persistent data store Available on certain EC2families– Ex: d2, i3, r5d, m5d Data is not replicated (bydefault) No snapshot support SSD or HDD

2Shared file system 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Elastic File System (EFS) Fully managed file system for EC2 instancesProvides standard file system semanticsWorks with standard operating system APIsSharable across thousands of instancesElastically grows to petabyte scaleDelivers performance for a wide variety of workloadsHighly available and durableNFS v4–basedAccessible from on-premise servers 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon EFS is SimpleFully managed-No hardware, network, file layerCreate a scalable file system in seconds!Seamless integration with existing tools and apps-NFS v4.1—widespread, openStandard file system access semanticsWorks with standard OS file system APIsSimple pricing simple forecasting 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon EFS is Elastic File systems grow and shrinkautomatically as you add and removefiles No need to provision storage capacity orperformance 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Highly Durable and Highly Available Designed to sustain AZ offlineconditions Resources aggregated across multipleAZ’s Superior to traditional NAS availabilitymodels Appropriate for Production / Tier 0applications 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

EFS – MountingEFSEC2EC2EC2EC2EC2EFS DNS n.amazonaws.comMount on machinesudo mount -t nfs4 mount-target-DNS:/ /efs-mount-point 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.EC2

EFS Storage ClassesStandard Stores data acrossmultiple AzsOne Zone Single AZ 47% lower costInfrequent Access Save up to 92% Maximizesoperational efficiencyFeatures include:Two Performance modes: General Purpose and Max I/OTwo Throughput modes: Bursting and Provisioned 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon FSx for Windows File ServerFully managed Windowsfile systems built on WindowsServer 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.Integrated withAWS

Native Windows compatibility and featuresNTFSSMBADNative SMBIntegrates withMicrosoft ADand supportsWindows ACLs2.0 to 3.1.1Native WindowscompatibilityWindows Server 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.DFSNamespacesandDFS Replication

Amazon FSx features Performance and Scale Security Compliance: PCI DSS, SOC 1/2/3, HIPAA-eligible Highly durable and available 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Use CasesHome DirectoriesWindows Business ApplicationsMicrosoft SQL Server deploymentsMedia workflowsWeb servingData Analytics 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

3Object Storage 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon S3 (Simple Storage Service) Web accessible object store (through API or HTTPS)Highly durable (99.999999999% design)Limitlessly scalableMultiple use casesSecurity, Compliance, and Audit capabilitiesStandard Storage Pricing (us-east-1) - 0.023 per GB 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Your choice of object storage classesS3 StandardS3 Intelligent-TieringS3 One Zone-IAS3 GlacierAccess FrequencyFrequent Active, frequentlyaccessed data Milliseconds access 3 AZ 0.0210/GBS3 Standard-IA Data with changingaccess patterns Milliseconds access 3 AZ 0.0210 to 0.0125/GB Monitoring fee perObj. Min storage duration 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Infrequentlyaccessed data Milliseconds access 3 AZ 0.0125/GB Retrieval fee per GB Min storage duration Min object size Re-creatable, lessaccessed data Milliseconds access 1 AZ 0.0100/GBS3 GlacierDeep ArchiveInfrequent Archive data Select minutes orhours 3 AZ 0.0040/GBRetrieval fee per GBMin storage duration Retrieval fee per GB Min storage duration Min object size Min object size Archive data Select 12 or 48hours 3 AZ 0.00099/GB Retrieval fee per GB Min storage duration Min object size

S3 Management Features 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

S3 Access Management & Security Deep integration with AWS Identity and Access Management (IAM)Access Control Lists (ACLs) & S3 bucket policiesQuery String AuthenticationAudit LogsS3 supports both server-side & client-side encryption S3 Inventory to check the encryption status of S3 objectsS3 Block Public Access to ensure S3 buckets and objects do not havepublic accessAmazon Macie to discover, classify, and protect sensitive data storedin Amazon S3 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

4On-Premises StorageIntegration 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Many Options for Data TransferAWSDirect ConnectAmazonKinesisFirehoseAmazonKinesisData StreamsAmazon KinesisVideo StreamsAmazon MigrationServiceAWSSnowballAWSSnowball EdgeAWSSnowmobileAWSDataSyncAWSTransferfor SFTP 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Storage Gateway hybrid storage solutionsEnables using standard storage protocols to access AWS storage servicesFilesVolumesTapes 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.Amazon S3Amazon GlacierAmazon EBSsnapshots

Storage Gateway – Files, volumes, and tapesFile gateway NFS (v3 and v4.1) interfaceOn-premises file storage backed by Amazon S3 objectsVolume gateway iSCSI block interfaceOn-premises block storage backed by S3 with EBS snapshotsTape gateway iSCSI virtual tape library interfaceVirtual tape storage in Amazon S3 and Glacier with VTL management 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Storage Gateway – Common capabilitiesStandard storage protocols integrate with on-premises applicationsLocal caching for low-latency access to frequently used dataEfficient data transfer with buffering and bandwidth managementNative data storage in AWSStateless virtual appliance for resiliencyIntegrated with AWS management and security 2021, Amazon Web Services, Inc. or its Affiliates. All rights reserved.