WIXLIB

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASNetwork based Storage SolutionsG. SivakumarIndian Institute of Technology, Bombayhttp://www.cse.iitb.ac.in/ sivaAcknowledgement: Some slides/information are adapted from thetutorials provided by Storage Network Industry Association atwww.snia.orgG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASGoals of Shared StorageIncreased flexibility in deploying and managing storage,Improved quality of service, andIncreased operational efficiency.using the following elementsPhysical Storage Devices (disk drives, disk arrays, controllers,tape libraries,.)Logical Storage Resources (volumes, files)Interconnection Network (many choices)Host Computers (equipped with Host Bus Adaptors, NetworkCards)G. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASbighome.iitb.ac.inA Sun Storedge NAS server (2 Terabytes disk) at IIT.300 MB for students, 500 for faculty.Mountable from anywhere in campusAcross platforms (Linux/Windows)smbd serverLDAP authenticationBacked-up using AMANDAAlso Provides homepages for all(http://homepages.iitb.ac.in/ user)G. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASLogical Volumes/PartitionsInternally bighome has a fibre channel connected set of disks(Hitachi and Seagate)bash-2.03# df -kFilesystemkbytesusedavail capacity Mounted on/dev/vx/dsk/rootvol 4032504 2873271 111890872%//dev/vx/dsk/usr4032504 1633010 000%/etc/mnttab/dev/vx/dsk/var4032504 944525 304765424%/varswap2177551232 217754801%/var/runswap2183894463464 217754801%/tmp/dev/dsk/c5t2d0s41016122 148331 80682416%/nsr/dev/vx/dsk/opt2734129 1025099 165434839%/opt/dev/vx/dsk/data3/vol03571785216 92363100 44951669318%/data3/dev/vx/dsk/data1/vol01571785216 176296565 37077882733%/data1/dev/vx/dsk/data4/vol04500312064 181497552 29888975538%/data4/dev/vx/dsk/data2/vol02500312064 162779319 31643695034%/data2G. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASUser Distributionbash-2.03# ls /data1/199420002004alumni.old batches misc19972001TT st foundquotadirbash-2.03# ls /data1/2004/btech ddimmdesmmmscmtech rsbash-2.03# ls hool checoreegeositmetscebash-2.03# ls /data1/2004/mtech/cse/z4305z4305001 z4305015 z4305024 z4305028 z4305802 z4305807 z4305905z4305011 z4305020 z4305025 z4305029 z4305804 z4305813bash-2.03# ls -ld /data1/2004/mtech/cse/z4305*drwxr-xr-x2 aniketpkate 10430596 Jul 21 18:18 /data1/2004/mtech/cse/z4305001drwxr-xr-x2 dheren10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305011drwxr-xr-x2 vamshi10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305015drwxr-xr-x5 z4305020 1043051024 Sep 30 01:53 /data1/2004/mtech/cse/z4305020drwxr-xr-x2 z4305024 10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305024drwxr-xr-x2 sheetal sonare 10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305025drwxr-xr-x2 sr anilk 10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305028drwxr-xr-x2 sreekanth 10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305029drwxr-xr-x2 nadesai 10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305802drwxr-xr-x2 sjagdhesh 10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305804drwxr-xr-x2 amruta10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305807drwxr-xr-x2 vselot10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305813drwxr-xr-x2 samveen 10430596 Jul 21 18:19 /data1/2004/mtech/cse/z4305905G. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutionsquotasquotasrsstf

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASAdministering BighomeAutomagically when LDAP accounts are added.G. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASHow Home Directories Createdif ( status eq "misc" status eq "stf" status eq "prjstf" status eq "fac") { data "/data"." data/ dirs[2]/ dirs[3]/ user";} else { data "/data"." data/ dirs[2]/ dirs[3]/ dirs[4]/ user";}#print LOG "mkhomedir.pl @dirs[2] @dirs[3]\n";print LOG "mkhomedir.pl link name dir real homedir data\n";my basedir join ’/’, @dirs;if (!chdir ( basedir)) {system ("/usr/bin/mkdir -m u rwx,og rx -p basedir") && die "Couldnt create basedir";}systemsystemsystemsystem("/usr/bin/mkdir -m u rwx,og -p data") && die "Couldnt create data";("/usr/bin/chown uid: gid data") && die "couldnt set permissions for data";("/usr/bin/ln -fs data dir") && die "Cant set symlink to dir";("/opt/VRTSvxfs/sbin/vxedquota -p qta user") && die "couldn’t set quotafor user";G. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASConfiguring SMBDbash-2.03# less /usr/local/lib/smb.conf# Samba config file created using SWAT# from pitta.cc.iitb.ac.in (144.16.106.14)# Date: 2002/09/30 16:42:17# Global parameters[global]workgroup COMPUTER-CENTREnetbios name BIGHOMEinterfaces ge0encrypt passwords Yesos level 65preferred master Truedomain master Truewins server 10.200.1.21ldap server ldap.iitb.ac.inldap port 389ldap suffix ou people,dc iitb,dc ac,dc inldap admin dn cn sambaproxy,ou people,dc iitb,dc ac,dc inldap ssl no[homes]read only NoG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASPhysical DisksHeadCylinderSectorData Transfer speed depends onSpeed of I/O technology (SCSI,Fibre Channel, .)Seek time (time for heads tomove to a new track)Latency (time for sector torotate under heads)Speed and size of disk drivebuffer memoryG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASDrive InterfaceParallel IDE/ATA or Serial ATA (SATA)Integrated Drive Electronics (IDE), AT Attachment (ATA)lower-cost devices than SCSI,controller/drive electronics wedded to the drive itself.IDE standardizes how disk drives are connected to serversvia a ribbon cable and an interface connector on a PC orserver motherboard.IDE/ATA protocol five revisions,For 10 years now speeds and feeds keeping pace with speedand capacity-hungry applications.Little improvement in transfer rate expected in futureDifficult to create arrays with ParallelParallel SCSI or SAS (Serial Attached SCSI)Fibre ChannelG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASSerial ATASATA isa standards-based interface that improves on parallel IDE/ATAinterface transfer rate is 150Mb/s, (compared with parallelATA’s 100Mb/s)That’s a 50with large data volume requirements, such asvideo editing.First Generation SATA drives not yet more efficient thanParallel ATA,SATA-2 and SATA-3 - expected transfer rates of 300 and 600Mb/sStill limited by max speed of PCI bus at 133 Mb/sG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASSCSIParallel interface I/O technologyMaximum cable run length is 25 metersSpeeds up to 320 MB/sec (Ultra SCSI-3 on 16 bit wide bus)Maximum of 16 (I/O controller devices) SCSI devices perbusEvolving standard: SCSI-1, SCSI-2, SCSI-3, SCSI-4 (1.2Gbps)Unaware of File or Operating SystemsBlock Data SCSI Block I/OScalability and distance limitationsG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASSCSI ProtocolG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASRAIDRedundant Array of Independent DiskRAID 1–Mirrored VolumesRAID 0 1–Mirrored ArrayRAID 4–Block-Level Striping with Parity DiskRAID 5–Striping with Distributed ParityRAID 10–Mirrored Striping ArrayG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASLogical View of StorageG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASStorage VirtualizationG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASDirect Attached Storage (DAS)Storage is captive behind server CPUData access is file system and platform dependant.Server CPU must handle user I/O requests also.Costly to scale; complex to manageG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASStorage Area Network (SAN)Scalability and PerformanceStorage Expansion No impact on serversServer Expansion No impact on storageLoad Balancing & Failover Active parallel pathsBandwidth on Demand Robust topologyOffload/Remote BackupG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASiSCSIEverything over IPIP over EthernetG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASiSCSI (ctd.)iSCSI is a SCSI transport protocol for mapping of storage blockI/O over TCP/IP networksAllows universal access to storage over standard TCP/IPnetworksiSCSI ratified by IETF February 2003 (RFC TBD)Embedded Payload of TCP SegmentTransparent to TCP/IPTransparent to Firewalls, VPN, Routers, etc.Topologies: Intranet, Internet, WAN, WirelessG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASWhy IP Access to Storage?Single access technology for both block and fileUbiquitous nature of IPAccess storage from LAN, MAN, WAN, InternetEconomy of scaleScalabilityDistance, node count, performance (GE/10GE), expertiseManageable, secure and interoperable(SNMP, MIBs, DNS, LDAP, tools)(IPSEC, VLANs, ACLs, Firewalls)Substantial R&D investment in Ethernet/IPG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASwww.snia.orgStorage Networking Industry Association reference model.Block I/O abstractionHow to share across computers?G. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASFile System AbstractionG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaDifficult to share in SAN.Network based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASNetwork Attached Storage (NAS)G. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions

IIT Bombay Case StudyStorage BasicsDAS, SAN, NASComparison of DAS-SAN-iSCSI-NASG. Sivakumar Indian Institute of Technology, Bombay http://www.cse.iitb.ac.in/ sivaNetwork based Storage Solutions