Transcription
DE-DUPLIKACJA UWOLNIONA!BoostFSDe-duplikacja na źródle dla każdegoFilm omawiający BoostFS:https://youtu.be/dSU 81xDoZ0
Agenda What is BoostFS? Let’s touch it Why source de-duplication Comparison of source de-duplication technics Announcements2 of YDell - Internal Use - Confidential
BoostFSWhat is it?
BoostFSWhat is it? BoostFS is source de-duplication that any– Backup software– Application– Database– Script– Commandcan use4 of YDell - Internal Use - Confidential
BoostFSWhat is it? Technically BoostFS is directory (folder) on server Any backup software / application / database / script /command writes to this directory (folder) Data are de-duplicated on the server and only unique chunksare sent to Data Domain5 of YDell - Internal Use - Confidential
BoostFSWhat is it? BoostFS uses the same BOOST technology that is used inany other application (backup software, databases, etc.) We will have– the same efficiency– no load of source machine (Intel)as we have in backup application / databases using BOOST6 of YDell - Internal Use - Confidential
BoostFSLicensing BoostFS is 100% free feature of Data Domain 6.0 Everyone who has Data Domain 6.0 or higher and– BOOST license on Data Domain boxor– Data Domain Virtual Edition (DDVE has BOOST licenseincluded within cost of DDVE)can use BoostFS without any additional fee7 of YDell - Internal Use - Confidential
BoostFSI want to try – how?http://gurago.pl/8 of YDell - Internal Use - Confidential
BoostFSI want to try – how?9 of YDell - Internal Use - Confidential
BoostFSI want to try – how?http://gurago.pl/10 of YDell - Internal Use - Confidential
BoostFSChcę spróbować – jak?http://gurago.pl/Tutorial how to Download Install ConfigureData Domain Virtual Edition (DDVE)11 of YDell - Internal Use - Confidential
BoostFSI want to try – how?Step by step guide for BoostFSBoostFS value presentationhttp://gurago.pl/Go for other ppt tutorialsthat show other super usecases of Data Domain!12 of YDell - Internal Use - Confidential
BoostFSRequirements
BoostFSTested Applications14 of YDell - Internal Use - Confidential
BoostFSTested ApplicationsFor any other application contactEMC for formal approval (RPQ)in case of production use.15 of YDell - Internal Use - Confidential
BoostFSSupported Operating Systems16 of YDell - Internal Use - Confidential
BoostFSSupported Operating SystemsThis guide shows the of installation ofBoostFS on SuSE 1117 of YDell - Internal Use - Confidential
BoostFSData Domain requirements BoostFS requires Data Domain Operating System(DDOS) 6.0 or higher If you do not have Data Domain, install Data DomainVirtual Edition (DDVE). Data Domain Virtual Edition (DDVE) is free fortests/trials with perpetual 0.5TB license18 of YDell - Internal Use - Confidential
BoostFSLet’s touch
Configuration
BoostFS InstallationChecking if we see binaries from Linux serverpwdls -al21 of YDell - Internal Use - Confidential
BoostFS InstallationInstalling BoostFS on our Linux serverrpm -Uvh DDBoostFS-1.0.0.4-546961.sles.x86 64.rpm22 of YDell - Internal Use - Confidential
Creating Storage Unit (source de-dup device)23 of YDell - Internal Use - Confidential
Creating Storage Unit (source de-dup device)24 of YDell - Internal Use - Confidential
Creating Storage Unit (source de-dup device)25 of YDell - Internal Use - Confidential
Creating Storage Unit (source de-dup device)26 of YDell - Internal Use - Confidential
BoostFS: Defining Data Domain targetboostfs lockbox set (command)Boost userStorage UnitFQDN of Data Domain/opt/emc/boostfs/bin/boostfs lockbox set -d ddt.labd.local -s BOOSTMySQL -u ddmysql 27 of YDell - Internal Use - Confidential
BoostFS: Defining Data Domain targetboostfs lockbox set (command)Boost userFQDN of Data Domain Storage Unit/opt/emc/boostfs/bin/boostfs lockbox set -d ddt.labd.local -s BOOSTMySQL -u ddmysql Provide password for Boost user28 of YDell - Internal Use - Confidential
Directory with source de-dup to Data DomainCreating directory to which we write with source de-dup on DDmkdir /backupls -al 29 of YDell - Internal Use - Confidential
BoostFS: Mounting Data Domain to dirAttaching Data Domain to our source de-dup directory/opt/emc/boostfs/bin/boostfs mount -d ddt.labd.local -s BOOSTMySQL /backup 30 of YDell - Internal Use - Confidential
Performing backup
Performing backup to BoostFS directoryManual backup with just cp commandcp –R /production /backup/production copy1 We are the backup applicationWe – using the "cp" command – are writing toData Domain.Normally the backup is performed by backupapplication that automatically creates directoriesand files32 of YDell - Internal Use - Confidential
Data Domain shows backup performanceStatistics from Data Domainddboost show stats interval 1 33 of YDell - Internal Use - ConfidentialData written to our /backup directoryData that DD has got(what a nice de-dup!)We write to /backup directorywith 1 stream
We see the huge de-duplicationCommandfilesys show compression /data/col1/BOOSTMySQLshows de-duplication statistics for our logical DDBOOSTMySQLwhich is our BOOST device mounted on serverSzczeliniec.labd.localfilesys show compression / data/col1/BOOSTMySQL We see the size of all protected data(991 051 760)Amount of unique block (4 310 760).Data Domain divided all data (991GB) on chunks4K to 12K. Amount of unique blocks was justabout 4,3MB. Probably similar data werebackuped to different logical Data Domain before.In DD we have global de-dup!!!34 of YDell - Internal Use - ConfidentialUnique blocks (4,3MB) were compressed beforewritten to disk. After compression, unique blocksoccupy on disk 3 814 613 bytes
We can observer which machines areperforming backupsddboost clients show active all 35 of YDell - Internal Use - ConfidentialWe can observe what clients are writing to ourData Domain!
Data DomainWhy sourcede-duplication?
Data ede-duplicationDell - Internal Use - ConfidentialBOOSTVirtualMachines1000GBCIFS200NFS GBSAN1GB1000GBTargetVTL de-duplication10GB37 of Y.100GBFiles100GBBOOSTSourcede-duplicationLAN servers2GB1GB
DATA DOMAIN BOOST r everything else, use theDD Boost file system plug-in38 of YDell - Internal Use - ConfidentialDD BoostSupported over LANDD BoostSupported over SANDD BoostSupported over WANCloudera
Data Domain:Why source de-duplication? Performance– The highest possible performance– Performance scalability› Across different machines› On the same machine39 of YDell - Internal Use - Confidential
Data Domain:Why source de-duplication? Performance– The same speed no matter if LAN or SAN– Over 60TB/h continues backup speed in realenvironments40 of YDell - Internal Use - Confidential
Data Domain:Why source de-duplication? No network bottleneck Source de-duplication for every backup software41 of YDell - Internal Use - Confidential
Data Domain:Why source de-duplication? No network load Client direct Simple management Network load balancing & live failover– Interface Group42 of YDell - Internal Use - Confidential
Data Domain:Why source de-duplication? Source de-duplication device (Storage Unit) isvisible at the same time via LAN/SAN– You can backup via SAN and the same backup via LAN– You can backup via LAN and the same backup via SAN– Clients can backup / restore at the same time viaLAN/SAN43 of YDell - Internal Use - Confidential
Data Domain:Why source de-duplication? Backup via WAN– Possible delays up to 20ms / 35ms / 200ms44 of YDell - Internal Use - Confidential
Data Domain:Why source de-duplication? Smaller costs– Fewer Media Servers– No need for dedicated network– Smaller amount of backup software licenses– Management45 of YDell - Internal Use - Confidential
Data Domain:Why source de-duplication? Disaster Recovery Managed by backup software Replication with granularity for single file Simple Disaster Recovery– Backup software which is aware of backup copies in bothlocations 46 of YDell - Internal Use - Confidential
Data e DisasterRecoveryManagedby backupsoftware providethe highestbackupperformance Replicationwith granularityfor singlefile technicallybest approachto backup/restoredataDataRecoveryDomain Simple fromDisaster provides the biggest value and uniuqe– Backup software which is aware of backup copies in bothpossibilities for backup/restorelocations shall be used if possible is recommended way to backup Data Domain47 of YDell - Internal Use - Confidential
What type ofsourcede-duplicationdo we have?
DATA DOMAIN BOOST r everything else, use theDD Boost file system plug-in49 of YDell - Internal Use - ConfidentialDD BoostSupported over LANDD BoostSupported over SANDD BoostSupported over WANCloudera
Who perfromssourcede-duplication?50 of YBackup softwareDell - Internal Use - ConfidentialApplication moduleBoostFS
Who perfromssourcede-duplication? Backup softwareApplication moduleGuestlevelbackupWindows 2012 R2ImagelevelbackupGuestlevelbackup51 of YDell - Internal Use - ConfidentialImagelevelbackupWindows 8.1BoostFS
Who perfromssourcede-duplication?52 of YBackup softwareDell - Internal Use - Confidential moduleApplicationBoostFS
Who perfromssourcede-duplication?Backup softwareApplication modulecp –R /production /backup/production copy1 53 of YDell - Internal Use - Confidential BoostFS
Who Backup softwareHighestApplication moduleHighestBackup software admin required data (configs) Database adminsfrom database adminsMonitoringBackup softwareDatabase admin /eCDMReplicationBackup software isaware about replicatedcopyMtree (Data Domainlevel) replication54 of YDell - Internal Use - ConfidentialBoostFSHighestBackup software adminor database adminAccording to backuptype (backup Dependson backup methodMtree (Data Domainlevel) replication
Who perfromssourcede-duplication?Backup softwareApplication moduleBackup /restorenetworkSAN/LAN (requiredsupport from backupapplication)SAN/LANLANNumber ofstreamsAny / Up to backupapplicationAny64 per Storage UnitRecommended if central Recommended ifRecommendation backup software isdatabases adminsresponsible for backups own the backupPrice55 of YBoostFSPer amount ofprotected databases No additional charge(source TB)BOOST on Data Domain hardware is requiredUp to backup softwarevendor rulesDell - Internal Use - ConfidentialOnly if source deduplication at* backup softwarelevel* application modulelevelis not avaialable
I wantmore info
More infoWhere to find?http://gurago.pl/Technology s, values, use cases, Just contact me .Daniel.Olkowski@dell.com57 of YDell - Internal Use - Confidential
gurago.plTechnology guideshttp://gurago.pl/58 of YDell - Internal Use - Confidential
gurago.plTechnology guideshttp://gurago.pl/59 of YDell - Internal Use - Confidential
Ogłoszenia
Warsztaty technologiczne 2017 Data Domain Avamar NetWorker VDP Zaninteresowanych proszę o kontakt– Daniel.Olkowski@dell.com61 of YDell - Internal Use - Confidential
Następny webcast 13 stycznia, piątek 10:00 – 10:30 Nowości w Avamar 7.462 of YDell - Internal Use - Confidential
Questions Daniel.Olkowski@dell.com
Exec vRanger NetVault Data Protector RMAN SAP SAP Greenplum HANA DB2 SQL DD Boost Supported over SAN DD Boost Supported over LAN VDP Advanced DD Boost Supported over WAN Veeam HortonWorks Cloudera For everything else, use the DD Boost file system plug-in
