WIXLIB

OpenStack ManilaShared File Services for the CloudPRESENTATION TITLE GOES HEREJanuary 29, 2015

SNIA Legal Notice!!The material contained in this tutorial is copyrighted by the SNIA unlessotherwise noted.Member companies and individual members may use this material inpresentations and literature under the following conditions:!!!!!Any slide or slides used must be reproduced in their entirety without modificationThe SNIA must be acknowledged as the source of any material used in the body of anydocument containing material from these presentations.This presentation is a project of the SNIA Education Committee.Neither the author nor the presenter is an attorney and nothing in thispresentation is intended to be, or should be construed as legal advice or anopinion of counsel. If you need legal advice or a legal opinion please contactyour attorney.The information presented herein represents the author's personal opinion andcurrent understanding of the relevant issues involved. The author, the presenter,and the SNIA do not assume any responsibility or liability for damages arisingout of any reliance on or use of this information.NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK.2

Today’s PresentersGreg Loughmiller,Technical Marketing Engineer,NetAppCloud Solutions GroupAlex McDonald, SNIA – CSICloud Storage Initiative Chair - NetApp3

Agenda!!!!!!!Project OverviewKey ConceptsAPI OverviewArchitecture OverviewDrivers and IntegrationAutomationRoadmap and Futures4

Shared File Services65%of all storage sold isfor file-baseduse casesper IDC, 20125

Manila: Project OverviewCreate a“Marketing”share VM4Manila is nowa formallyincubatedOpenStackprogram!Applicable for a variety ofuse cases (DBaaS, SAP,generic file share, VDI, etc)Share“R&D” withInstances 1&3ManilaNovaShares ProviderFinanceR&DMarketingHypervisor1234566

Manila: Project Overview!!What’s the customer use case forManila?!65% of disk capacity slated for filestorage (IDC 2012)!Self-service management &provisioning of shared file systems ishard!Customers invent this themselvesvia scripting, automation, etc.Who is contributing to Manila?!!EMC, IBM, Mirantis, NetApp, Red Hat,SUSEWhere can I get stack-manila on IRC(Freenode)7

Manila: Overview of Key Concepts! Replace homegrown or legacy systems! Improve IT responsiveness by providing self-serviceshare management! Integrate Manila with existing automation frameworksthrough REST API or CLIManilaRESTAPIShared FileServices8

Manila: Overview of Key Concepts! Share (an instance of a shared file system)!!User specifies size, access protocol, “share type”Can be accessed concurrently by multiple instances! Share access rules (ACL)!!Defines which clients can access the shareSpecified by IP in CIDR notation! Share network!!Defines the Neutron network & subnet through whichinstances access the shareA share can be associated with only one share network9

Manila: Overview of Key Concepts! Security service!!Finer-grained client access rules for Authn/z (e.g.LDAP, Active Directory, Kerberos)Share can be associated to multiple security services! Snapshots!!Read-only copy of share contentsNew share can be created from a snapshot! Backend!Provider of shares; a share resides on a singlebackend! Driver!Vendor or technology-specific implementation ofbackend API10

Manila: API Overview - SharesOperationCLI commandCreate sharemanila createDelete sharemanila delete id List sharesmanila listGET/sharesShow share detailsmanila show id GET/shares/{id}Rename sharemanila renamePUT/shares/{id}Edit share metadatamanila etadataShow share metadata manila metadata-showREST APIPOSTDELETE/shares/shares/{id}

Manila: API Overview – Share Access & NetworksOperationCLI commandREST APIAllow share access manila access-allowPOST /shares/{id}/actionDeny share access manila access-denyPOST /shares/{id}/actionList share accessmanila access-listPOST /shares/{id}/actionOperationCLI commandCreate share networkmanila share-network-createPOSTDelete share networkmanila share-network-deleteDELETEList share networksmanila share-network-listActivate share networkmanila share-network-activateREST e-networks/share-networks/{id}/action

Manila: Overview of Architecture!!!!Manila is not in the data path!manila-api!!Exposes REST APIthrough WSGI applicationmanila-scheduler!!Makes provisioningdecisions for sharerequestsmanila-share!!Manager process oneprocess per backend!Responsible forcommunicating withstorage subsystemsControl iverDriver13

Manila: Vendor Drivers! Reference Implementation!!!!!!!!!!Nova VM (from Glance image) hosts NFS, CIFS serversCinder volume (of requested size) per share provides storagecapacityNetApp clustered Data ONTAPRed Hat GlusterFSEMC VNX and IsilonIBM GPFS (Kilo)NFS-Ganesha(Kilo)Oracle ZFS(Kilo)Huawei (Kilo)More to come 14

Manila: Generic Share Driver!!!!!Creates a Nova instance(not owned by requestingtenant) to offer NFS/CIFSshares backed by CindervolumesNew instance is created foreach “share network”Connected into existingNeutron network & subnetInstance flavor, sourceGlance image, & SSHkeypair are configurable inmanila.confManila creates shares ininstance using Linuxcommands over SSHMount –t nfs!nova-computemanila create!nova boot!CIFSneutronport-add!NeutronManilacinder create!Cinder15

Manila: NetApp clustered Data ONTAP!!!!Driver points at an existingclustered Data ONTAPdeploymentA new storage virtualmachine (SVM) is createdfor each share networkCreate a new Data LIF withthe VLAN tag set to sameVLAN tag of the NeutronnetworkAccess permissions are setat the controller for guestsmount –t utronControl PathData Path16

Manila: Red Hat GlusterFSmanila createmanila access-allow!!!Use Gluster toprovide aDistributed ScaleOut File Systembackend for ManilaFile SharesCurrent: SingleTenant GlusterFSdriver usingGluster-NFSFuture: Be able touse NFSGanesha(Kilo)Nova ComputeManilaProcesses10.1.1.110.1.1.210.1.1.3 Sales Marketing Marketing Eng aremanila-shareGlusterFS DriverDriverDriver/Gluster Manila Volume/Marketing /Sales/Eng 10.1.1.1 10.1.1.2 10.1.1.3 10.1.1.1ControlPathData Path17

Manila: IBM GPFS!Goal is for GPFS to provide a singledata plane for all data isorGPFSHypervisorManila extends the data planeinto the VMHypervisorNFS or GPFSSupport both cNFS and GPFS!!GuestpNFS in roadmapLeverage Standard GPFS cNFSGPFSScale Out, High Performance,Highly Available, Encryption,Backup, DR, Declustered RAIDRAIDTiered Storage PoolsSSDFastDiskSlowDiskTape18

Manila: NFS-Ganesha Driver!!!!!The NFS-Ganesha is a User SpaceNFS ServerIt is an Open Source project withactive community of both Companyand Independent sponsoreddevelopersProvides a modular architectureproviding File System AbstractionLayer(FSAL) for Storage BackendsGanesha driver will be a gatewaymediated model between Manila andStorage PoolsCurrent work in progress for Manila!!GlusterFSGPFS19

Manila: EMC VNX!Today:!!!!Common driver with PlugincapabilityPrototype supports majority ofManila APICurrently requires that interfacealready exist on tenant networkWIP Items:!!Implement multi-tenancy byautomating management of VirtualData Movers (VDM) and VIF (vianetwork setup/teardown)Add logic for selecting otherphysical data moversInstance/mnt/nfs1HypervisorTenant NetworkVIFShare/ExportFSVDMPhysical Data MoverStorage Pool20

Manila: EMC Isilon!Today:!!!!Creates export/share andallocates quotaSupports majority of Manila APILeverages Host ACL for bothSMB and NFSInstance/mnt/nfs2HypervisorTenant NetworkWIP Items:!!SmartConnect and AccessZones (for multi-tenancy)Define “update share status”VIFNodeOneFSVIFNode21

Manila: Automation!!The manila module isa thorough attempt tomake Puppet capableof managing theentirety of manila.Combination ofPuppet manifests andruby code to deliveryconfiguration andextra functionalitythrough types andproviders.22

Manila: Status!!!!!Officially an incubated OpenStack program (August 26th, 2014)!Work towards Project GraduationMultiple POC’s in progressAdditional contributors and drivers being developedActive Community contributors23

Manila: What is new in Juno!!!!!Manila repos are now under “OpenStack” Github organizationpuppet-manila now on stackforgeIncreased developer & admin documentationRemoval of obsolete/unmaintained driversAdded tempest integration and gate tests24

Manila: Kilo and beyond!!!!!!!!Automate mounting shares within instancesShare Type SupportReplicationManage and Un-manage of SharesBackupTrove Enablement for Manila AwarenessAdditional Vendor Drivers and BackendsDriver Extensions25

Manila: How to get Started!Manila butions!RDO!!OpenSUSE!!RPMs are available now; Packstack integration coming soonRPMs are available now; installer integration coming soonIRC on Freenode!#openstack-manila!!any time#openstack-meeting-alt!15:00 UTC on Thursdays26

Other SNIA-CSI Webcasts! Check out on-demand Webcasts from this CloudDevelopers’ Tutorial Series:! Introducing CDMI 1.1! OpenStack Cloud bcasts! Upcoming CSI Webcasts:! LTFS Bulk Transfer Standard – Feb. 10thhttps://www.brighttalk.com/webcast/663/138935! Hybrid Clouds: Bridging Private & Public CloudInfrastructures – March 18https://www.brighttalk.com/webcast/663/143055

After This Webcast! This webcast and a copy of the slides will be posted tothe SNIA Cloud Storage Initiative (CSI) website andavailable webcasts! A full Q&A from this webcast, including answers toquestions we couldn't get to today, will be posted to theSNIA-CSI blog!http://www.sniacloud.com/! Follow us on Twitter @SNIACloud28

ConclusionThank You29

#openstack-manila on IRC (Freenode) 7 . Manila: Overview of Key Concepts ! Replace homegrown or legacy systems ! Improve IT responsiveness by providing self-service share management ! Integrate Manila with existing automation frameworks through REST API or CLI 8 Manila Shared File Services REST API .