Lessons Learned From Putting Linux On System Z In . - IBM

Transcription

Hans-Joachim Picht Linux on System z Initiatives hans@de.ibm.com 16/17 February 2011Lessons LearnedFrom Putting Linux on System zin Production

Background: zLinux Hans from WW will come and answer all yourquestions - or why to never ask a secretary to assist in travel booking.me219.5 days in the air (an airline crew member flies an avg of 37.5 days per year) 2011 IBM Corporation

Disclaimer: More Questions than Answers Every site is different. I'm not omniscient I'm going to give you questions to ask back at yourcompany I ll also take questions as we go along unless timegets short ?Most of the content is based on what I have seen atcustomers in Europe, Middle East, Africa, Asia Pacificand to a small degree in North America Other IBMers / clients might experience differentchallenges3 2011 IBM Corporation

Survey: Who has not worked with Linux on System z before?4 2011 IBM Corporation

Traditional Mainframe5Data CenterLWSLSHWLWHSH 2011 IBM Corporation

TraditionalMainframe6NewWorkloadData CenterLWSLSHWLWHSH 2011 IBM Corporation

Data CenterLinux onlyMainframe7LWSLSHWLWHSH 2011 IBM Corporation

What you see depends on the perception.or your background8 2011 IBM Corporation

What you see depends on the perception.or your background9 2011 IBM Corporation

What you see depends on the perception.or your background10 2011 IBM Corporation

What you see depends on the perception.or your background11 2011 IBM Corporation

What you see depends on the perception.or your background12 2011 IBM Corporation

What you see depends on the perception.or your background This is a mainframe,and can lately alsobe used to run theLinux Operating System. 13 2011 IBM Corporation

What you see depends on the perception.or your backgroundThis is a high end server usingLinux & Virtualizationfor massive Server Consolidation(IBM Enterprise Linux Server) This is a mainframe,and can lately alsobe used to run theLinux Operating System. 14 2011 IBM Corporation

Do we all speak the same language?Bill Smith25 years ofMainframe experienceIPL4-wayMain StorageDASDOSA15Alice JonesGrew up with amobile phoneMulti CoreGigabit EthernetMemorySAN. 2011 IBM Corporation

IBM Enterprise Linux Server Offering Standard z10 BC Mainframe Two 3.5GHz processors enabled for Linux 64 GB of memory Fibre and ethernet communications IBM Virtualisation z/VM including 3 years S&S HW maintenance for 3 yearsSystem z 10Linux z/VM z10 BC ELSStarting at a price of 294 k (312 k )!Incremental IFL starting at 96k (99 k )!16 2011 IBM Corporation

Solution Edition for Enterprise Linux Server The System z Solution Edition forTraditionalMainframeNewWorkloadEnterprise Linux offers a set ofIntegrated Facility for Linux (IFL)processors, memory, I/O connectivityand z/VM virtualization software inflexible configurations to an existingmainframe system For.Incremental new workload Cannot be applied to existingworkload17 2011 IBM Corporation

Novell SuSEEnterpriseLinux ServerOption 118System z 10The Linux Support is not included in these bundlesRed HatEnterpriseLinuxServerOption 2 2011 IBM Corporation

Lessons Learned From Putting Linux on System z in ProductionPerception of Linux on zLinux on System z Adoption for ConsolidationWHY?Sensemaking forServerConsolidationIBM: Readyfor theEnterprise200019CPU SpeedTime2010 2011 IBM Corporation

How Do Companies Typically Select a Platform for TheirApplications? Their first question is: Will it run there? Their second question is: How much does the hardware cost? They re done!But this is just a TCA viewIs that all they should be thinking about?20 2011 IBM Corporation

What Did We Miss?21 2011 IBM Corporation

What Did We Miss?Nonfunctional owerMaintainabilityQuestions that lead to a more complete TCO view must22be considered 2011 IBM Corporation

So what is new?MainframeitieszBXProvides newsolutions23Weare fastThe Solution Editionssolve the businessproblem 2011 IBM Corporation

A myriad of factors influence platform ationsLocalMomentum24Factors 2011 IBM Corporation

If we simplify it a little bit.IBM System z HW Loaner Program Architecture & InstallationSupport,.ValuePropositionPoC Business Cases Sizing Servers for IFLs Value of Linux on System z Presentations .25 Linux Implementation zVM & Linux HealthcheckPurchase&Production 2011 IBM Corporation

Managing a Linux POCClosingTestingInstallation &Set UpProjectDefinitionProjectInitiation26 2011 IBM Corporation

Managing a Linux POCValue Proposition Learning the value of System zLinux Server Consolidation Sizings Business Case DevelopmentPOC InitiativeProjectInitiation27 Scoping POC POC IFL Sizings Real memory sizing Scope Document Statement of Work 2011 IBM Corporation

Managing a Linux POCInfrastructure Planning Hardware Software Network Security Disk Backup & RecoveryProject PlanningProjectDefinitionProjectInitiation28 Scope Document Project Plan Systems Assurance Statement of Work Status Report Phone / Email SupportIBM Loaner Program POR date Success Criteria Configs Sizings IBM Contracts Linux Eval Software Evals 2011 IBM Corporation

Managing a Linux POC IBM loaner Eq. ClosingzVM & Linux install Other SW install Network Security Disk DB loads Application set up Other Distributed Servers Regular Status Meeting & Installation &Set UpProjectDefinitionProjectInitiation29Report 2011 IBM Corporation

Managing a Linux POCTestingInstallation &Set UpProjectDefinition Test Plan Regular Status Mtg &Report ProjectInitiation30Issues ManagementResource Management In house IBM Linux Distro ISVs 2011 IBM Corporation

Managing a Linux POCClosingTestingInstallation &Set Up Customer Final Report Success Criteria Acceptance IFL Purchased or removedProjectDefinitionProjectInitiation31 2011 IBM Corporation

Managing a Linux POCClosingTestingInstallation &Set UpProjectDefinition1-8weeks2-20 weeks1-3 weeks3-5 weeksProjectInitiation32 2011 IBM Corporation

Example: Runtime PerformanceOperations Per SecondExpectationLinux isslow?RealityTime33 2011 IBM Corporation

Example: Runtime PerformanceRealityOperations Per SecondExpectationContextRemoved theDebugstatement.OriginalTest runTime34 2011 IBM Corporation

Choosing the Scope is CriticalSignificantenough3 VM's35400 DB'sNotoverwhelming 2011 IBM Corporation

PlaningResourceCommitmentSuccess CriteriaSenior ManagementCommitment36 2011 IBM Corporation

TestingTest Plan& Outline testsSomethingisdifferenteep track ofach run s changesresults37Is isBetter now?Document performancetargets when comparedto current 2011 IBM Corporation

Learning Curve: Ask for help early Leverage IBM and BP resourcesOpen problems with software vendors too, i.e. Oracle, RedHat or NovellLearningGet help fromothersDo it all aloneTime38 2011 IBM Corporation

Beware of a single Benchmark POCStay away from performance benchmark tests that drivethe IFL to 100% to determine maximum transactionscompared to Intel/Power platforms.Linux on System z sweet spot is as a multi-tasker.A simple core to core comparison might not be the rightapproachI know in the past we had to say this because our CPUwas slow now this is no longer the case39 2011 IBM Corporation

One Box is EnoughHP NehalemzEnterprise196Current SPARC150 Sun/Solaris DB servers75 HP (IA) DB servers1 zEnterprisez196 Linux OnlyThe reasons are compelling especially when Softwarewhich is licensed by the core is used!40 2011 IBM Corporation

Installation Planning: First Things FirstGet the right groups involved y(including network security) 2011 IBM Corporation

Installation Planning: First Things FirstDRAW PICTURES! Doing anything else might get you in trouble42 2011 IBM Corporation

Installation Planning: First Things First Installing Linux is not like installing z/OS or z/VM (hopefully you renot surprised) For mainframe installs, you will need an installation server It s best if this is a Linux or UNIX system There must be a usable TCP/IP network connection between theinstallation server and your target system This means end-to-end, through whatever firewalls, routers,bridges, WAN links, whatever43 2011 IBM Corporation

Disk Storage Selection What kind of disk/DASD devices are you going to be using? Directly attached (FICON or ESCON) SCSI over FCP iSCSI SAN NASSCSI over FCP gives better performance, and the SAN adapters are cheaper,but you might need additional adapters on the mainframe side. (Can be used forFICON or FCP, but not both at the same time.) Make sure that your storage hardware is certified/compatible with z/VM & Linuxon System z? 44Who do you need to work with to make that work correctly? 2011 IBM Corporation

Don't turn a PoC into a Production Environment!A Proof of Concept is designed to demonstratethe feasibility of a solution.You should not confuse this with a system statewhich is either close to production or can betransferred into a production environment easily.45 2011 IBM Corporation

Workload share on utilized IFLsPrimary applications in the past60% Application serving for z/OSe.g. WebSphere, SAP, CICS TG, DB2 Connect30% Data servinge.g. Oracle DB, DB2 UDB5%Workplace servinge.g. Domino, Scalix, other e-mail5%Infrastructure servinge.g. Apache, Samba, NFS, etc. 1% Linux application development/deployment46 2011 IBM Corporation

Latest Customer Survey: Workloads run on Linux System z(Existing Customers)ApplicationDevelopment68%Web Serving57%Batch54%OLTP49%File & 8%Data Analysis27%Data WarehousingEmailProxy Caching24%19%16% 2011 IBM Corporation47Workgroup16%

Latest Customer Survey: Migrations ReasonsBetter reliability/resilience52%Reduction of cost35%Consolidation Efficiencies29%Co-residency with data already on themainframeImproved performance16%Mainframe is company standard16%Recommendation from ISV or SI10%Security of the mainframe10%Better software compatibility6%Software requirements6%Other4819%13% 2011 IBM Corporation

Latest Customer Survey: Previous Platform for ConsolidatedWorkloads63%63%Window s basedplatforms4950%43%50%43%Unix basedplatformsLinux (not on)mainframe33%30%Linux (on)mainframez/OS or Oetc 2011 IBM Corporation

Linux on System z: Consolidation vs. New ApplicationsQ: Are you using Linux on System z to consolidate workloads, host new applications or both?Many users start with a Linux consolidation project ordeploy new applications, and then expand their use ofLinux on System z to do both.50Source: 2009 IBM Market Intelligence 2011 IBM Corporation

OracleLong-Term Partnership: Oracle & IBM have partnered for over 21 years (JD Edwards over 30 Years) More than 19,000 joint customers worldwideIBM has on-site resources at Oracle locations dedicated to testing all major Oracle applicationsThe core factor for z196does not changeWe expect 11GR2 in Q1 the current (limited) betaTest is running successfullCollaborate51CompeteWe are happyTo assist in Oracle DBMigrationsto Linux on System z 2011 IBM Corporation

Oracle"Agrowing number of customers are deployingSystem z virtual Linux servers on the Oracle Grid.Now with IBM's new aggressive pricing for Linuxprocessors IBM has improved the economics ofrunning Oracle solutions with IBM System z servers."Matt Puccini, OracleManaging Director Oracle/IBM Integrated Solutions52 2011 IBM Corporation

Workload Migration ComplexityVery ComplexComplexMigration ComplexityDown level middlewarePartitioned DBsHigh AvailabilityEasyIHSDominoDBsSimple Standards basedSOAApp Server C, C compilersCustom codeSignificant Code upgradesreq before migrateMany Korn,Perl scriptsMultipleSecurity Zones1Single JVMLike to LikeInfra WorkloadsMigration Cost per Server: Segment migration costs based on complexity of workload53e: Minimizerisk by segmenting applications into price / variability segments 2011 IBM Corporation

Good fit application workloadsApplications requiring top end WebSphere MQ DB2 Connect CICS Transaction Gateway IMS Connect for JavaCommunications Controller for SAPLinux WebSphere and JAVA applications development Virtualization and Security Services WebSphere Application Server (WAS), Portal InfoSphere Domino Cognos Network Infrastructure, FTP, NFS, DNS, Communigate Pro (VoIP) Oracle Database . .54 disaster recovery model Communications Server and 2011 IBM Corporation

Application Selection What applications are you going to run? Not everything that runs on Linux is available for Linux on System z. (OpenSource included!) Ask your ISVs to be specific; they may need to get back to you. All Open Source, all commercial, or a mixture? What are the virtual/real storage requirements for the applications to be run? Oracle can be a tremendous storage hog: But the per-processor licensing cangive big savings on the software license How much disk space is going to be needed? This can drive the decision on SCSI versus ECKD Aggregating 3390-#'s into multiple Terabyte file systems is a painHave a look at the IBM Linux on System z ISV Application s/isv/linuxproduct.html55 2011 IBM Corporation

What is missing?56 2011 IBM Corporation

Typical Recommended Solution on Linux on System zz/VM Production LPAR 1LPAR weight 35%WASDMGRWASDmgrWASServerWASServerz/VM Production LPAR 2LPAR weight Clusterz/VM Test/Development LPARLPAR weight 30%TestTestTestTestDevDEVDevDEVDevDevDEVDevIFLs sharedHTTPHTTPServerServer All Linux virtual serversdraw from a commonpool of memory andIFLs. Resources from a failedserver flow to survivingservers Small applicationclusters (Just enoughnodes for failover) Smaller cluster reducesfailure points Two LPARs runproduction workload. Applications run inclusters split betweenthe prod LPARs.Each blue box is a virtual Linux server.57 2011 IBM Corporation

Deciding on a DistributionNovell / SuSE58Red Hat 2011 IBM Corporation

Deciding on a Distribution IBM is natural: We usually don't recommend one distribution or the other. Compared to the Linux on x86 market you are in the fortunate position that youonly have to choose between two distributors Novell and RedHat are strategic partners of IBM. You can also run GNU/Debian Linux but then you can only get support from alimited number of 3rd parties (e.g. System z BP's) -also no ISV application iscertified for Debian on z. Don't ask us about the market share. Each distributor provides different numberswhich add up to more than 100% and we don't track this data on our side59 2011 IBM Corporation

Deciding on a Distribution: Some AdviceIf you are already familiar with one distribution on x86 you mightwant to run the same flavor on the mainframe If you plan to host an ISV application make sure that it is certifiedfor the distribution of your choice (not all products are certified foreach distro. Also check the release level (e.g. 5.5, 10.2) If you are still unsure, invite a representative of each distribution toyour side 60 2011 IBM Corporation

Enterprise Linux Distributions Tested & Supportedz196z10z9zSeriesRHEL 6RHEL 5SLES 10SLES es/testedplatforms.html61 2011 IBM Corporation

Methodology for Installing and Maintaining Linux Cloning Manual installation nobody wants to install 20 servers manually, no matter ifthey run on x86 or the mainframe! Autoyast (SuSE) Kickstart (Red Hat)Novell / SuSE62Red Hat 2011 IBM Corporation

The Why, What of CloningWhy Cloning? Standardized configurations Facilitates maintenance testing & rollout Time savings Cost savingsWhat can be cloned? z/OS: It takes 2.0-2.5Hours. Cloned by running 50 batch jobs)63z/VM: Takes about 2-3minutes to clone z/VMBut takes 20-30 min ifFlash Copy is notavailable)z/Linux: Virtual Servers arecloned in 5 minutes. 15 minutes if FlashCopy DASD feature notavailable 2011 IBM Corporation

Who will be responsible for the virtual Linux environments Organizational challenges and the question about responsibilities and pplicationLinuxz/VM HypervisorHardware (LPAR, IOCDS, Storage, OSA)MainframeMainframeLinux/Unixto draw the line between various departments 2011 IBM Corporation

Who will be responsible for the virtual Linux environments Did I forget to tell you that we are alreadyin production with Linux on System z 65 2011 IBM Corporation

Which skills are needed?Mainframe Hardware / Storage / Network(no difference with a z/OS shop)66 2011 IBM Corporation

Which skills are needed?z/VM: Installation, Configuration, Management-critical for the Linux deployment,cloning,.Mainframe Hardware / Storage / Network(no difference with a z/OS shop)67 2011 IBM Corporation

Which skills are needed?Linux: The difference between Linux on x86 andSystem z is usually smaller than expectedz/VM: Installation, Configuration, Management-critical for the Linux deployment,cloning,.Mainframe Hardware / Storage / Network(no difference with a z/OS shop)68 2011 IBM Corporation

Which skills are needed?Middleware: Websphere is Websphere in mostCases no matter on which OS/plattform we run itLinux: The difference between Linux on x86 andSystem z is usually smaller than expectedz/VM: Installation, Configuration, Management-critical for the Linux deployment,cloning,.Mainframe Hardware / Storage / Network(no difference with a z/OS shop)69 2011 IBM Corporation

Which skills are needed?Application: If possible adjust your applicationto the characteristics of a virtualized environmentMiddleware: Websphere is Websphere in mostCases no matter on which OS/plattform we run itLinux: The difference between Linux on x86 andSystem z is usually smaller than expectedz/VM: Installation, Configuration, Management-critical for the Linux deployment,cloning,.Mainframe Hardware / Storage / Network(no difference with a z/OS shop)70 2011 IBM Corporation

A typical customer: ACME Inc. During the second half of 2010 ACME Inc. purchased an IBM System z mainframe to actas a server consolidation platform. Hardware (excerpt) IBM System z10 Enterprise Class Model: 2097-E12 96GB memory 3 Integrated Facility for Linux (IFL) CPU's IBM System Storage DS6800 Disk Model: 1750 522 Parallel Access Volume (PAV) licence.In z10 has been configured with 4 LPARs: Production, Development, Software and onereserved for future use. 71The system is going to be used as a server consolidation platform. Multiple WebSphere servers running on Intel machines will be consolidated toLinux servers running as virtualized guests hosted by the z/VM operating system. Each LPAR will run a z/VM 5.4 operating system. 2011 IBM Corporation

Architectural Setup: ACME Inc.System z10 2097 E12LINUxLINUxLINUxLINUxCMSz/VM CPPRODLPARLINUxLINUxLINUxLINUxCMSCMSz/VM CPz/VM CPDEVLPARTESTLPARz/VM CPSPARELPARPR/SMFor the initial implementation each LPAR has been given access to 3 shared IFL's i.e. no dedicated IPL's have been configuredIFL Weight: 70% Production, 10 % Development, 10 % Test, 10 % Spare LPAR72 2011 IBM Corporation

73ZLS1E1zLinux Dev. ERPLPARfor LINUXIFLs (shared)ZLS2Q1ZLH3P1ZLS3P1ZLS3M1zLinux Test/QA ERPzLinux Prod. HRzLinux Prod. ERPzLinux Prod. SolManLPARLPARLPARLPARDevelopmentZDBE1Test QAZDBQ1ProductionZDBP1z/VM & z/VSE4x IFLsSAP Requirement: Dev, Test & Prod Systemsz/VSE Developmentz/VSE Productionz/OS Production 3x DB2H3P, S3P, S3MZLIN1z/OS Test/QA3x DB2E2Q, H2Q, S2Qz/VM V5 for Linuxz/OS Dev.4x DB2E1E, H1E, S1E, S1MZLH2Q1zLinux Test/QA HRzLinux Test/QA Sandbox ZLE2Q1ZLS1M

Lessons Learned From Putting Linux on System z in Production Hans-Joachim Picht – Linux on System z Initiatives <