The Cost-Saving Opportunity In Transforming Testing

Transcription

THE WORLD’S #1 CONTINUOUS TESTING PLATFORMThe Cost-Saving Opportunityin Transforming Testing

The Cost-Saving Opportunityin Transforming TestingSoftware testing is often one of the mostexpensive—and inefficient—components ofan IT budget. Most IT leaders are shocked tolearn how much their organization spendson software testing. Over the past 5 years,software testing has consumed an average of23-35% of the overall IT spend (according toCapgemini’s interviews with 1725 IT leaders1).1Capgemini, Sogeti, HPE, World Quality Report 2019-20, 2020 ality-report-2019/).Tricentis2

A painful glimpseHow does this play out on the ground? On the right, you’ll find apainful glimpse at what testing costs on some specific projects atGlobal 2000 organizations (all figures are per year).Given that most IT departments have hundreds of projects andthousands of applications to test, these costs quickly add up—and eatup an exorbitant chunk of the IT budget.It doesn’t have to be this way. There’s a huge opportunity to unlocksubstantial cost savings by optimizing testing. In fact, the companieswith the costly testing processes on the right have already achievedan average of 59% cost savings (approximately 20M a year) bytransforming inefficient software testing processes. At the same time,they also increased speed to market by an average of 26%.Projects atGlobal 2000organizations 7.5MCost to test 22 applications at a 40B retailer (53% automation) 25MCost to test 12 applications ata 22B bank (2% automation) 1.3MCost to test a single application at a 19Bhealthcare provider (0% automation)Tricentis3

Why is software testingso costly?How did software testing become such a money pit? The shortanswer is that testing processes built for a much different era havebecome more of a liability than an asset. What might have workedwith bi-annual or quarterly releases of monolithic applicationsdoesn’t translate to the near-continuous releases of heterogeneous,distributed applications now standard with Agile and DevOps. Tryingto retrofit is inadequate and costly.Tricentis4

8 reasons testing is expensiveAUTOMATION BARRIERSCOMPLEXITYMISGUIDED TESTINGOver 80% of testing is still manual,Assessing the overall userApproximately 67% of the tests beingincluding much repetitive checkingexperience is always challenging—built, maintained, and executed areripe for automation. That consumeseven more so when the average appredundant and add negligible valueresources without achieving theinteracts with 52 other componentsto the testing effort.speed, precision, and scalabilityand a transaction spans web, mobile,required for modern deliveryAPIs, SAP, custom apps, mainframes,processes.etc.Legacy testing processes havebecome a liability in the worldof modern applications, Agile,and DevOps.TEST DATA WAIT TIMEHIGH-MAINTENANCE TESTAUTOMATIONREDUNDANCY AND REWORKAs applications evolve, poorly-writtenefforts commonly lead to duplicatedand overly-brittle tests break. Testersefforts as well as avoidable rework.UNATTAINABLEAUTOMATIONCOVERAGESiloed and disconnected testingREWORKwaste 31% of their time reviewingand fixing broken tests.The majority of testers waste 5-15TEST ENVIRONMENT DELAYSAND COSTShours per week dealing with the test84% of testers are routinely delayedperformed at the UI-level, but UIsdata needed to execute realistic testsby test environment access. Plus,typically aren’t completed until the(average wait time for test data 2access fees are often charged whenvery end of each development cycle.weeks).testing against 3rd party services andUSER INTERFACE (UI) WAIT TIMEThe vast majority of testing (80%) isDELAYSmainframes.Tricentis5

8 cost-saving opportunitiesDEMOCRATIZE AUTOMATIONUNIFY TESTING APPROACHESTEST WHAT MATTERSTest automation doesn’t requireRelying on a different specialist andAligning testing with businessprogramming resources and a hightool set to test each technology fastrisks delivers the greatest ROI inlearning curve. Scriptless automationbecomes unmanageable. Seek cross-the shortest time. With the rightempowers everyone to create andtechnology or technology-agnosticapproach, you can cover 80% ofcontrol their own automation.approaches.your risks with 20% of the effort.ELIMINATE THE MAINTENANCETRAPPROMOTE COLLABORATIONAND REUSEOnce you understand thenature of the beast, you canstart to tame it. Here are someproven strategies for tacklingthe challenges outlined earlier.There are many differentRework, misunderstandings,approaches to test automation, andand mistakes can be preventedsome are more resilient than others.by coordinating all QA activitiesThe less maintenance is required,in a central platform that syncsthe lower your total costs.efforts across testing and projectSUSTAINABLEAUTOMATIONRESILIENCYAND REUSEmanagement tools.OFFER ON-DEMAND TEST DATASIMULATE TEST ENVIRONMENTSSHIFT LEFT TESTINGEnabling testers to access/createSimulating the behavior ofWith new testing technologies,the required test data on demandconnected systems eliminates accesstesting can begin before UIs areeliminates wait time as well asfees and ensures that testing canimplemented. Test at the API layerfalse positives (which are resource-proceed even if test environmentsand use AI-based technologiesintensive to review).are unavailable or unstable.to create UI tests before UIs areSELF-SERVICE SHIFT LEFTcompleted.Tricentis6

Reduce testing costsfast with TricentisThe days of painfully slow and costly testing are over. Meet Tricentis.Using our continuous testing platform, you can release softwareinsanely fast. Leveraging AI and the efficiencies of the cloud, you’ll8 10Insurance CompaniesOF THETOPaccelerate software delivery by drastically reducing test cycle times.You’ll reduce costs by leaving error-prone manual or siloed testingmethods in the dust. And you’ll dramatically increase the quality of7 10Global BanksOF THETOPyour software, boosting release confidence.610Financial ServicesOur end-to-end automation platform is built for the enterprise from7 10Telco Providersthe ground up. Whether it’s model-based automation or completeenterprise reporting and analytics, you’ll rest easy knowing Tricentis isthe undisputed leader with over 1,800 customers around the world.OF THETOPOF THETOP7 10Global ServicesOF THETOPProvidersThe result? Everything changes. Your business wins more business,eliminates bottlenecks, and creates fiercely loyal customers.Tricentis5 10Energy & UtilitiesOF THETOPCompanies7

ADVANCED ANALYTICSCross Project and Portfolio VisibilityContinuous Testing and Automation PlatformAnalyzeManageAutomateAssess RiskDesign and BuildExecute at ScaleReduce testing efforts by exposing risksDesign manual, open source andScale distributed end-to-end testingin critical business processesno-code automated testsfrom mainframe to isTEST GINE8

We’ve helped industry leaders slashtesting costs. We’ll help you too.Tricentis knows exactly how to help you pivot your inefficient softwaretesting from obstacle to opportunity. Our secret sauce is a mix of theindustry-leading technologies, heavily road-tested methodologies, andKey benefitsthe customer focus vital for achieving rapid time-to-value.Here are a few examples of how transforming testing can unlockbudget, accelerate application delivery, and improve the customerREDUCETESTING COSTSexperience. Imagine the possibilities at your organization—and let usknow how we can make it a reality, together.“We cannot have people spending their time on software testing tasksACCELERATERELEASE SPEEDthat can and should be automated. There is much higher-level work todo. We need future-oriented staff, and we can’t afford to make themsuffer by asking them to do needless manual testing.”INCREASESOFTWAREQUALITY—Andreas Kranabitl, CIO SPARTricentis9

Reducing the cost of testing 20M/year at NationwideNationwide Mutual Insurance Company recently prioritized farreaching digital transformation initiatives to propel the century-oldorganization forward. To start, they asked Gartner to evaluate theircore IT programs and learned that their cost of quality was muchhigher than industry peers. Sensing an opportunity to unlock budget,their IT leaders worked with Tricentis to outline a strategy for reducingthe cost of quality across their 2,500 applications.Nationwide began by using Tricentis Tosca to optimize and automatethe core test suites for the applications that historically requiredthe largest amount of testing effort. This maximized their ability togenerate savings as quickly as possible. From there, they prioritizedthe remaining applications, gained the support of the applicationowners, and expanded adoption in a series of 3-month waves.Automation meant that the testing headcount could be reducedapproximately 3X.Tricentis10

In the first year of the program, Nationwide reduced costs 29%,exceeding their target by 150%. They shaved nearly 20M out of theirannual testing budget and reallocated this spend towards digitaltransformation initiatives. It is important to note that this impressivegain was achieved without compromising time-to-market orexceptionally high quality. In fact, while cost savings was the primarygoal, transforming testing actually improved quality and speed as apositive side effect.Tricentis11

Achieving 30-40% direct resourcesavings at a 30B beverage leaderThe world’s largest beverage company understands how difficult itcan be to guarantee system stability during SAP updates. IT struggledwith the overwhelming amount of manual analysis required to checkeach change. Too much time was being wasted. Too many peoplewere being utilized. Too great a risk was being taken.“It’s essential to do a comprehensive SAP system analysis, but it’snot practical to do it manually,” said the application developmentlead for their SAP platform. “We were burning resources and weren’tguaranteeing data integrity, putting general business operations atrisk. We knew automation was the key to this process and we beganthe search for a solution to empower IT to more effectively manageSAP.”That search led to Tricentis LiveCompare, which performs AI-poweredchange impact analysis for SAP updates. “LiveCompare ensures we’reTricentis12

testing the right things and spending resources in the right places.The data received from LiveCompare allows us to more accuratelytailor each test plan to an individual release. Instead of testingeverything, we test only what’s impacted. That has translated into adirect resource savings of 30-40%.”Tricentis13

Cutting testing costs 75% at MoëtHennessy – Louis Vuitton (LVMH)To support corporate goals of double-digit ecommerce growth overthe next 2 years, LVMH, the world’s leading luxury retailer, adoptedan ambitious plan for digital launches. Meeting their objectivesinvolved bringing entirely new brands online as well as introducingexisting brands into new markets. Given their deep-seated corporatecommitment to “deliver excellence,” they had to ensure that eachlaunch was flawless from the start—for every customer on everydevice.Delivering exceptional quality at extreme speed required a testingtransformation – shifting from ad hoc manual inspections of eachrelease to a streamlined, repeatable, and highly-automated process.With the help of Tricentis qTest, LVMH adopted a strategic testdesign methodology, architected test building blocks that enabled70-90% reuse across launches, and orchestrated a set of disparatetest automation tools to mimic realistic customer behavior. TheyTricentis14

also integrated all their testing data into a single pane of glass thatprovides real-time insight into release readiness by persona, feature,and tech layer.The result: LVMH slashed the time required to test each new marketrollout from 50 days to 13 days, met their objective for exceptionalquality, and also cut testing costs 75%.Tricentis15

Final ThoughtsAccording to industry benchmarks, you can expect 10x faster speedand 50% cost savings by optimizing your testing process. This involvesramping up test automation across all teams/technologies, aligningits focus with your top risks and business objectives, and breakingdown information silos across the organization’s disparate qualityprocesses, tools, and contributors.See how your peers and competitors have already turned testinginto a strategic advantage—and contact Tricentis to see how you canfollow in their footsteps.Estimate how test automation could pay off for your organizationUse our ROI calculatorTricentis16

2570 W El Camino Real, Suite #540Mountain View, CA 94040 1 650 383 8329sales@tricentis.com

industry-leading technologies, heavily road-tested methodologies, and the customer focus vital for achieving rapid time-to-value. Here are a few examples of how transforming testing can unlock budget, accelerate application delivery, and improve the customer experience.