Transcription
Software Quality
Springer-Verlag Berlin Heidelberg GmbH
Martin WieczorekDirk Meyerhoff (Eds.)Software QualityState of the Artin Management, Testing, and ToolsWith Contributions ofR. Baltus, G. Bazzana, A.Birk, H. Bons, M. Bromnick,W. Dzida, J. F. Perpiftcin,A. Fitzke, R. Freitag, R. Goldner,D. Huberty, G. Jahnke, J. Johansen, A.M. Jonassen Hass,P. Keese, T. Lovric ,W. Mellis, D. Meyerhoff, C. Nagel,J. Pries-Heje, C. Radu, B. Roberts, D. Rombach, F. Sazama,M. Timpe, H. Uebel, R. van Megen, D. Vohwinkel, J.Warlitz,M.J. WieczorekSpringer
Martin WieczorekDirk MeyerhoffSQS Software Quality Systems AGStollwerkstr. 1151149 Koln, Germany{martin.wieczorek; dirk.meyerhoff}@sqs.deWith 99 Figures and 14 TablesISBN 978-3-540-78085-4Library of Congress Cataloging-in-Publication Data applied forDie Deutsche Bibliothek - CIP-EinheitsaufnahmeSoftware quality: state of the art in management, testing, and tools/Martin Wieczorek;Dirk Meyerhoff (ed). With contributions of R. Baltus . - Berlin; Heidelberg; New York;Barcelona; Hong Kong; London; Milan; Paris; Singapore; Tokyo: Springer, 2001ISBN 978-3-540-78085-4ISBN 978-3-642-56529-8 (eBook)DOI 10.1007/978-3-642-56529-8This work is subject to copyright. All rights are reserved, whether the whole or part of thematerial is concerned, specifically the rights of translation, reprinting, reuse of illustrations,recitation, broadcasting, reproduction on microfilm or in any other way, and storage indata banks. Duplication of this publication or parts thereof is permitted only under theprovisions of the German Copyright Law of September 9, 1965, in its current version, andpermission for use must always be obtained from Springer-Verlag. Violations are liable forprosecution under the German Copyright Law. Springer-Verlag Berlin Heidelberg 2001Originally published by Springer-Verlag Berlin Heidelberg New York in 2001The use of designations, trademarks, etc. in this publication does not imply, even in theabsence of a specific statement, that such names are exempt from the relevant protectivelaws and regulations and therefore free for general use.Cover design: Kiinkel Lopka, HeidelbergTypesetting: perform, Heidelberg from author ยท s dataPrinted on acid-free paperSPIN 1087021133/31115 4 3 2 1
list of ContributorsROB BALTUSHead of Department Software QualityManagement, Comma Soft AGPutzchens Chaussee 202-204a,53229 Bonn, GermanyEmail: rob.baltus@comma-soft.comWeb: www.comma-soft.comTelephone: 492289770 0Fax: 49228 9770200GUALTIERO BAZZANA, DR.Partner and Managing DirectorOnion SpABrescia 25131, via L. Gusalli n 9, ItalyEmail: gb@onion.itWeb: www.onion.itTelephone: 39 030 3581510Fax: 39 030 3581525ANDREAS BIRKResearcherFraunhofer Institute for ExperimentalSoftware EngineeringSauerwiesen 6, 67661 Kaiserslautern,GermanyEmail: birk@iese.fhg.deWeb: www.iese.fhg.deTelephone: 49 6301 707256Fax: 49 6301 707200HEINZ BONSMember of the BoardSQS Software Quality Systems AGStollwerckstrafie 11, 51149 KOln, GermanyEmail: heinz.bons@sqs.deWeb: www.sqs.deTelephone: 49220391540Fax: 492203915415MIRIAM BROMNICKConsultantOvum LtdCardinal Tower, 12 Farringdon Road,London EC1M 3HS, United KingdomEmail: MBK@ovum.comWeb: www.ovum.comTelephone: 44 20 75519169Fax: 44 20 7551 9090WOLFGANG DZIDA, DR.Senior ScientistGMD, Institute for AutonomousIntelligent SystemsSchlofi Birlinghoven, 53754 Sankt Augustin,GermanyEmail: dzida@gmd.deWeb: www.gmd.deTelephone: 492241 142275Fax: 492241142324JAVIER FERNANDEZ PERPINANConsultantDTKGmbHPalmaille 82, 22767 Hamburg, GermanyEmail: fernandez@dtkhh.deWeb: www.dtkhh.deTelephone: 4940389970 0Fax: 494038997020
VIList of ContributorsANDRE FITZKEGREGOR JAHNKESafety ManagerAlcatel SEL AGLorenzstr. 10, 70435 Stuttgart, GermanyEmail: a.Jitzke@alcatel.deWeb: www.alcatel.deTelephone: 49 71182146518Fax: 49 711 821 44317Head of Department Quality AssuranceARGE IS KV GmbHBismarckstr. 36, 45128 Essen, GermanyEmail: jahnke@iskv.deWeb: www.iskv.deTelephone: 49201 1094 139Fax: 492011094130REGINE FREITAGJ0RN JOHANSENResearcherGMD, Institute for Autonomous IntelligentSystemsSchlofl Birlinghoven, 53754 Sankt Augustin,GermanyEmail: regine.freitag@gmd.deWeb: www.gmd.deTelephone: 492241 142047Fax: 492241142324Department ManagerDELTA Danish Electronics, Light &Acoustics, Department Software TechnologyVenlighedsvej 4, DK-2970 Horsholm,DenmarkEmail: joj@delta.dkWeb: www.delta.dkTelephone: 45 45 86 7722Fax: 45 45 8658 96RUDOLF GOLDNERANNE METTE JONASSEN HASSHead of Department ApplicationDevelopmentRZF NRW - IT Centre ofNorthrine Westphalia's Finance DepartmentRoss-Strafle 131, 40476 wNRW.deWeb: www.rzf-nrw.deTelephone: 49211 4572 432Fax: 49211 4783 3003Senior Software ConsultantDELTA Danish Electronics, Light &Acoustics, Department Software TechnologyVenlighedsvej 4, DK-2970 Horsholm,DenmarkEmail: amj@delta.dkWeb: www.delta.dkTelephone: 4545867722Fax: 45 45 86 58 96DIRK HUBERTYSenior ConsultantSQS Software Quality Systems AGStollwerckstrafle 11, 51149 Koln, GermanyEmail: dirk.huberty@sqs.deWeb: www.sqs.deTelephone: 49220391540Fax: 492203915415PAUL KEESESenior ConsultantSQS Software Quality Systems AGStollwerckstrafle 11, 51149 Koln, GermanyEmail: paul.keese@sqs.deWeb: www.sqs.deTelephone: 49220391540Fax: 492203915415
List of ContributorsVIITOMISLA V LOVRIC, DR.JAN PRIES-HEJE, PH.D.Head of Department Software-Based SafeComputer ArchitectureTiN InterTraffic GmbH, ISEBAm Grauen Stein, 51105 KOln, GermanyEmail: bahn-tuev@iseb.comWeb: www.iseb.comTelephone: 49221 8061805Fax: 49221 8062581Member of Department of ComputerInformation SystemsJ. Mack Robinson College of BusinessP.O.Box 4015, Atlanta, GA 30302-4015, USAEmail: jpries@cis.gsu.eduWeb: www.cis.gsu.eduTelephone: 1 404 651 3880WERNER MELLIS, PROF. DR.Senior ConsultantIntegri nvLeuvensesteenweg 325,1932 Zaventem,BelgiumEmail: cradu@integri.beWeb: www.integri.beTelephone: 3227120750Fax: 32 27120767CRISTIAN RADU, DR.Head of Information Systems DepartmentUniversity of ColognePohligstr. 1, 50969 Koln, GermanyEmail: werner.mellis@uni-koeln.deWeb: www.uni-koeln.deTelephone: 49221 4705368Fax: 492214705386DIRK MEYERHOFF, DR.BARBARA ROBERTSHead of Departments ConsultancyProducts / Performance TestingSQS Software Quality Systems AGStollwerckstrafte 11, 51149 Koln, GermanyEmail: dirk.meyerhoff@sqs.deWeb: www.sqs.deTelephone: 49220391540Fax: 492203915415DSDM ConsultantF.I. Group picCampus 300, Maylands A venue, HemelHempstead, HP2 7TO, United KingdomEmail: Barbara Roberts@figroup.co.ukWeb: www.figroup.co.ukTelephone: 4414768618,55Fax: 44 1476861855CHRISTOF NAGEL, DR.DIETER ROMBACH, PROF. DR.Team Software EngineeringT-Nova Deutsche Telekom Innovationsgesellschaft mbHNeugrabenweg 4, 66123 Saarbrucken, GermanyEmail: christof.nagel@telekom.deWeb: www.telekom.deTelephone: 49 6819093216Fax: 49 716192555757Executive DirectorFraunhofer Institute for ExperimentalSoftware EngineeringSauerwiesen 6, 67661 Kaiserslautern,GermanyEmail: rombach@iese.fhg.deWeb: www.iese.fhg.deTelephone: 49 6301 707100Fax: 49 6301 707200
VIIIList of ContributorsFRANK SAZAMADETLEF VOHWINKELResearcherSenior ConsultantDaimlerChrysler AG, Research andSQS Software Quality Systems AGTechnology / SW EngineeringStollwerckstrafle 11, 51149 Koln, GermanyP.O. Box 2660,89013 Ulm, Germany(with Q-Labs since October 1, 2000)Email: detlef.vohwinkel@sqs.deEmail: frank.sazama@q-labs.deTelephone: 49220391540Web: www.daimlerchrysler.comFax:Web: www.sqs.de 492203915415Telephone: 49 711 806081 31Fax: 49 711 806081 99JOACHIM WARLITZ, DR.Head of Assessment DepartmentMICHAEL TIMPEAlcatel SEL AGHead of Software Development DepartmentLorenzstr. 10, 70435 Stuttgart, GermanyEmail: j.warlitz@alcatel.deMED medicine online AGFriedrich-Ebert-Strafle, Haus 51,Web: www.alcatel.de51429 Bergisch Gladbach, GermanyTelephone: 49 711 821 46176Email: michael.timpe@medicineonline.deFax: 49 711 821 46902Web: www.medicineonline.deTelephone: 49 02204 843730MARTIN J. WIECZOREK, DR.Fax: 49 02204 843731Head of Departments Telecommunication /Public and CareHELMUT UEBELSQS Software Quality Systems AGMarketing DirectorStollwerckstrafle 11, 51149 Koln, GermanyEmail: martin.wieczorek@sqs.deAlcatel SEL AGLorenzstr. 10, 70435 Stuttgart, GermanyEmail: h.uebel@alcatel.deWeb: www.alcatel.deTelephone: 49 711 821 44492Fax: 49 711 821 46813RUDOLF VAN MEGENMember of the BoardSQS Software Quality Systems AGStollwerckstrafle 11, 51149 KOln, GermanyEmail: rudolf.van megen@sqs.deWeb: www.sqs.de 49220391540 492203915415Telephone:Fax:Web: www.sqs.deTelephone:Fax: 49220391540 492203915415
Preface to the Series software.quality@xpert.pressQuality management and software testing are among the most important topics insoftware development and IT management, responsible for about 40 per cent of thecosts of software projects. During the development phase over a third of all money isspent on the retrieval, prevention and removal of errors. Unless the significance ofquality management and testing is recognised, IT projects can easily fail, as applicationand implementation errors can cause considerable follow-up costs and very high upgrade expenses.In the early 90s, the completion of the new Denver International Airport (Colorado,USA), for instance, was delayed by 16 months (Harvard Business Manager 6/2000).Originally, this major airport was to start operating in autumn 1993, but the openinghad to be postponed until February 1995. The delay was due to inadequate testing ofthe programs controlling the computerised baggage routing system. The project had tobe discontinued, and the original idea was abandoned. By then the delay in commissioning had caused additional expenses of nearly US 2 billion.Another example is the launch of an IT system for the billing of share transactions atthe London Stock Exchange. The project, called "Taurus", started in May 1986 and wasstopped seven years later, after the Stock Exchange had invested over 89 million andbrokerage firms had spent another 400 million on developing Taurus-compatiblesystems. The development of an electronic transfer system had failed, and the bull "Taurus" - had hit a brick wall.These are two among many failures of IT projects which could have been avoidedthrough systematic software quality management. But IT projects can proceed quitedifferently - without straining the budget and without loss of time. This is borne out bynumerous successful projects from a variety of industries, where the main focus was onsoftware quality management and software testing from the very beginning. The quality of the software was prioritised as a key factor for the success and economic viabilityof IT projects.In the age of Internet and e-commerce, the reliability of IT systems is becoming increasingly important. Whereas software errors could still be removed "manually" inthe days of host computers, the Internet mercilessly reveals every single IT error to acompany's customers. Moreover, once a potential customer has tried to place an onlineorder and has failed, he is unlikely to return. In a global economy where worldwidecompetitors are virtually on the customer's doorstep, no enterprise can afford such aloss, whatever its size.
XPreface to the Series software.quality@xpert.pressBut we are also being faced with software quality in our daily lives. Nowadays we areliterally surrounded by machinery that carries out small, but vital jobs. A modern vehicle, for instance, has about 60 chips that guarantee a safe ride through the traffic - fromthe airbag to the most important engine functions.The increasing importance of high-quality computing systems in our informationsociety is to be the focus of the new series called "software.quality@xpert.press " whichis launched by SQS. Issues of this series are to be published by Springer from time totime, highlighting and discussing the state of the art and developments in softwarequality management and software testing. The focus will be not so much on the scientific background, but on sharing hands-on experience with those involved in day-today work.HEINZ BONSRUDOLF V AN MEGENSQS AG Member of the BoardSQS A G Member of the Board
Preface to the Volume Software Quality - State of the Artin Management, Testing and ToolsMany companies, administrative bodies and organisations are facing the same questions: How can we improve the quality of our IT while at the same time reducing ourcosts? Unlike in traditional production, which brought forth economic trend conceptssuch as "lean production", the idea of "quality and IT" is still rather nebulous formany. Yet software quality management has long been part of everyday life and, onmany markets, a decisive competitive factor. In particular, this includes areas such ase-business, financial services and telecommunication, as no company can afford rejected orders, failed monetary transfers or faulty phone bills.With this first volume of Springer's new series "software.quality@xpert.press" we areproviding a collection of articles on topical issues of software quality management andsoftware testing, written by authors of national and international reputation. The articles are largely the result of two conferences held in 2000: SQM "Software QualityManagement" and the ICSTEST "International Conference on Software Testing". Bothare organised and conducted on an annual basis by SQS Software Quality Systems AG.The articles bridge the gap between strategic quality planning and everyday operations in corporate IT departments. They largely reflect current practices and experience. Everything that is said is the result of successful projects from a variety of sectors,countries and types of companies, offering new and sometimes unusual approaches totopics that are thought to be rather well-known.This first volume is divided into three parts. The first part discusses topics from software quality management: the latest approaches to software development and their effects on current methods and procedures in quality assurance, practical experience inthe application of process improvement programs as well as the effects of knowledgemanagement on quality management. One important issue that can foster the significance and acceptance of software tests is the question of financial profitability. Aresoftware tests worthwhile? This question is answered in practical cost/benefit models.The second part is about the certification and testing of software and of systems thatintegrate software as an important component. The focus is particularly on the Internetand electronic commerce, as these are areas where software testing has been significantand obvious to all users. Here, even the slightest errors would be detected by customersimmediately, so that web applications - particularly banking modules - need to standup to any test. Another example is safety-critical software: for instance, because of theircommitment towards public licensing authorities, railway suppliers have been pioneers
XIIPreface to the Volume software quality@Xpert.pressin the testing and certification of software. Their experience can provide importantstimuli to all other sectors.Finally, part three of this volume presents the state of the art in testing tools and discusses new trends and perspectives in this area.This volume is aimed at IT decision makers and executives as well as IT specialistsfrom the various corporate divisions that are concerned with questions of softwarequality management, software quality assurance and software testing.We would like to thank all the authors for their great interest in this book project andfor their outstanding support in its realisation. Without them, it would have been impossible to compile this high-quality collection of highly practical examples from software development and software quality management projects. We hope that alleveryday examples from everyday life, compiled for the first time in this book, willserve as signposts - and perhaps also as instructions - towards better IT quality andeconomic viability.MARTIN WIECZOREKDIRK MEYERHOFFSQSAGSQSAG
Table of ContentsPart I Software Quality ManagementI.1Paradigms of Software Quality Management and Software DevelopmentWerner Mellis:Process and Product Orientation in Software Development andtheir Effect on Software Quality Management . 3Barbara Roberts:Dynamic Systems Development Method,The Standard for Rapid Application Development . 16I.2Process Oriented Software Quality ManagementAndreas Birk and Dieter Rombach:A Practical Approach to Continuous Improvementin Software Engineering . 34Jan Pries-Heje & Anne Mette Jonassen Hass and Jorn Johansen:Taking the Temperature on Danish Software Quality . 46Detlef Vohwinkel:Test process assessments and improvement . 611.3Knowledge and Quality ManagementFrank Sazama:An organizational approach for experience-basedprocess improvement in software engineering:The Software Experience Center . 73ChristofNagel:Knowledge Management: A pragmatic process based approach . 89Rob Baltus:Integrating Knowledge Management and Quality Management . 1071.4Cost Benefit Models for Quality AssuranceRudolf GOldner:A Cost-Benefit Model for Software Testing . 126
XIVTable of ContentsGregor Jahnke:An Example Cost/Benefit Analysis forQuality Management Systems . 135Part II Certification and TestingILl Testing Functional and Non-Functional RequirementsPaul Keese:Scalable Acceptance Testing . 149Wolfgang Dzida and Regine Freitag:Usability Testing - The DATech Standard . 160IL2 Testing Web and E-Business ApplicationsGualtiero Bazzana:Ensuring the quality of Web Sites and E-commerce applications . 178Michael Timpe:Pair Programming and Testing in a Medical Web Project . 192Dirk Meyerhoff and Dirk Huberty:Testing Web-Based Home Banking Applications . 200II.3 Certification and Testing of Embedded and Safety-Critical SystemsHelmut Uebel, Andre Fitzke and Joachim Warlitz:European Standards in the Field of Railway Signallingand their Influence on Software Testing Methods . 209Tomislav Lovric:Requirements for the Certification of Safety Critical Railway Systems . 225Cristian Radu:Test Environment for Terminal Certification . 241Javier Fernandez Perpiiian:Remote Testing of Embedded Software . 259Part III ToolsMiriam Bromnick:Testing Tools, Trends and Perspectives . 275Author's Index . 288
Software Engineering Sauerwiesen 6, 67661 Kaiserslautern, Germany Email: birk@iese.fhg.de Web: www.iese.fhg.de Telephone: 49 6301 707256 Fax: 49 6301 707200 HEINZ BONS Member of the Board SQS Software Quality Systems AG Stollwerckstrafie 11, 51149 KOln, Germany Email: heinz.bons@sqs.de Web: www.sqs.de Telephone: 49220391540
