Transcription
Test Automation:Agile Enablement forData Warehousing andBusiness Intelligence TeamsPresented to the So ware Quality Associa4on of Denver (SQuAD)March 8, 2016Denver, ColoradoLynn Winterboer, Agile Analy4cs Educator and Coach, @AgileLynnBrad Ewald, DW/BI Solu4on Architect, @JBEwald 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Agenda Why is test automa4on important for agile data teams? Why aren’t all data teams automa4ng their tests today? What is the path to test automa4on? What does simple DW test automa4on look like? 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Why is test automation importantto agile data teams? 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Agile Demands Something DifferentAgile calls for small increments of“poten4ally shippable code”.That means QA is essen4alon a regular, frequent basis.The test suite grows larger each itera4on.Manual tes4ng quickly becomes infeasible.Test SuiteTestSuiteTestSuiteDoesn’t breaksomething we did backhereTestSuiteTestSuiteTestSuiteTestSuiteHow can we be surethat something we dohere 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
Testing is Central to AgileAgile BI development is driven by testsAcceptance criteria are the defini4on of “done”Passing tests are the measure of “done”Regression tests are the measure of “s4ll done” 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
Agile Teams Understand that test automa4on isa key technical enablerto “being agile” 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
Why aren’t all data teamsautomating their teststoday? 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
DW/BI Test Automation ChallengesData industry does not focus on tes4ng as much asother disciplines:Educa4onTeam MembersSkills & Discipline 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
DW/BI Test Automation ChallengesExis4ng tools are not easily adapted to the data world:Development LanguagesWeb and Mobile Focus 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
DW/BI Test Automation ChallengesGood test data sets are hard to come by:Large volumes (on small environments)Shared test environmentsData sensi4vitySmall sets need extra planning and design 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
What is the pathto test automation? 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Agile Testing Perspectives3) Tools &Automa/onTest EnvironmentBuild Automa4onTest Data SetsTest Automa4on Tool1) A2tudes &CultureHighQualityDW/BISystemTes4ng SkillsTest Design, Organiza4on& MaintenanceRepeatable TestsFeedback LoopsBusiness Domain2) Skills &Prac/cesTes4ng is a Team SportLearning CultureBuild Quality In 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
Test Automation PyramidSubjec4ve user feedback is essen4alBrifle tests that areaffected by UI changesWrite these inbusiness domainlanguageManualTestsAppTestsAcceptance TestsPush as many tests aspossible to this layerUnit & Component TestsLisa Crispin & Janet Gregory, Agile Tes6ng: A Prac6cal Guide for Testers and Agile Teams 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
Where to Start?Where does it hurt the most? 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
Where Does It Hurt the Most?Painful test setup?Deploying a new build?Breaks in produc4on?Regression tes4ng?Tes4ng new features?Prone to manual test error? 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
Where to Start?What is the smallest, simplest way youcould relieve that pain? 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
What does simpledata warehousingtest automationlook like? 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Basic ApproachSourceSchemaTargetSchemaComponentunder testTestDataload TestQueriesSta4c TestDataSetupexecutetestsExecuteTestReportClean UpTest Runner 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com Ken Collier, 2016, All Rights Reserved
Demonstration 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Testing FrameworkFunc4onality Screens for describing and crea4ng test cases Procedures that execute tests and create expectedresults BI Reports and Dashboards for monitoringComponents SQL Server and Related Model Microso Access (input screens) SQL Server Stored Procedures (test execu4on) Power Shell scripts (batch execu4on) MS Power BI for Repor4ng 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
What Constitutes a Test?Actual Result(or Dataset)Expected Result(or Dataset) 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Testing Demo 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Session Intent1) Why:Test Automa9on is key to DW/BI agile success2) How:Automate a solid tes9ng prac9ce; don’t automate chaos3) Show:DW/BI test automa9on is not that hard 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Thank You!Lynn WinterboerAgile Analy/cs Educator & @agilelynnBrad EwaldDW/BI Solu/on Architectbrad.ewald@gmail.com@jbewald 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
DW/BI Test Automation ToolsToolDescrip,onDBFitOpen source database tes4ng tooliCEDQhfp://icedq.comA unified plajorm for ETL tes4ng and data migra4ontes4ngAnaly,x Data ServicesEnterprise data mapping and ETL code automa4on,including new automa4c genera4on of reusable test casesassociated with Source to Target MappingsWhereScapehfps://www.wherescape.comData warehouse automa4on so ware, including a testharness framework with user-configurable profilingmethods.Tricen,s ToscaDW-friendly test automa4on comhfp://www.tricen4s.com/tricen4stosca-testsuite/ 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
DW/BI Test Automation ReferencesReferenceDescrip,onAgile Analy*cs: A Value-Driven Approach to BusinessIntelligence and Data WarehousingChapter 7: Test-Driven DataWarehouse Developmentby Dr. Ken CollierAgile Data Warehousing for the Enterprise: A Guide forSolu9on Architects and Project LeadersPart V: Agile EDW QualityManagement PlanningBy Ralph HughesAutomated Data Warehouse Tes*ng: Beginner’s Step-byStep GuideJava-based test automa4on for simpledata warehousing testsby G. SudenAgile Tes*ng: A Prac9cal Guide for Testers and Agile Teams Great introduc4on to agile tes4ng forany type of developmentby Lisa Crispin and Janet GregoryMore Agile Tes*ng: Learning Journeys for the Whole Team Includes several chapters on testautoma4on as well as one dedicatedby Lisa Crispin and Janet Gregoryto agile tes4ng for DW/BI 2016 by Winterboer Agile Analy4cs www.WinterboerAgileAnaly4cs.com
Intelligence and Data Warehousing by Dr. Ken Collier Chapter 7: Test-Driven Data Warehouse Development Agile Data Warehousing for the Enterprise: A Guide for Solu9on Architects and Project Leaders By Ralph Hughes Part V: Agile EDW Quality Management Planning Automated Data Warehouse Tesng: Beginner’s Step-by-Step Guide by G. Suden Java-based test automaon for simple data
