Transcription
Test Automation and StrategyIn a Microsoft Dynamics context2020-10-01www.engagegroup.se
PRESENTERSStefanJegbertJohanPersson
AGENDA Introduction to Test Automation Test Strategy Environments Demo of Microsoft RSAT QA
OUR SERVICES Nordic based company withglobal reachLIFECYCLESERVICESSTRATEGY Provide independent advisoryand specialist support Dynamics focus Complete life-cycle gegroup.se
Introduction toTest Automation
Dynamics 365 ”One Version” with regular updates and functional changesWHYINCREASEDFOCUS OFEFFICIENTANDSTRUCTUREDTESTING Be able to cope with increased cadence of Changes Consistent test quality over time Reduce time (and cost) of executing tests Compliance Request from external stakeholders
WHICH TESTS COULD BE AUTOMATED?PROTOTYPESRELEASE/SPRINTS Mock-up Usability Alpha / Beta Feature testAcceptance (UAT)AccessSimulationsSmoke TestsENVIRONMENTRECURRENT Performance/Load Migration Security & penetration Regression tests Build verification tests End-to-End test scenariosTechnology FacingPURPOSE and BENEFITS Faster Regression CyclesBusiness CrticalSupporting the TeamBusiness Facing Test Effectiveness Integrated Lifecycle Management Accelerated Testing Process Consistent Quality
USAGE & TEST CLASSIFICATION AUTOMATION TEST TOOLe.g. Microsoft RSATBusiness CycleTestsRecordUsersMultiple ComponentTestsWrite CodeTestEngineersWrite CodeDeveloperDataDataIntegrationComponent TestsUnit TestsData Projects & Test Data Acceptance test library (ATL) SysTest framework Data task automation
Test Strategy
Operation Continues Integration/deploymentContinues test executionMonitoring and ReportingHand-over to Defect managementRefine test cases and plans TrainingTESTMGMT Train super users for a commonunderstanding of way-of-working Business case Captures the reasoning, arguments, risks andbenefits for implementing an automationregression testing Test StrategyTestLifecycle Identify and document system landscape,requirements, objectives andresponsibilities in a test strategy (incl.complete test cycle and landscape) Automation test toolselection Implementation Create Guidelines build on best practicesDocument test cases incl. entry and exit criteriaCreate end-to-end test cases with recordingsCreate test plan and hand-over to Operations Identify and map needs and requirementsagainst automation test tools capabilities Demonstrate different tools Compile and present decision material Proof of Concept Implement test tool in Customer environment Run initial workshops/training Design and implement 2-5 test case
WHAT TO TEST?RSATCustomer Service InsightsProject OperationsAzureSales&Sales ProFinance &Supply ChainAI/MLMarketing InsightsCustomer InsightsSales InsightsBusiness CentralPower AppsPower etingPower BIPower Virtual AgentCommerceField ServiceCommon Data Service (CDS) & CDMLinkedIn
WHAT TO TEST?Customer Service InsightsProject OperationsAzureFinance &Supply ChainAI/MLMore ComplexLandscape?Sales&Sales ProMarketing InsightsBusiness CentralPower AppsPower etingPower BIPower Virtual AgentCommerceField ServiceCommon Data Service (CDS) & CDMLinkedIn
RSATExecutive ourceCoding skills requiredBasicBasicMediumAdvancedVendor dependencyHighHighLowNoneCustomizableNoneCRHighNo limitFeature descriptionDynamics F&ODynamics CEISV (Internal)WebRESEARCHTHECORRECTTOOLMobile deviceIntegration/API (Dynamics)Performance testing (Dynamics)LegacyUsabilityBrowser supportDashboardsDevOps IntegrationPricingNoneYearly fee / UserYearly maintenance fee(*different price plans)Yearly maintenance fee(*different price plans)Free
TEST LOYOPERATIONSMIGRATION TESTSOLUTIONDEFECT MANAGEMENTREPORTWHOUNIT TESTINTEGRATION TESTREGRESSION TESTPERFORMANCE TESTTESTINGMONITORINGREPORTHOWPROGRESS TRACKINGPLAN & DESIGNTEST CASE & PLANTEST MGMTADAPT & STDESIGN & BUILDBUILD/STAGEUATPRODUCTIONRUN & IMPROVE
TEST FRAMEWORKPLANDESIGNBUILDStrategyPlan & SuitesEnvironmentProduce and get approval of test strategy that onan high-level describes:Produce test plan that describe detailed scope oftesting and activities to be performed dependenton phase in the project 1.2.3.4.Record test cases Executive summaryStrategy overviewObjectivesApproachAcceptance criteriaDeliverables and responsibilitiesScopeResource planTime planTool selectionValidate and select best fit test toolNegotiate licenses (if any) and secureavailability for installation Record tasks (test cases)Scripts & DataImplementDefine test cases in relation to user stories orprocesses dependent on phase in the project : Build on demands and system landscape: Business Line/unit Business ProcessBusiness Sub-ProcessFunctions & Feature (test script level)Implementation and introduce test toolPrepare system landscape for test execution Entry criteria Test context and environment System readinessTest data load or sample dataExit criteria Solution validated Non-functional requirements validated Acceptance criteria metWay-of-Working Design and establish way of workingEducate test team in tools and way-of-workingOrganisation Establish test organisationInform on roles & responsibilityImplement test suite (linking cases to E2E)Schedule automated test suitesRUN & IMPROVEContinues testing Story testingIntegration testingRegression testingAdapt & Refine Add/included new processes or feature testingto current structure and way of workingAdjust test scripts and suitsProgress tracking Test metrics (blocked, failed, passed)Ensure test process are usedInform product owner(s) on test results
OUR KEY EXPERIENCES Lack of insight that you already have Opt-in when choosing Dynamics 365- In order to efficient manage continuous updates over time Test driven development is a mindset- You will need a few strong ambassadors from start Do not set too high ambitions in the begin- Get started with some easy happy flows You will never reach 100%- It will (and let it) take timeTAKEAWAYSSlide /16 Invest in getting the correct tools and guidance- Get help. There will be some technical challenges in the beginning andmake sure to create good guidelines/trainingThere is a great risk that you take a little too easy on the task and are prepared toinvest in require time and focus. Several of our customers have started themselves buthave quit and before really get started.
Environments
ENVIRONMENTSSandboxSystem & Acceptance TestDevelopmentWebAppTESTPower BIProductionWebAppUATWebAppPRODAzure DBAzureLasernetDEVLasernetInputPROD REGRESSION WARM-UP T10DEV1DEV2DEV3DEV4TESTBUILDUATPRODOctober rel.sandboxPower egrationSystem testRelease masterAcceptance testProductionSystem copyevery 2 weeksPRODDEV/TESTCRMCRMProductionCRM TestTier 1Tier 2Customer managedProductionMicrosoft managedX
ENVIRONMENTSDevelopmentDevelopLocalBuildData ProdProductionPerformanceTestingStandardAdd-onHigh granularity in environment strategy Higher flexibility, speed and quality in executionIn excess granularity Challenge maintenance andsynchronisation and causes highercostsCloud-hosted
TEST AUTOMATION PREPARATIONOrganisationScope of testingDeploymentSecure adequate organisationand resourcesConduct risk assessment andalign with test scopeSecure processes for controlleddeployment020406010305UpgradeTest ToolsTest CasesUpgrade to version 10Implement selected test toolRecord selected transactionscreating test case library
SCOPE - Impact Analyzer
SCOPE - Impact Analyzer
SCOPE - Impact Analyzer
SCOPE - Impact Analyzer
SCOPE – Impact Analyzer
TOOLSCreate TaskRecordings inDynamicsLCS Business Process modellerAzure DevOpsCreateTestcases inDevOpsAdjust Test ManagerDynamics 365 F & SCM Task RecorderEvaluateExecute Tests
HOW?Author and distribute (BPM)Record TestsSave to BusinessProcess ModelerManage/DistributeBPM libraryConfigure test plans (Azure DevOps)Select BPM librarySynchronize to VSTS,Create Test Plans andTest SuitesConfigure Parametersand DataExecute Tests and Manage results (RSAT and Azure DevOps)Update parametersand dataExecuteReport andInvestigate in VSTS
DEMO
Test Automation and Strategy In a Microsoft Dynamics context 2020-10-01 www.engagegroup.se. . Marketing Sales & Sales Pro Customer Service Field Service Finance & Supply Chain Human Resources . CRM DEV/TEST CRM Test Power BI Azure DB WebApp TEST WebApp UAT WebApp PROD PROD CRM Production Production Lasernet Output
