Transcription
31st Annual ITEA Symposium“T&E to Achieve Better Buying Power”Dr. C. David BrownDASD(DT&E)Director, Defense Test Resource Management CenterCrystal Gateway MarriottOctober 7, 2014DISTRIBUTION STATEMENT A – Cleared for Open Publicationby OSR on October 7, 2014 – SR case number 15-S-00401
“Shift Left” Initiative Achieves Better Buying Power Objectives– Focus critical DT&E activities earlier in theacquisition cycle!– Three initial focus areas: Earlier Mission Context Earlier Interoperability Testing Earlier Cybersecurity TestingUSD(AT&L) White PaperBBP 3.0 “Shift Left” the right information, right time:– Technical (e.g., PDR/CDR)– Programmatic (e.g., LLP)– Acquisition (e.g., MS C)Grounded in USD(AT&L) Better Buying Power Principlesto Improve Acquisition OutcomesDISTRIBUTION STATEMENT A – Cleared for Open Publicationby OSR on October 7, 2014 – SR case number 15-S-00402
“Shift on & RiskReductionMaterielSolution AnalysisPDRUserNeeds“Most important single decision in the life cycle sets inmotion all that follows.” - Frank KendallDevelopmental RFPDecisionTEMPTEMPEngineering & ManufacturingDevelopmentCDRFRPProduction MFRisk Management FrameworkSystems EngineeringManagement PlanOperation & MaintenanceDOT&E IA MemoCybersecurity DT/OTConcept RequirementsHigh-LevelDesign &SubsystemRequirementsKey Capabilities needto be designed-inearly rather thantested-in laterDISTRIBUTION STATEMENT A – Cleared for Open Publicationby OSR on October 7, 2014 – SR case number 15-S-0040SystemEarlier Interoperability TestingVerification &DeploymentMission nCurrent PracticeResults inInadequate Designand Late Discoveryof ProblemsHigher Cost toResolve ProblemsEarlierUnit TestingDetailed DesignReliability GrowthSoftware CodingHardware FabricationCReliability Optimizedfor IOT&E vice MS CSignificant Growthplanned for after MS C3
Defense Industry ForumTop-Level JHU/APL (Trusted Agent) will create an independent andcollaborative T&E Defense Industry Forum (DIF) forgovernment, industry, and other stakeholders to identifypolicies and technical challenges that affect theefficiency and effectiveness of DoD Test infrastructure. Build trust and help Government / Industry Stakeholders Recommendations to identify actionable items for AT&Lto implement changes to T&E policy and processesThe Defense Industry Forum was requested byOEMs in the TRMC StudyDISTRIBUTION STATEMENT A – Cleared for Open Publicationby OSR on October 7, 2014 – SR case number 15-S-00404
KLP Qualification BoardFirst Q-Board Scheduled for December 9, 20145
Developmental esSystem Requirements and T&EMeasuresDecision #1DSQ #1Functional evaluationareasTechnicalReqmtsSystem x.x.5PerformanceCapability #13.x.x.6PerformanceCapability #2Decisions SupportedWhatDSQ #2Decision #2DSQ #3DSQ #4DDSQ #5DescriptionIdentify major decision points for which testing and evaluation phases, activity and evenCells contain description of data source to be used for evaluation information, for exam1) Test event or phase (e.g. CDT1.)2) M&S event or scenario3) Description of data needed to support decision4) Other logical data source descriptionTechnical Measure #1DT#1M&S#2Technical Measure #2M&S#1DT#33.x.x.7Technical Measure #33.x.x.8Technical Measure #43.x.x.1Technical Measure #13.x.x.2Technical Measure #23.x.x.3Technical Measure #33.x.x.4Technical Measure #4HowWhy and bility #3InteroperabilityCapability #4DT#3IT#2M&S#4IT#2CybersecuritySW/System Assurance PPP 3.x.xSW Assurance Measure #1RMFRMF Contol Measure #1Vulnerability AssessVul Assess Measure #1Interop/Exploitable Vuln.Vul Assess Measure #2Cont AssessSW Dev AssessSW Dev Asses SCont AssessCont AssessCont AssessBlue TeamRed TeamReliabilityReliability Cap #1Reliability Cap #24.x.x.1Technical Measure #114.x.x.2Technical Measure #124.x.x.3Technical Measure #134.x.x.4Technical Measure #14M-demo#1M-demo#1M-demo#2M-demo#26
TEMPsThe GoodThe Bad Robust T&E Planning Contract amongStakeholders Cumbersome andbureaucratic process Document is too bigThe Ugly “TEMP is only for OSD” Long term value is questionableDISTRIBUTION STATEMENT A – Cleared for Open Publicationby OSR on October 7, 2014 – SR case number 15-S-00407
Questions8
DIACAP/RMF . Interoperability . Mission Context FRPIOT&E. Risk Management Framework Cybersecurity DT/OT. Earlier Interoperability Testing . RMF RMF Contol Measure #1 Cont Assess Cont Assess Cont Assess Cont Assess Vulnerability Assess Vul Assess Measure #1 Blue Team Interop/Exploitable Vuln. Vul Assess Measure #2 Red Team
