ITEA Live-Virtual-Constructive Conference presentatio

Valerdi, Dr. Ricardo

DSpace@MIT

A prescriptive and adaptive framework for UAS SoS Testing in LVC Environment Dr. Ricardo Valerdi  Massachusetts Institute of Technology   January 13 ,2010 Massachusetts Institute of Technology  http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 2 Outline •  PATFrame team •  PATFrame objectives & scope •  PATFrame stakeholders •  PATFrame tasks •  PATFrame features •  Next steps Sponsors Transition Partners http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 4 Prescriptive Adaptive Test Strategy/ Test Infrastructure System under test Prescriptive Adaptive Test Framework http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 5 PATFrame Objective To provide a decision support tool encompassing a prescriptive and adaptive framework for UAS SoS Testing •  PATFrame will be implemented using a software dashboard that will enable improved decision making for the UAS T&E community •  Focused on addressing BAA topics TTE-6 Prescribed System of Systems Environments and MA-6 Adaptive Architectural Frameworks •  Three University team (MIT-USC-UTA) draws from experts in test & evaluation, decision theory, systems engineering, software architectures, robotics and modeling http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 6 Hours Years Long Term  Planning Decisions/ investments Data Collection,  analysis &  reprioritization Test Planning (in SoS  environment) Time Scale for Testing Decisions Days PATFrame Scope Test Development (i.e., design for testability) Months Test Execution (real time) Minutes http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 7 UAST Steering Group MIT USC UTA White Sands Developmental Test Command Army Test & Evaluation Command (ATEC) DoD Test Resource Management Center (TRMC) SoftStar Ft. Hood Operational Test Command        N-UCAS Navy Kirtland Air Force PATFrame Stakeholders Transition Partners Naval Air Systems Command (NAVAIR) Air Force Operational Test and Evaluation Center (AFOTEC) http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 8 PATFrame kickoff meeting Fort Hood, TX - Aug 2009 http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 9 Normative Descriptive Prescriptive Goal: Capture Actual SoS Test Goal: Construct Theoretical Best “SoS” Test Metric set, “best” levels Metrics, state of the practice levels Goal: Synthetic framework for SoS testing at single and multi-program level “Successful SoS Test” = f(metricA, metricB, etc.) Actual SoS tests include metricA’, metricC, etc. limit (MetricA) Normative (best) Descriptive (SoP) Descriptive (actual) Potential (new test A) test A contribution to state of the practice “success” MetricA MetricB MetricC MetricN … … Task 1: Prescribed System of Systems Environment http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 10 Causal Model Ontology Design Idioms for SoS Framework for dynamic adaptation Task 2: Adaptive Architectural Frameworks http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 11 Integrated Test Management Features under development: •  System modeling (adaptive architectures, dependency matrices) •  Risk prediction (leading indicators, knowledge-based forecasting) •  Test planning (real options) •  Test resource estimation (parametric modeling) •  Test evaluation & adaptation (system dynamics) http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 12 Real Options as Prescriptive and Adaptive Framework for SoS Testing •  Use case: •  Question: what to test? (i.e. what SoS test scenarios to prescribe?) •  Inputs: models of autonomous/net-centric system of systems, major uncertainties •  Outputs: enablers and types of real options for responding to uncertainties as candidate test scenarios (i.e. identification of how SoS can adapt) Joint/ SoS Model:  coupled dependency  structure matrix Identification of Real Options: Vehicle1 (Army) Vehicle2 (Navy) Vehicle3 (Air Force) Ontology Uncertainties Mission  objectives Objective: Maintain Vehicle1Vehicle2 comm. Uncertainty: proximity of vehicles 1 and 2 1. Real option to adjust comm. range using  flexible range comm. systems on vehicles1, 2 2. Real option to use Vehicle3 as relay 1 2 3 http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 13 System of System Risk Based Testing • Number of interfaces • Complexity of system integration • Environment  Operation • Long life expectancy  • Multiple stakeholders • Multiple requirements Risk Identification Risk  Mitigation • Operation and Usability in Environment • Requirements Balance • Incremental Technology Maturation • Optimized Utilization Synchronized Position Hold Engage Reorient Experimental Satellites (SPHERES) Knowledge	  Base	  Analysis	  Techniques	  Risk	  &	  Uncertainty	  Analysis	  (leading	  indicators)	  Process	  Analysis	  (	  System	  Dynamics)	  Reasoning	  Engine	  Plan	  Analyze	  and	  Design	  Execute	  Evaluate	  • What	  	  realizable	  opHons	  	  are	  available?	  • Which	  test	  do	  I	  run	  and	  in	  what	  order?	  Primary	  Outputs	  for	  	  Test	  and	  EvaluaHon	  • When	  am	  I	  done	  • TesHng?	  Test	  Requirements	  Primary	  Inputs	  	  to	  	  PATFrame	  Models	  of	  the	  	  system	  	  under	  test	  Available	  resources	  	  • and	  Hme	  Mission	  needs/goals	  Model	  of	  the	  SoS	  	  environment	  Ontology	  • How	  should	  my	  test	  	  • strategy	  change?	  http://lean.mit.edu © 2010 Massachusetts Institute of Technology   Valerdi- 15 Next Steps •  PATFrame workshop tomorrow (10:30-4:30) •  Evolve uses cases with transition partners •  Obtain feedback on PATFrame features •  PATFrame workshop March 11 in Los Angeles (at USC) •  Continue alignment with Net-centric systems investment area 

A Prescriptive and Adaptive Framework for UAS SoS Testing in LVC Environment

http://dspace.mit.edu/bitstream/1721.1/84034/1/CPS_100113_Valerdi_ITEA_PATFrame_Overview.pdf

A Prescriptive and Adaptive Framework for UAS SoS Testing in LVC Environment

Abstract

Similar works

Full text

Available Versions

DSpace@MIT