Presentation is a discussion on NASA Lessons Observed related to large complex system design

Conroy, Mike

NASA Technical Reports Server

C
O
N
V
R
  2
0
1
5
mike.conroy@nasa.gov
Playing Nice Across Time & Space
Tools, Methods and Tech for 
Multi-Location Multi-Decadal Teams
https://ntrs.nasa.gov/search.jsp?R=20150022934 2019-08-31T05:06:12+00:00Z
C
O
N
V
R
  2
0
1
5
A Little History
• I have been around the Modeling, Simulation,  
Visualization and Information Technologies space 
for over 25 years
• They are grand, challenging, disruptive, ever changing 
and incredibly powerful.  They grow more so every day.
• And, like any sharp tool, they have sharp edges.
• I would like to share some “Observations” from 
those years
• As in Lessons Observed vs. Lessons Learned
• And, I would appreciate your thoughts on any that I may 
have missed
C
O
N
V
R
  2
0
1
5
How To Play Nice
• The Game is:
• Multi-Decade, Massive, Complex System Conception, 
Design, Development and Operations
• Targeted towards a hostile and unforgiving environment
• With a gifted, diverse and distributed group of friends
• With the goal of getting as far off the planet as possible
• The Rules Come From:
• Physics  /  Teams  /  Process  /  Science / Story
• Time  /  Distance  /  Culture  /  Goals  /  Generations
C
O
N
V
R
  2
0
1
5
Some Definitions (circa 2001)
• We Model
• We represent the thing we want to study
• With as much detail as is necessary for that study
• We Simulate
• We represent behavior of the thing(s) we want to study
• With as much detail as is necessary for that study
• We Decide
• We look at the thing(s), their behavior(s), determine the 
next step(s) and communicate the results of the study
• With enough detail for that study to be used or re-used
4
C
O
N
V
R
  2
0
1
5
Communications Observation
Very Large Bolts
C
O
N
V
R
  2
0
1
5
Ares 1 Launch Sim (HLA, Trick, 5 sites)
LAS
(LaRC) Orion
(JSC)
Ares
(MSFC)
GO
(KSC)
Comm
(JPL)
6
C
O
N
V
R
  2
0
1
5
Simulation Speeds Communication
• It is non-threatening (‘ish).  
• Leadership is not wrong, I just need their help to 
get the simulation right.
• Or, everyone is wrong, and we need to know now.
• Imagine 3 people vigorously discussing what turns 
out to be 3 different concepts
• The worst thing that can happen is that they come to 
an agreement and leave happy
• Simulation can help ensure everyone is at least in the 
same argument, and it leaves a record
C
O
N
V
R
  2
0
1
5
Concurrent Design Observation
Habitat Demonstration Unit
C
O
N
V
R
  2
0
1
5
HDU Overview
• Vision
• Develop, integrate, test, and evaluate a 
Habitation prototype to better understand 
mission architectures, requirements and 
operational concepts
• Timeline
• Project Kick-off: June 2009
• Shell: October 2009 – April 2010
• Systems Integration: April – August 2010
• 10 Month Build, 4 Month Integration 
• Field Test at Desert RATS September 2010
• Participation
- Jointly managed and built across 3 Time 
Zones with subsystems from 7 Centers
Lunar Reference Concept (PEM)
HDU Concept
9
C
O
N
V
R
  2
0
1
5
CAD Based Integration - Interior
10
C
O
N
V
R
  2
0
1
5
CAD Based Integration - Exterior
11
C
O
N
V
R
  2
0
1
5
Concept Realization (15 Months to Field)
12
C
O
N
V
R
  2
0
1
5
Concurrent Design Lessons 
• CAD integration rapidly grew to system simulation, then 
concurrent development
• Concepts were matured in design sessions
• Concept developed, “model” updated, package base lined 
• Design completed, “model” updated, systems built
• Multiple Centers, Teams, Projects, Time Zones and Budgets
• Success not just because of Simulation
• HDU leadership prioritized decisions such that time critical 
elements were decided on first 
• Even if only allocations
• Simulation Screen Shots became a key communication path
• Timely, Enhanced Understanding, Converged Ideas
Design
Development
Concept
Done 13
C
O
N
V
R
  2
0
1
5
Self Grading Observation
NASA Standard 7009, Modeling and Simulation
C
O
N
V
R
  2
0
1
5
The Numbers on the Score Sheet
• To communicate the rigor, fidelity and pedigree of our 
work (Credibility), across distance and years
• We used NASA Standard 7009 
• 8 categories, 5 levels per category
• Range from “No Evidence” to “Best Possible” Credibility
15
Verification
4
3
2
1
0
Validation
4
3
2
1
0
Input 
Pedigree
4
3
2
1
0
Results 
Uncertainty
4
3
2
1
0
Results 
Robustness
4
3
2
1
0
Use History
4
3
2
1
0
M&S 
Management
4
3
2
1
0
People 
Qualification
4
3
2
1
0
Inputs Agree with 
Real World Data
No Evidence of 
Input Pedigree
De facto Standard
Passes Simple 
Tests
C
O
N
V
R
  2
0
1
5
As Programs Mature, Credibility Increases
• Compare the planned Constellation (crewed) 
maturation with a flight experiment (no crew)
• The experiment first pass has higher credibility, but the end 
result is only 2’s and 3’s.  
• They do more work up front before commitment, but do 
not need the later, expensive, high fidelity simulations.  
C
O
N
V
R
  2
0
1
5
Standard Grades
• This lets engineers, scientists, analysts and others 
identify what they created, and what it could be 
used for. 
• It also lets leadership understand what something 
should NOT be used for.  
C
O
N
V
R
  2
0
1
5
This Might Work Observation
SEE 2015, a template for integrated exploration
C
O
N
V
R
  2
0
1
5
Simulation Exploration Experience
• Cooperative Student Event
• US, Canada, Europe so far
• Simulate a Lunar Base with NASA Tools
• HLA (MAK, Pitch, Forward Sim)
• Trick (NASA Open Source)
• Federations (rovers, flyers, surveyors, buildings, terrain)
• DON, Distributed Observer Network (Game Based Visualizer)
• Model Process Control data, creates persistent simulations
• We would welcomes others…
C
O
N
V
R
  2
0
1
5
Data from SEE 2015 Event
<object id="UoL Space Vehicle">
<pos>-815681.8256345909 -
296766.0468345342 -
1499649.7534911816</pos>
<quat>0.5796094794186682 
0.7726450948750871 -
0.2166842183987196 -
0.14184624855957192</quat>
<parent>MoonCentricFixed</parent>
<vis>1</vis></object
C
O
N
V
R
  2
0
1
5
Going Forward
• Just wanting to meet huge new challenges is not 
enough
• We must learn how to start meeting them today
• With our partners, wherever they are
• We must enable our children to finish tomorrow
• Simple and persistent mechanisms to communicate with them 
whenever they are
• We must Learn how to Play Nice Across Space and 
Time
21
C
O
N
V
R
  2
0
1
5
Questions?
More Observations?
C
O
N
V
R
  2
0
1
5
Backup Stuff
C
O
N
V
R
  2
0
1
5
SEE 7009 CAS Score = 0-1-0-0-0-1-1-1
24
C
O
N
V
R
  2
0
1
5
Design Process Observation
“The” System Engineering Chart
C
O
N
V
R
  2
0
1
5
A Stereotypical Design Process
26
Pre 
A
B C D EA
A Stakeholder wants to know 
what “It” will look like.  
If I respond with anything:
I just lost design flexibility
I just defined the cost plan
I still really know very little 
about the system or 
solution
System Engineering Phases
100%
0%
C
O
N
V
R
  2
0
1
5
I Really Want is…
27
Pre 
A
B C D EA
When Stakeholder asks 
“What will it look like?”
What “We” Really Want:
1. I can show you in a few 
months, not years 
(Early System 
Knowledge)
2. Then you can help 
steer me (Design 
Flexibility Preserved)
3. And we can look at the 
financial burn (Delayed 
Resource 
Commitments)System Engineering Phases
100%
0%
C
O
N
V
R
  2
0
1
5
Simulation Based Designs
Pre 
A
B C D EA
Sustainable Systems
28
Simulation Based Concepts
Simulation Based Products
Sustainable Systems
NASA / INCOSE System Engineering Phases
And, along the way we create artifacts that we 
can share, that increase understanding and allow 
us to access additional expertise
C
O
N
V
R
  2
0
1
5
Multi-Decadal and Interdependent are Hard
29
Time (50 years)
Us
Our 
Kids
Our 
Grandkids 
C
O
N
V
R
  2
0
1
5
Persistent Simulation
• Persistent Simulation for Multi-Decadal Teams
• Or, Playing Nice Across Time and Space
• Bio – Mike Conroy / Modeling, Simulation, IT 
Technology Manager / Kennedy Space Center 
• Experience from Expendable Launch Vehicles, Space 
Shuttle, a multi-year sentence in financial management, 
computer networks and data systems, engineering 
environments, contracts, group management and 
Modeling and Simulation for the Constellation Program.  
• Now leading Kennedy Simulation and IT Research 
management while building simulators and game based 
tools for NASA Exploration efforts.


Playing Nice Across Time Space

Abstract

Similar works

Full text

Available Versions

NASA Technical Reports Server