Symposium PresentationApproved for public release; distribution is unlimited

Eresman, Raymond

Haas, Nicholas

Hyatt, Kathleen

Patton, Scott

Stark-Kublin, Beverly

Wydler, Virginia

English

Calhoun, Institutional Archive of the Naval Postgraduate School

Calhoun: The NPS Institutional ArchiveDSpace RepositoryAcquisition Research Program Acquisition Research Symposium2022-05-06Technical Data Package Independent AssessmentHaas, Nicholas; Wydler, Virginia; Eresman, Raymond;Hyatt, Kathleen; Patton, Scott; Stark-Kublin, BeverlyMonterey, California. Naval Postgraduate Schoolhttp://hdl.handle.net/10945/70234Downloaded from NPS Archive: Calhoun© 2022 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.Nicholas Haas, Task LeadTechnical Data PackageIndependent Assessment2Agenda• Background• Acquisition Milestones Relative to TDP • Assumptions and Constraints• Phased Approach• Considerations• Assessment Findings• Recommendations© 2022 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.3Background© 2021 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.• MITRE conducted a review of the current Legacy Technical Data Package and determined the utility and readiness to support a Source Selection Bidders’ Library. • MITRE Independent Assessment Team Actions: • Gained access to TDP artifacts and analyzed all available documents, files, and other technical information and artifacts assembled by sponsor• Compared the TDP artifacts against Department of Defense (DoD) and Agency guides to ensure compliance with laws, regulations, and policies• Interacted with Functional Group Leads to categorize and compartmentalize artifacts for assessment analysis• The MITRE Independent Assessment Team compiled the analysis of the technical data for completeness to release to industry for use in preparing competitive proposals.  24Acquisition Milestones Relative to TDP© 2021 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.Requirements DevelopmentCongressional NotificationFinal Proposal Revisions/ DiscussionsCompetitive Range DeterminationDiscussions/ ClarificationsProposals Received RFP Released Industry DayDraft RFP Released --Bidders’ Library PublishedAcquisition Strategy PanelMarket Research / RFI SynopsisDebriefings Contract AwardKey Acquisitions Milestones – MDA Acquisition Actions OnlyKey Acquisitions Milestones for opportunities/Industry Interactions to update Bidder’s Library 25Assumptions and Constraints© 2021 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.• The following were outside the scope of this analysis:• MITRE IA team did not provide artifacts which become part of the Bidders’ Library• MITRE IA team did not create or edit any of the artifacts that were reviewed• MITRE IA team was not responsible for configuration control of artifacts• Constraints to validate and verify information with the Sponsor Functional Group Leads:• COVID-19 conditions limited the number of personnel with access• Some information listed in the spreadsheet had incorrect titles, links were not correct or not working, and descriptions were incomplete~3% of the total Artifacts listed on the TDP Spreadsheet were inaccessible• Artifacts referenced in the TDP spreadsheet were not always stored in the TDP artifacts library~25% of the total Artifacts listed on the TDP Spreadsheet were in other sharepoint foldersNOTES: • For the purposes of this Assessment, MONTH/DAY was the last day data was accessed by MITRE. Updates to the TDP Artifact folder after MONTH/DAY were not included in this assessment.  • Constraints identified did not affect overall recommendation (only led to some of the sub-recommendations for improvement)26Phased Approach Flow Diagram© 2021 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.GOVT Requests TDP IACurrent TDP Spreadsheet CreatedMILDEP 31000B/Agency TDP Guide Market ResearchInitial Analysis of TDP Spreadsheet Developed Interview Questions for Functional Group LeadsPhase IInterviews with Functional Group LeadsCategorize Artifacts by Classification Level  Developed Outline for Tech ReportTDP Artifact Folder Updated Phase IIBidders’ Library AnalysisIA Tech ReportFinal BriefingPhase IIIGovernment TeamMITRE TeamAUGUST OCTOBER NOVEMBERSEPTEMBER DECEMBER FEBRUARYJANUARY MARCH APRILCOVID Restrictions Implemented 2  I  I .  I  .  I   .7Considerations© 2021 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.MITRE analyzed the existing TDP artifacts and offered observations, considerations, and recommendations for the upcoming competitive acquisition in the following areas:• Individual program’s specific TDP needs• Data Management Strategy• Long-Term Strategy to Compete • Technical Data Rights Approach• Intellectual Property Considerations• Technical Data and Rights in Data• Contract Data Requirements List (CDRLs)• Open Architecture Standards• Acquisition Best Practices / Future Competition Considerations28Assessment Findings© 2021 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.Determine the feasibility to support a Bidders’ Library for the release of a competitive RFP; however, the report highlights some areas that may be improved upon with additional information. There is still adequate time to implement the recommendations before contract award, as discussed earlier in this briefing.• Independent Assessment team considered these factors when making Recommendations for completeness of Bidders’ Library:• Accessibility for bidders• Utility and appropriateness of the document• Presence of any limiting factors such as proprietary information• The following Appendices are a summation of the findings of the IA team and may be used as tools throughout the RFP process and should evolve based on Vendor Inputs and Agency updates to their RFP package.• Appendix A lists all the data that was analyzed from the TDP Artifact Folder• Appendix B is the recommended list of artifacts for inclusion in the Bidders’ Library29Recommendations© 2021 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.The following are some of the key recommendations presented throughout the document:• Ensure TDP requirements are aligned with overarching Agency system level Specs and Docs• Standardize artifact file names to the TDP artifact master list descriptions• Include documentation that describes programs overall role in the system of systems (if app)• When populating the Bidders’ Library, ensure that all documents and artifacts are checked for proper classification and markings• Address how TS/SCI programs will be handled and what documentation will be required• Consider overall Software Description Document in the bidders’ library describing magnitude and types of software and relevant CDRLs• Group artifacts logically in the Bidders’ Library; for example, requirements, design, directives, description, interface, software, cyber, training, planner, etc.210Questions?© 2021 THE MITRE CORPORATION. ALL RIGHTS RESERVED. FOR INTERNAL USE ONLY.For additional information, contact:Nicholas Haasnhaas@mitre.org256-293-07272

Technical Data Package Independent Assessment

Excerpt from the Proceedings of the Nineteenth Annual Acquisition Research SymposiumThe Program Management Office (PMO) is responsible for the quality and integrity of the data associated with system delivery and performance. When competing a new system or system update, the Program Manager (PM) is required to complete acquisition planning activities for a specific procurement and to develop a well-conceived acquisition strategy. This activity includes developing and validating Technical Data Package (TDP) requirements. Often, the program staff are committed to managing the current system and do not have the resources to fully review and validate the TDP for a major competition. Therefore, the TDP may not represent the best product to industry. A PMO may consider having an outside entity conduct a review of their technical data to assess the readiness and viability of the TDP. An Independent Assessment (IA) may provide significant information for understanding what technical data is available, what data is missing for a competitive solicitation, and what needs to be purchased under a new or follow-on contract. An IA can assist with conducting the first steps in the competitive process of developing requirements and conducting market research. The purpose of an IA is to provide the PMO with additional validation that the TDP is sound for a solicitation and subsequent contract

https://calhoun.nps.edu/bitstream/handle/10945/70276/SYM-AM-22-090.pdf?sequence=1

Technical Data Package Independent Assessment

Abstract

Similar works

Full text

Available Versions

Calhoun, Institutional Archive of the Naval Postgraduate School

Calhoun, Institutional Archive of the Naval Postgraduate School