with Alyson Wilson, 2010 Joint Statistical Meetings, August 2010

Fricker, Ronald D.

Wilson, Alyson G.

Calhoun, Institutional Archive of the Naval Postgraduate School

Calhoun: The NPS Institutional ArchiveFaculty and Researcher Publications Faculty and Researcher Publications2010-08Assessing the Methodology for TestingBody ArmorFricker, Ronald D.Yang, J.H., Kennedy, Q., Sullivan, J., and R.D. Fricker, Jr. (2012). Scan Patterns on OverlandNavigation in Varying Route Difficulty: Is Total Flight Hours (TFH) a Good Measure ofExpertise? Boston, MA: Human Factors and Ergonomics Society Proceedings, 56:1, 1406-1410.http://hdl.handle.net/10945/38748Assessing the Methodology for Testing Body ArmorRonald D. Fricker, Jr.Naval Postgraduate Schooland Alyson G. WilsonIowa State UniversityAugust 1, 2010• Armor manufactured from various materials has been used throughout recorded history– Animal skins → fabrics → wood → metal → advanced materials• US forces wear body armor for ballistic protection from– Penetration of projectiles – Blunt force trauma of impact Background2• Kevlar and ceramic materials used in modern armor systems – Lighter than traditional metallic alloy-based armor – Ceramics have superior hardness, low density, and high compressive strength• Typical insert (“plate”) – Consists of a layer of dense boron carbide or silicon carbide backed by a layer of metal or polymer composite– Entire plate wrapped in tightly woven ballistic fabric– Plate breaks up an incoming projectile and dissipates its kinetic energy Modern Body Armor3Interceptor Body Armor4Source:  “DoD Testing Requirements for Body Armor”, Inspector General, United States Department of Defense, Report No. D-2009-047, January 29, 2009.USSOCOM Body Armor5Source:  “DoD Testing Requirements for Body Armor”, Inspector General, United States Department of Defense, Report No. D-2009-047, January 29, 2009.Sources:  Phase I Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, Dec. 30, 2009 & https://peosoldier.army.mil/factsheets/SEQ_SSV_IBA.pdf (accessed 7/26/10).                                • Program Executive Officer –Soldier: “…there have been no known soldier deaths due to small arms that were attributable to a failure of the issued ceramic body armor”• Ceramic materials preferred because they are relatively light compared to traditional armor made of metallic alloys– However, all effective body armor systems currently add a significant burden of weight on the soldier– Interceptor body armor (size medium) w/ all protective plates ~ 33 lbs.Current Body Armor is Effective6150 lbs. of lightweight gear• Before awarding contracts to buy body armor, DoD conducts “first article testing” or FAT• Goal is to determine whether product meets purchase specifications• For body armor, it is a  destructive ballistic test– I.e., representative armor is shot at under various conditionsBody Armor Testing, In Brief7Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.Clay as Recording Medium8Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.• Test consists of mounting “shoot pack” on clay backing• Use of clay based on Prather et al. (1977) study which found clay measurements could be “correlated to tissue response for use in characterizing both the penetration and deformation effects of ballistic impacts on soft body armor materials.”• Changes in clay formulation over time have resulted in extensive effort to try to maintain test clay consistency Test Metrics9Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.• Penetration– Resistance to projectiles fired at a constant velocity – May be partial (plate, Kevlar) or complete (bullet or bullet fragments into clay backing)• Back face deformation (BFD)– BFD is the depth of the crater left in the clay after impact– Surrogate measure for blunt force trauma• Total of 27 plates tested:– 1 plate against threats “A,” “B,” and “C” and 3 plates against threat “D” in ambient conditions– 1 plate for each of nine environmental conditions– Also, 12 plates for “V50” tests• Passing standards– For threats “A,” “B,” and “C,” no penetration allowed and BFD less than 48 mm– For threat “D,” a point system was used to score shots based on penetration and BFD • An accumulation of six or few points was passingOriginal Army FAT Protocol10Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.• Testing protocols differ across DoD• Army protocol not statistically based– DoD IG: “standardization of body armor testing and acceptance will ensure that Service members receive body armor that has been rigorously tested and will provide uniform protection in the battlefield”1• Clay-based testing: – Clay formulation has changed over time, resulting in a formulation that is temperature sensitive• How much variation in test results attributable to variation in test conditions and how much due to plate variation unknown– Scientific connection between clay test results and protection of human beings tenuous at best(Some) Body Armor Testing Issues111 “DoD Testing Requirements for Body Armor”, Inspector General, United States Department of Defense, Report No. D-2009-047, January 29, 2009.• Three-phase study– Phase 1: Completed 30 December 2009– Phase 2: Competed 22 April 2010– Phase 3: Starts 9 August with meetings scheduled over ~ three months• First two phases conducted as intense four-day meetings– Days 1 and 2, briefings and site visits– Days 3 and 4, draft committee letter report• Chaired by retired Army Major General with 7-8 members (engineers and statisticians)NAS Committee12• DOT&E tasked the committee to:– “…comment on the validity of using laser profilometry/laser interferometry techniques to determine the contours of an indent made by a ballistic test in a non-transparent clay material at the level of precision established in the Army’s procedures for testing personal body armor.”– “…provide interim observations regarding the column-drop performance test described by the Army for assessing the part-to-part consistency of a clay body used in testing body armor.”Phase I13Source:  Phase I Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, December 30, 2009.• Digital caliper used to measure BFD has several shortcomings, including– If deepest location in the clay indent is displaced from the aim point, must estimate original clay surface at the impact point – Caliper subject to operator judgment because one must measure a soft, deformable surface by barely touching and yet not disturbing the clay • Standard error for measuring etched metal gage block on order of 0.1 mm; for BFD in soft clay medium on the order of 1 mmDigital Caliper14Source:  Phase I Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, December 30, 2009.• Laser used to take three dimensional measure of clay surface before and after test– Differences of two surfaces used to measure BFD• Benefits:– Does not require contact with clay – Measurements collected over whole surface• However, system more complicated and costlyLaser Profilometry/Interferometry15Source:  Phase I Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, December 30, 2009.Accuracy vs. Precision16Source:  Phase I Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, December 30, 2009.• “The digital caliper is adequate for measurements of displacements created in clay by the column-drop performance test…”• “Surface profilometry by a laser… is a valid approach for determining the contours of an indent in a nontransparent clay material at a level of precision adequate for the Army’s current ballistic testing of body armor.”Phase I Recommendations17Source:  Phase I Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, December 30, 2009.• DOT&E tasking– “In Phase II, the committee will consider in greater detail [than in Phase I] the validity of using the column drop performance test described by the Army for assessing the part-to-part consistency of a clay body within the level of precision that is identified by the Army test procedures.”– “The final report will document the committee’s findings pertaining to…the appropriate use of statistical techniques (e.g., rounding numbers, choosing sample sizes, or test designs) in gathering the data.” Phase II18Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.• Total of 60 plates tested spread over a combination of plate sizes, environmental conditions, and shot order• Passing standards:– Penetration:• One-sided 90 percent lower confidence bound for the probability of complete system penetration is greater than 0.9 (first shot) and greater than 0.8 (second shot)– BFD:• First shot: one-sided 90% upper tolerance limit for BFD must be less than 44.0 mm with 90 percent confidence • Second shot: one-sided 80% upper tolerance limit for BFD must be less than 44.0 mm with 90 percent confidence Proposed New FAT Specifications19Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.20Statistical Protocol Allows Explicit Risk Trade-Offs To Be MadeSource:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.Variation Introduced by Test Protocol Unknown21Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.• “Column drop” test used to test clay for consistency prior to ballistic testing– Clay heated until indentation depth of weight dropped into clay meets standard– Indentations from 3 drops must all be within 25 mm ± 3 mm• Yet clay performance may still vary substantially due to temperature andother factors• How much variationthis introduces intoballistic test results unknown22Effect(s) of New Protocol Standards on Manufacturers Unknown Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.• “…expedite the research necessary both to quantify the medical results of blunt force trauma on tissue and to use those results as the updated mathematical underpinnings of the back face deformation (BFD) body armor testing methodology.”• “The Army should develop ballistic testing performance specifications and properties that will lead to a short-term, standard replacement for the current Roma Plastilina #1 oil-based modeling clay.”• “Since oil-based modeling clay is time and temperature sensitive, a post-drop calibration test is needed to validate that the clay remains within specification at the end of a body armor test.”Some Phase II Clay-Related Recommendations23Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.• “The committee unequivocally supports the concept of a statistically based test protocol…”• “…the Army should quickly develop and experiment with a gas gun calibrator, or equivalent device…to estimate as accurately as possible the variation of back face deformation measurements both within a given box and between boxes, under realistic testing conditions using existing test protocols.”• “…the results of the experiments and analyses proposed in this report, should be used as due diligence to carefully and completely assess the effects, large and small, of the proposed statistically based protocol before it is formally adopted across the body armor testing community.”Phase II Recommendations Related to Statistical Methodology24Source:  Phase II Report on Review of the Testing of Body Armor Materials for Use by the U.S. Army, The National Academies, April 22, 2010.• DOT&E has tasked the committee to:– Develop ideas for revising/replacing the Prather study methodology– Provide a roadmap to reduce variability of clay processes and how to migrate from clay to future solutions– Within the time and funding available, review and comment on methodologies and technical approaches to military helmet testingPhase III25

Assessing the Methodology for Testing Body Armor

http://calhoun.nps.edu/bitstream/handle/10945/38748/JSM2010.pdf?sequence=3&isAllowed=y

Assessing the Methodology for Testing Body Armor

Abstract

Similar works

Full text

Available Versions

Calhoun, Institutional Archive of the Naval Postgraduate School