"A lengthy article entitled “Validated Techniques and Scoring Models for
PDD Test Data Analysis – Conclusions from the 2011 APA Report” authored
by Marcin Gołaszewski and published in European Polygraph, Volume 6,
Number 4(22), 2012, listed eight polygraph techniques as having been approved
as validated techniques by the American Polygraph Association."(...

Matte, James Allan

European Polygraph

English

Repozytorium Instytucjonalne Krakowskiej Akademii

UDO UNDEUTSCH* The actual use of investigative physiopsychological examinations  in Germany  EUROPEAN POLYGRAPH Volume 7 • 2013 • Number 2 (24)James Allan Matte*Matte Polygraph Service, Inc.Williamsville, New YorkUSALimited response to Marcin Gołaszewski’s Conclusions From the Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph TechniquesKey Words: polygraph techniques, APA Report, validation techniquesA lengthy article entitled “Validated Techniques and Scoring Models for PDD Test Data Analysis – Conclusions from the 2011 APA Report” authored by Marcin Gołaszewski and published in European Polygraph, Volume 6, Number 4(22), 2012, listed eight polygraph techniques as having been ap-proved as validated techniques by the American Polygraph Association. Th e aforesaid article singled out two polygraph techniques, namely the Integrated * jamesallanmatte@mattepolygraph.comJAMES ALLAN MATTE86Zone Comparison Technique (IZCT) and the Matte Quadri-Track Zone Comparison Technique (MQTZCT), as “outliers”, because the Meta-Analytic Survey (MAS) “indicated that statistical data are inconsistent with the distri-bution of results from all other techniques and are called outliers.1 Th erefore one ought to look at these data with great caution. All the more so because the IZCT and the MQTZCT have not been veriﬁ ed by independent research-ers. Furthermore, the APA drew attention to some shortcomings in the vali-dation process of these techniques.”It should be noted that Gołaszewski’s article mentions and references the 2012 Terminology Reference for the Science of Psychophysiological Detection of Deception (Krapohl, Handler, Sturm 2012) in addition to the Meta-Analytic Survey as the basis of his critical comments regarding the MQTZCT, which is the focus of this limited response. It also must be noted that Gołaszewski’s article fails to cite and reference the “Critique of Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques” published in Euro-pean Polygraph (Matte 2012a), and the critique in the form of “A Letter-to-the Editor Regarding the APA’s Terminology Reference for the Science of Psychophysiological Detection of Deception” published in Polygraph (Matte 2012b).2 An evaluation of a study is not complete without the inclusion of its published critiques, which may reveal serious errors, omissions and bias, as was found in the Meta-Analytic Survey and described in detail in the afore-mentioned critiques.In addition to stating that the MQTZCT had not been veriﬁ ed by independ-ent researchers, the article further stated that:“Moreover, the developer of MQTZCT reported a near-perfect correlation coeﬃ  cient of 0.99 for the numerical scores. He suggested an unprecedented high rate of inter-scorer agreement, which is unexpected bearing in mind the complexity of the method. In addition to this, scores were not provided for those cases that were not scored correctly.”1 Outliers are numbers in the data set that are extremely high or extremely low, compared to the rest of the data. Th e mean may not be a fair representation of the data, because the aver-age is easily inﬂ uenced by outliers of very large or very small values in the data set that are not typical.2 Critique of Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques, (Matte 2012a), and A Letter-to-the-Editor Regarding the APA’s Terminology Reference for the Science of Psychophysiological Detection of Deception. (Matte 2012b) are available for review and download at www.mattepolygraph.com. LIMITED RESPONSE TO MARCIN GOŁASZEWSKI’S CONCLUSIONS... 87First of all, the MQTZCT was validated by three separate ﬁ eld studies: Matte, Reuss 1989a,1989b3; Mangan, Armitage, Adams 2008; Shurany, Stein, Brand (2009). Th e Mangan et al 2008 and the Shurany et al 2009 ﬁ eld studies were separate studies, independent of the Matte, Reuss 1989 study and the devel-oper of the MQTZCT (Matte). Th e manner in which these three studies were conducted and their independence from each other is fully described in the aforesaid Critique published in European Polygraph (Matte 2012a).Secondly, the statement that the unprecedented high rate of inter-scorer agreement is unexpected due to the complexity of the method is not only inaccurate but reﬂ ects a lack of knowledge regarding the MQTZCT, which became evident in the Terminology Reference’s erroneous description of the Inside Track, a major component of the MQTZCT4 (Matte 2012b). Th e format of the MQTZCT and resultant polygraph charts used for scoring of the physiological data are in fact simpler to evaluate and score than some other validated polygraph techniques, inasmuch as the MQTZCT isolates each relevant question for comparison with the neighboring control question immediately preceding it within the same track, and hence is non-selective, whereas some other validated techniques require that the polygraphist select one of the two control questions ﬂ anking the relevant question for compari-son, a selective approach requiring additional psychophysiological evaluation aﬀ ecting the decision process. Furthermore, once the scores have been as-signed in each tracing of each track, the polygraphist merely has to tally the total scores from the three tracks for a grand total score, which is married to a conclusion table for a decision of truth, deception or inconclusive. Th e process is logically structured and standardized. In addition, the data in the Matte-Reuss 1989a ﬁ eld study (Table 10-C) shows that the average score per chart for the truthful was +6 and for the deceptive -9; hence for three charts the average score for the truthful would be +18 and the deceptive -27. Th e score threshold for the truthful for three charts is +9 and the deceptive -15, which provides a margin of accuracy of 9 points for the truthful and 12 points for the deceptive before inconclusive results would occur. Moreover, in order for the blind reviewer to commit a false negative (FN) or false positive (FP) error, he would have to travel from -27 past Zero 3 Matte, Reuss 1989a, 220-page doctoral dissertation and 1989b abridged version of the same ﬁ eld study published in Polygraph, 18(4), 1989 are available for review and download at www.mattepolygraph.com. 4 D. Krapohl and M. Handler, authors of the Terminology Reference, were also members of the APA Committee that authored the Meta Analytic Survey.JAMES ALLAN MATTE88to +9, a distance of 36 points to arrive at a false negative, and +18 past Zero to -15, a distance of 33 points to arrive at a false positive, respectively. Th ere-fore, the margin of accuracy as shown in the Matte-Reuss ﬁ eld study provides a signiﬁ cant score buﬀ er for the blind reviewer, which no doubt contributed to the near-perfect correlation coeﬃ  cient of 0.99 for the numerical scores in that study. In addition, the statement that the MQTZCT’s near-perfect correlation coef-ﬁ cient of 0.99 is unprecedented fails to acknowledge the fact that in the Man-gan et al 2008 ﬁ eld study, 30 conﬁ rmed cases were blind scored by two polyg-raphists, which resulted in one error in 60 cases blind scored for a correlation coeﬃ  cient of .983, which was provided to the APA Committee with all of the score sheets, yet no mention of this is made in their report. Th e fact that 10 of those conﬁ rmed cases were randomly selected from 2007 cases because there were insuﬃ  cient numbers of conﬁ rmed cases in 2006, may have been the reason for its omission from the MAS report; however, it should have made no diﬀ erence inasmuch as the details and results of those conﬁ rmed cases were all unknown to the blind reviewers. Hence, two independent reli-ability studies were conducted on the MQTZCT, reﬂ ecting a similar high rate of inter-scorer agreement. Furthermore, the Mangan et al ﬁ eld study showed that the average score per chart for the Truthful was +7.1 and the Deceptive -10.0, resulting in a three chart score of +21.3 for the Truthful, and -30.0 for the Deceptive, thus providing a buﬀ er of 12.3 points for the Truthful and 15.0 points for the Deceptive before inconclusive results would occur. Th is score buﬀ er gave the blind scorers in the above mentioned conﬁ rmed cases a similar margin of accuracy against false positives and false negatives as found in the Matte-Reuss 1989 study, to wit: 36.5 points (FP) and 39 points (FN), respectively. Th irdly, the aforesaid article states “In addition to this, scores were not pro-vided for those cases that were not scored correctly.” Th is statement is grossly inaccurate inasmuch as the Matte, Reuss 1989 ﬁ eld study and the Mangan, Armitage, Adams 2008 ﬁ eld study both reported 100 percent accuracy, with no errors to report. Th e Shurany, Stein, Brand 2009 ﬁ eld study reported two errors and zero inconclusives. Th e raw data for the two errors in the Shurany et al study were included in the completed study data provided by Shurany to Chief Investigator Nelson. Nelson had previously acquired incomplete data of the study from Barry Cushman, who released it without authorization from Shurany. Th erefore all of the raw data from all three ﬁ eld studies were in fact provided to the APA Committee.LIMITED RESPONSE TO MARCIN GOŁASZEWSKI’S CONCLUSIONS... 89In all fairness to Marcin Gołaszewski, it is most likely that this author’s cri-tique in the form of a Letter-to-the-Editor of APA regarding the Terminology Reference, which was published in Polygraph in December 2012 and not ac-cessible to Europeans until late January or February 2013, was not available to Gołaszewski when he submitted his Conclusions from the 2011 APA Report for publication in European Polygraph. Furthermore, this author’s Critique of the Meta-Analytic Survey published in European Polygraph in 2012 may also have not been available to Gołaszewski at the time he submitted his Conclusions article for publication in European Polygraph. It is not unusual for articles submitted to peer-reviewed journals to remain in the publishing queue for several months to more than a year before publication. Th erefore the purpose of this author’s Limited Response to Gołaszewski’s article is to introduce the two cited critiques to his article to correct the record, not fault Gołaszewski’s excellent scholarship. Only when all the facts are known can the truth prevail.ReferencesGołaszewski M. (2012). Validated Techniques and Scoring Models for PDD Test Data Analysis – Conclusions from the 2011 APA Report. European Polygraph, Vol. 6, Nr. 4(22), 227-240.Krapohl D., Handler M, Sturm S. (2012). Terminology Reference for the Science of Psychophysiological Detection of Deception, 3rd Edition. American Polygraph Associa-tion.Mangan D. J., Armitage T. E., Adams G. C. (2008). A Field Study on the Validity of the Quadri-Track Zone Comparison Technique. Physiology & Behavior, Vol. 95 (1-2), 17-23.Matte J. A. (2012a). Critique of Meta-Analytic Survey of Criterion Accuracy of Vali-dated Polygraph Techniques. European Polygraph, Vol. 6, Nr. 1(19), 19-44. Matte J. A. (2012b). A Letter to the Editor Regarding the APA’s Terminology Refer-ence for the Science of Psychophysiological Detection of Deception. Polygraph, Vol. 41, Nr. 4, 260-265.Matte J. A., Reuss R. M. (1989a). Validation Study on the Polygraph Quadri-Zone Comparison Technique. Research Dissertation Abstract, LD 01452, Vol. 1502, 1-220. Proquest Information and Learning (Formerly known as University Microﬁ lm Inter-national). Matte J. A., Reuss R. M. (1989b). A Field Validation Study on the Quadri-Zone Com-parison Technique. Polygraph, Vol. 18, Nr. (4), 187-203.JAMES ALLAN MATTE90Shurany T., Stein E., Brand E. (2009). A Field Study on the Validity of the Quadri-Track Zone Comparison Technique. European Polygraph, Vol. 1, Nr. 1(7), 5-23.

Limited response to Marcin Gołaszewski's Conclusions From the Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques

Biblioteka Nauki - repozytorium artykuÅÃ³w

Limited response to Marcin Gołaszewski’s Conclusions From the Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques

https://repozytorium.ka.edu.pl/bitstream/11315/24813/1/MATTE_Limited_response_to_Marcin_Golaszewskis_conclusion_2013.pdf

Limited response to Marcin Gołaszewski's Conclusions From the Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques

Abstract

Similar works

Full text

Available Versions

Repozytorium Instytucjonalne Krakowskiej Akademii

Biblioteka Nauki - repozytorium artykuÅÃ³w

Limited response to Marcin Gołaszewski's Conclusions From the Meta-Analytic Survey of Criterion Accuracy of Validated Polygraph Techniques

Abstract

Similar works

Full text

Available Versions

Repozytorium Instytucjonalne Krakowskiej Akademii

Biblioteka Nauki - repozytorium artykuÅÃ³w

Biblioteka Nauki - repozytorium artykuÅÃ³w