Dr. Perle's article on chiropractic muscle testers.http://www.dynamicchiropractic.com/mpacms/dc/article.php?id=5243

Perle, Stephen M.

UB ScholarWorks

Intellectual HonestyChiropractic Muscle Testers Have Not Risen to the ChallengeBy Stephen M. Perle, DC, MSWe read with interest the recent article by Scott Cuthbert, DC, in Dynamic Chiropractic.1  At first glance,one might get the impression that the applied kinesiology (AK) movement had produced some originalresearch that validates their unique version of manual muscle testing. Dr. Cuthbert starts off his article withthe statement that he is reviewing "a landmark study presenting the basic science and clinical researchevidence for the reliability and validity of the manual muscle test."It’s interesting that the "landmark study" to which he refers actually is a literature review he co-authored andpublished in the BioMed Central journal Chiropractic and Osteopathy.2  It’s rather presumptuous to writean article for DC reviewing and praising his own work as a "landmark study." Calling a literature review a"study" is an exaggeration. History, not an author himself, labels a publication as a "landmark." One cannoteven imagine Newton labeling his Principia as a landmark. Providing such aggrandizing labels does littlemore than deceive the casual reader and seems to us to lack intellectual honesty.There are numerous methodological flaws in the literature review by Cuthbert and Goodheart, and we werepleased to see that a commentary by Haas, et al., already has been published in the same journal.3  Wewould refer the comprehensive reader to the full critique article published by Haas, et al., regarding theserious problems with the poorly implemented literature review published by Cuthbert and Goodheart. Mostof the BioMed Central electronic journals are "Open Access," meaning they are immediately andpermanently available online without charge. To view the full text articles by Cuthbert and Goodheart, andthe response article by Hass, Cooperstein and Peterson, visit www.chiroandosteo.com.We are writing this article to briefly outline the major misinterpretations of the literature andunsubstantiated statements made by Cuthbert in his Dynamic Chiropractic article.1  Cuthbert and Goodheart2  did not perform any original research. It appears they simply reviewed the existing literature,looking for research articles that supported their notion that manual muscle testing was reliable and valid.- 1 -While a review of the literature is an important and necessary step in advancing our understanding of theresearch literature, authors must ensure that their conclusions are appropriate and unbiased and based uponall the existing literature. Cuthbert and Goodheart did none of this. Trying to label a literature review as astudy appears to be intellectually dishonest, unless Cuthbert is just ignorant of the proper terminology.There is a huge difference between the appropriate uses of the standard manual muscle test (SMMT) and theuses of the applied kinesiology manual muscle test (AKMMT). Cuthbert tries to interchange the uses ofthese two types of muscle testing as if they are equivalent procedures, but this is intellectually dishonest. Hecites studies that show excellent inter-examiner reliability for the SMMT, generally for specific neurologicalconditions resulting in muscle weakness. The SMMT, a standard component of an orthopedic/neurologicalexamination, is measured on a five-point scale originally developed by Kendall, et al.4  This scale has beenshown to be a reliable method to document the amount of muscle weakness, atrophy or paralysis in patientswith serious neuromuscular diseases such as polio, stroke, cerebral palsy, multiple sclerosis and spinal-cord injuries.The use of manual muscle testing for applied kinesiology (AK) does not follow this five-point scaleprotocol, and instead uses a simple two-point scale: "weak" or "strong." More importantly, AK muscletesting is not used to determine atrophy or serious muscle weakness in neuromuscular diseases. AKpractitioners use their two-point version of muscle-strength testing to determine organic disease,"functional" disorders, subluxation, etc. Substantial scientific literature does not exist to support the use ofthe AK version of manual muscle testing for these "functional" conditions.5It’s scientifically disingenuous to use the literature that supports SMMT to claim it validates AKMMT. Thisis akin to saying that since a thermometer immersed in water can reliably and with great validity measurethe water temperature, that one can reliably use the same thermometer to measure the temperature and sugarconcentration of that water without immersion of the thermometer in the water. Both measurements aredone with thermometers but with vastly different methods and interpretations. A review of all the researchcurrently available on manual muscle testing says absolutely nothing about the ability of an AK practitionerto diagnose any condition other than what those using the muscle testing in the studies reviewed weremeasuring: muscle strength.Cuthbert1  makes the statement that "to provide the strongest evidence for the use of chiropractic MMTtechniques, more randomized controlled clinical trials (RCTs) and systematic reviews like this one ... will be- 2 -essential." It appears he does not understand that the RCT design is primarily for testing treatmenteffectiveness and is not necessary for examining the question of reliability or validity. The strongestevidence to support the use of AKMMT would be systematic reviews of level 1 evidence on validity. Cohortstudies are one type of level 1 evidence of diagnostic validity.6Simply, a validity study examines whether a diagnostic test actually measures what it purports to measureby comparison to a gold standard. Sometimes, prior to conducting validity studies (and when there is a lackof a gold standard), studies of reliability are conducted. Reliability studies determine if the diagnostic testgives the same answer when applied repeatedly. A diagnostic test that is not reliable cannot typically beconsidered valid.Several inter-examiner reliability studies have been performed on the AKMMT, and they show poor results.In their critique article, Haas, et al.,3  have cited numerous references that show poor inter-examinerreliability for the AKMMT, and again, we refer the serious reader to their paper for those references.In addition, Cuthbert and Goodheart2  did not perform a systematic review of the literature.1  In fact, theirliterature review was not "systematic" because of their failure to adequately and comprehensively search,then rate and critically review the quality of the articles they retrieved. Haas, et al,3  point out in theircritique article that Cuthbert and Goodheart missed a number of important citations in their flawed literaturesearch, including a number of chiropractic studies by several authors, including LeBoeuf, Triano and Haas,that showed poor inter-examiner reliability for the AKMMT.Although it seems impressive that 100-plus studies exist on manual muscle testing, it appears that Cuthbertand Goodheart simply went online and found papers with the term muscle testing in the title and saved thosestudies which looked interesting to them. They admit to only saving articles that showed highinter-examiner reliability by virtue of having a Kappa value of >.50. This is circuitous logic. By omittingthose studies which showed poor or low inter-examiner reliability, they were left only with studies showinggood or high reliability. It is therefore no surprise that their cherry-picking of the literature resulted in onlyhigh reliability studies! We question the intellectual honesty of writing that a diagnostic method is reliablewhen one systematically ignores every paper that refutes that assertion. Imagine a jury never being allowedto see exculpatory evidence, even if the preponderance of the evidence was in the accused favor. Would itbe a surprise that the jury found the accused guilty?- 3 -In conclusion, it’s disturbing to see such a misleading title that suggests Cuthbert and Goodheart have "risento the challenge of validating their work." This is simply not true and, in our opinion, is intellectuallydishonest. In order to validate AK, they actually would have to produce their own original research, such asinter-examiner reliability studies that use applied kinesiology muscle-testing procedures on patients with thefunctional disorders they purport to be capable of detecting. They need to provide the evidence that theunique version of manual muscle testing used with their system of applied kinesiology is reliable, and thenproceed to show that this reliable testing procedure also is clinically valid. In order to show validity, areliable diagnostic testing procedure must be compared to some other sort of gold-standard test.We perceive cherry-picking the physical therapy and rehabilitation literature on standard, manual muscletesting and inappropriately trying to pawn this off as proof of the reliability and validity of the appliedkinesiology version of manual muscle testing as completely intellectually dishonest. We look forward to theday that we can read the results of some well-designed inter-examiner reliability and validity studiesproduced by the applied kinesiology community, rather than an intellectually dishonest attempt to claim tohave validated AK though a poorly done literature review.References1.  Cuthbert SC. Chiropractic muscle testers rise to the challenge of validating their work. Dynamic Chiropractic, 2007;25(18). 2.  Cuthbert SC, Goodheart GJ. On the reliability and validity of manual muscle testing: a literaturereview. Chiropr Osteopat, March 6, 2007;15:4. 3.  Haas M, Cooperstein R, Peterson D. Disentangling manual muscle testing and Applied Kinesiology:critique and reinterpretation of a literature review. Chiropr Osteopat, Aug. 23, 2007;15(1):11. 4.  Kendall FP, McCreary E, Provance PG. Muscles: Testing and Function. Baltimore: Williams &Wilkins, 1993. 5.  Cooperstein R, Gleberzon B. Technique Systems in Chiropractic. Edinburgh: Churchill-Livingston,2004. 6.  Centre for Evidence Based Medicine. Levels of Evidence. www.cebm.net/index.aspx?o=1025. About the co-authors: - 4 -Dr. Michael Schneider has been in private chiropractic practice for 25 years and currently is a PhDcandidate in rehabilitation science at the University of Pittsburgh.Dr. Jeffrey Hebert is a PhD student at the University of Utah. Additionally, he is a practicing chiropractorand diplomate of the American Chiropractic Board of Sports Physicians.Dr. John Ventura has been in private practice for 23 years, is clinical instructor in family medicine atUniversity of Rochester School of Medicine and assistant clinical professor at NYCC.Dr. Warren Jahn has been in private practice for 30 years, attained his master’s degree concentrating inbiomechanical trauma and is on the editorial board for the Journal of Chiropractic Medicine.Click here for previous articles by Stephen M. Perle, DC, MS.Page printed from: http://www.dynamicchiropractic.com/mpacms/dc/article.php?id=52437&no_paginate=true&p_friendly=true&no_b=true- 5 -

Intellectual Honesty: Chiropractic Muscle Testers Have Not Risen To The Challenge

http://www.dynamicchiropractic.com/print_pdf.php?pr_file_name=http%3A%2F%2Fwww.dynamicchiropractic.com%2Fmpacms%2Fdc%2Farticle.php%3Fid%3D52437%26no_paginate%3Dtrue%26p_friendly%3Dtrue&title=Intellectual%20Honesty

Intellectual Honesty: Chiropractic Muscle Testers Have Not Risen To The Challenge

Abstract

Similar works

Full text

Available Versions

UB ScholarWorks