Dey, Priyanka

Gintoli, Michele

Lechner, Bob-Dan

Mouchet, Sebastien

Nallala, Jayakrupakar

English

Repository of the University of Namur

RESEARCH OUTPUTS / RÉSULTATS DE RECHERCHEAuthor(s) - Auteur(s) :Publication date - Date de publication :Permanent link - Permalien :Rights / License - Licence de droit d’auteur :Bibliothèque Universitaire Moretus PlantinInstitutional Repository - Research PortalDépôt Institutionnel - Portail de la Rechercheresearchportal.unamur.beUniversity of NamurNegative results in scientific research: Not junk, but an opportunity to learnMouchet, Sebastien; Dey, Priyanka; Gintoli, Michele; Nallala, Jayakrupakar; Lechner, Bob-DanPublished in:Photonics FocusPublication date:2022Document VersionPublisher's PDF, also known as Version of recordLink to publicationCitation for pulished version (HARVARD):Mouchet, S, Dey, P, Gintoli, M, Nallala, J & Lechner, B-D 2022, 'Negative results in scientific research: Not junk,but an opportunity to le rn', Photonics Focus, vol. 3, no. 5, pp. 6-7.<https://www.researchgate.net/publication/363272036_Not_Junk_Negative_Results_in_Research_Present_an_Opportunity_to_Learn/link/632d455ae137f218b5c1400b/download?_tp=eyJjb250ZXh0Ijp7InBhZ2UiOiJwdWJsaWNhdGlvbiIsInByZXZpb3VzUGFnZSI6bnVsbH19>General rightsCopyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright ownersand it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.            • Users may download and print one copy of any publication from the public portal for the purpose of private study or research.            • You may not further distribute the material or use it for any profit-making activity or commercial gain            • You may freely distribute the URL identifying the publication in the public portal ?Take down policyIf you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediatelyand investigate your claim.Download date: 23. Jan. 2024BANDWIDTHNot Junk: Negative Results in Research Present an Opportunity to LearnIN SCIENCE, positive findings conforming with established hypotheses are celebrated via publication—the coin of the realm in academia—whereas nonconforming or nega-tive results are often frowned upon and discarded by the researcher. This is surely also true for optics and photonics.Many scientists do not proceed further with negative find-ings because the related value in the scientific community tends to be much lower than for so-called positive data. How-ever, null outcomes sometimes need to be demonstrated and, in some cases, scrutinizing negative results from an alternative perspective can help to understand a larger problem. In the early 1900s, Lord Rayleigh derived the famous –4 formula to predict the spectral radiance of electro-magnetic radiation from a blackbody—a derivation that led to the Rayleigh-Jeans law. This derivation relied on the classical physics theories and on empirical observations for low frequencies. How-ever, that derivation implied that the emitted energy was infinite at high frequencies. This idea was at odds with the then-known fact that total emitted energy is finite, and the prediction significantly diverged from observations above 100 THz. From its first derivation in 1900, it took approximately five years for the idea of the “ultraviolet catastrophe” to catch on, mostly thanks to the contributions of Lord Rayleigh himself and Albert Einstein, who managed to convince the scientific com-munity that classical electro-magnetism had to be rejected in favor of the quanta of light theory derived in 1900 by Max Planck (who, ironically, wasn’t initially convinced of the reality of the theory, and thought of it just as a mathematical trick). This negative result was one of several that led to the birth of quantum mechanics.So, disregarding negative results not only represents an obstacle for the development of science, but also encour-ages researchers to dismiss results contradicting existing literature, regardless of potential for leading to significant breakthroughs. Validating negative results by further experi-mentation or analyses, ensuring reproducibility and statistical significance, is sometimes necessary. Researchers, editors, publishers, and funding institutions should be aware of the significance of negative findings and support their dissemination. We need a change of mindset to transfer in-depth knowledge gleaned from negative results to next-generation researchers. In other words, it’s time to be positive about negative results.Negative findings can be defined as results that contradict research hypotheses, established scientific knowledge, and previous evidence or predictions. They are typically charac-terized by a different, opposite, or absent correlation between observed phenomena. Of course, these results must still rely on sound theories and carefully performed experiments. Erroneous results cannot be considered negative results per se.Negative results are usually rejected or even regarded as failures by researchers and their peers. As a consequence, posi-tive results in published articles sometimes lead to conclusions different from those arising from unpublished negative results. When this is systemic, we say there is a publication bias.Published negative results also tend to be less cited than positive results, or only cited by a small group of researchers, leading to exclusion from meta-analyses or literature reviews. This so-called citation bias also has indirect consequences: In academia, well-cited articles often lead to a higher probability of continued research funding.So, it is crucial for the advancement of knowledge to pub-lish both positive and negative findings. The publication of well-documented, well-designed, and well-executed “failures” could add important perspectives and records to the scientific literature. For example, results considered negative are often statis-tically more reliable since they are reproduced at multiple occurrences. They are valuable elements in the scientific literature that can help to evaluate data, reveal undiscovered relationships, or point out wrong assumptions and flaws in theories. They can also be used to steer research strategies, and provide inspiration for innovative development of theories, simulations, or experiments. What’s more, their dissemination avoids duplication of effort by other groups.Instead of rejecting negative results, we might allow greater room for nature’s complexity by placing greater trust in our data, rather than outright rejecting that which does not imme-diately fit our preconceptions. This practice may mean acquir-PHOTONICS FOCUS SEPTEMBER/OCTOBER 20226  Photo credits: The Nobel Foundation archiveLord Rayleigh  (John William Strutt)Albert Einsteining more data and discussing it with peers in our own research groups and institutions, as well as with colleagues from other institutions.When negative results are encountered, the path forward for the research team can vary. If obtained in an early stage of a project, decide whether to investigate further depending upon, for example, significance of the data, the project timeframe, project objective, and researchers’ instincts. If secured in a late stage of investigation, negative results should be disseminated.This practice is true for both early-career and established research-ers. The former should take advantage of such publications to prac-tice technical writing, which is a valuable skill. The latter typically have the time to address time-consuming questions that arise from negative results and enough credibility to question widespread assumptions in their fields.Fortunately, an increasing number of peer-reviewed scientific jour-nals aiming to reduce publication bias have emerged in recent years. All reinforce the idea that, in science, failure can be as important as success. In addition, open-access broad-topic journals such as PeerJ, PLOS ONE, Scientific Reports, and F1000Research also allow the publication of negative results. Still, the number of articles reporting negative findings remains a small percentage of the overall literature. Ideally, results should be published regardless of negative or positive conclusions. Even if journals favoring novel, impactful, and positive results cannot be avoided, publishers could give negative findings more room. Conference proceedings, like SPIE’s, are one such venue for publications of this type. Publishing scientific articles is not an end unto itself. As research-ers, we should not be disappointed or frustrated by negative results but strive to reach unbiased conclusions driven solely by the data. Such research has value. SÉBASTIEN R. MOUCHET, PRIYANKA DEY, MICHELE GINTOLI, JAYAKRUPAKAR NALLALA, and BOB-DAN LECHNER are researchers in the Department of Physics and Astronomy, University of Exeter, UK. Contact the authors at s.mouchet@exeter.ac.uk; or B.Lechner@exeter.ac.ukTeach a course at an SPIE eventWe are looking for new courses and instructors to add to our course programs.Visit spie.org/instructorsfor more information, or email us at education@spie.orgSHARE YOUR EXPERTISEwww.masterbond.com154 Hobart St., Hackensack, NJ 07601, USA+1.201.343.8983 ∙ main@masterbond.com• For bonding, sealing,coating & encapsulating• Outstanding toughness• Resists thermal cyclingTwo PartEP38CL

Negative results in scientific research: Not junk, but an opportunity to learn

https://pure.unamur.be/ws/files/88168914/Mouchet_et_al_2022_Photonics_Focus.pdf

Negative results in scientific research: Not junk, but an opportunity to learn

Abstract

Similar works

Full text

Available Versions

Repository of the University of Namur