Giner-Sorolla, Roger

Kent Academic Repository

Kent Academic RepositoryFull text document (pdf)Copyright & reuseContent in the Kent Academic Repository is made available for research purposes. Unless otherwise stated allcontent is protected by copyright and in the absence of an open licence (eg Creative Commons), permissions for further reuse of content should be sought from the publisher, author or other copyright holder. Versions of researchThe version in the Kent Academic Repository may differ from the final published version. Users are advised to check http://kar.kent.ac.uk for the status of the paper. Users should always cite the published version of record.EnquiriesFor any further enquiries regarding the licence status of this document, please contact: researchsupport@kent.ac.ukIf you believe this document infringes copyright then please contact the KAR admin team with the take-down information provided at http://kar.kent.ac.uk/contact.htmlCitation for published versionGiner-Sorolla, Roger  (2012) Games of Skill and Chance: How Open Science Norms Might ChangeCareer and Research Strategies.    In: SPSP Annual Conference, January 17-19, 2013, New Orleans,Louisiana.     (Unpublished)DOILink to record in KARhttps://kar.kent.ac.uk/60482/Document VersionPresentationRoger Giner-Sorolla University of Kent ` Art: arranging results and hypotheses to create an aesthetically attractive story ` Science: being honest about hypotheses and results a priori (Giner-Sorolla, 2012)  2SHQVFLHQFH UHSRUWLQJUHVXOWVWKDWGLGQ·Wsupport our initial hypothesis (not necessarily in journals)  ` ´*DPHRIVNLOOµLQVHOHFWLYHSUHVHQWDWLRQEHFRPHV´JDPHRIFKDQFHµLQFRQIURQWLQJreality ` Some of our results might turn out to be nonsignificant  ` But nonsignificant results happen even for true effects    What if results are consistently null?  1. Methodological issues (see LeBel & Peters, 2011)  ` Well-powered experiments ` Agreement on minimum useful effect size ` Confirmed methods  2. Ownership of ideas and moral hazard: three kinds of research program  THEORY BASIS: testing large-scale theories about human psychology EFFECTS BASIS: testing hypotheses that predict a relationship between two variables with a causal story LAY BASIS: testing the validity of psychologically relevant ideas believed by a certain population ` Example: cognitive dissonance vs. self-SHUFHSWLRQWKHRU\DQGWKH´FULWLFDOµexperiments testing between them  THEORY-BASIS RESEARCH ` Large-scale ideas explaining many different effects, hypotheses, paradigms  ` Good psychologists were (are?) recognized early on for being creative in testing even RWKHUSHRSOH·VWKHRULHVHJ)D]LRZanna & Cooper, 1977)  THEORY-BASIS RESEARCH Do you, the researcher, have a vested interest in positive results?   ` 2QO\LILW·V\RXUWKHRU\LW·VQRWDOZD\V² and a theory is big enough to survive disconfirmation in any one area ` In a test between theories, results going either way are useful to report THEORY-BASIS RESEARCH ` Example: Do official national apologies actually promote forgiveness in recipient group members, as some believe?   LAY-BASIS RESEARCH ` Can include tests of ideas from philosophy, pop psychology, etc.   ` The researcher chooses, but does not create, the idea he or she is testing.  ` Can include applied intervention research if WKHUHVHDUFKHUGRHVQ·W´RZQµWKHLQWHUYHQWLRQ(literally or figuratively).   LAY-BASIS RESEARCH LAY-BASIS RESEARCH Do you, the researcher, have a vested interest in positive results?   ` Not really ... Although you may have a personal interest in supporting one side out of ideological commitment  ` Null results can indeed be interesting, as a ´GHEXQNLQJµDUJXPHQWHJ3KLOSRW	+RUQVH\RIILFLDODSRORJLHVGRQ·WOHDGto forgiveness) ` Imagine if the Festinger & Carlsmith (1959) forced compliance finding had been published today ² as a media-IULHQGO\´HIIHFWµwithout a large scale theory and just a very specific hypothesis?   EFFECTS-BASIS RESEARCH The Mighty Dollar Effect  Surprisingly, offering someone $1 to turn pegs can make WKHPOLNHLWPRUHWKDQRIIHULQJWKHP$WOHDVWWKDW¶Vwhat researchers at Stanford University found in a mind-blowing study on college students ... ` The researcher is identified as the creator and ´RZQHUµRIWKHHIIHFWEHLQJWHVWHG  ` Can focus on the effect, or on a limited-scope hypothesis that supports it   ` Can include applied intervention research if WKHUHVHDUFKHU´RZQVµWKHLQWHUYHQWLRQ(literally or figuratively).   EFFECTS-BASIS RESEARCH EFFECTS-BASIS RESEARCH Do you, the researcher, have a vested interest in positive results?   ` Yes ... The hypothesis is your creative idea, so null results are no more interesting than an unwritten novel  ` This is a problem when other UHVHDUFKHUVGRQ·WVHHDUHZDUGLQYHULI\LQJRUFKDOOHQJLQJ´\RXUµLGHD  ` Are the ideas you test bigger than yourself?  ` What would constitute an interesting finding against them?  ` Do your Introduction sections promote only your own hypothesis, or do they consider alternatives? 

Games of Skill and Chance: How Open Science Norms Might Change Career and Research Strategies

https://kar.kent.ac.uk/60482/1/SPSP%202013%20OS.pdf

Games of Skill and Chance: How Open Science Norms Might Change Career and Research Strategies

Abstract

Similar works

Full text

Available Versions

Kent Academic Repository