Skip to main content
Article thumbnail
Location of Repository

Capturing the Justice Judgment: An Application of the Theory of Representative Design in two Policy Capturing Studies in Organizational Justice



An understanding of how justice judgments are formed is essential knowledge for practitioners given the adverse consequences which may arise due to perceptions of unfairness. In this thesis, two studies are conducted to explore the overall justice judgment, complying with the principles of representative design in order that the stimuli and situations are relevant and realistic for the sampled participants, and reflect real world decision making processes. \ud Study 1 adopts a policy capturing design using a sample of 12 Judges to rate the overall fairness of 56 performance appraisals (N=672 situations). Study 2 uses Mouselab, a process-tracing tool, to present the stimuli and record the information acquisition processes used by individuals. This study uses N=2744 situations on which within- and between- individual analyses are conducted. \ud The selection process of the 10 cues on which judgments were formed explained around 82% of variance in overall justice judgments. Objective decision making policies are inferred using regressions, and are compared to subjective policies stated by each Judge. \ud Results illustrate that unequal weights are assigned to justice antecedents in the formation of overall judgments, and that the presence of antecedents does not ensure their salience to an overall judgment. Furthermore, the salience of the role of justice dimensions varies between individuals. Judges are mostly consistent in making justice judgments between situations (r=0.63), but exhibit poor self-insight into their own mental processes. Comparison of objective and subjectively ranked cues was low (r=0.02), and between objectively and subjectively rated cues (r=0.26). Measures of personality and cognitive control (CRT) are included to explore decision making between individuals. \ud This thesis demonstrates possibilities for representative design in justice research, and illustrates how it can enhance the capabilities of policy capturing studies. Practical implications for appraisers are discussed in light of how fair performance appraisals are perceived to be

Topics: Organizational justice, Fairness, Representative design, Policy capturing, Process tracing, Mouselab.
Year: 2011
OAI identifier:
Provided by: Durham e-Theses

Suggested articles


  1. (2001). [1944]) Distal Focussing of Perception; Size Constancy in a Representative Sample of Situations IN doi
  2. (2002). A Better Mousetrap For Catching Decision Processes. doi
  3. (2008). A Comparison of the Coefficient of Predictive Power, the Coefficient of Determination and AIC for Linear Regression. Decision Sciences Proceedings.
  4. (1995). A Comparison of Two Process Tracing Methods for Choice Tasks. doi
  5. (1996). A Comparison of Two Process Tracing Methods for Choice Tasks. Organizational Behavior and Human Decision Processes, doi
  6. (1990). A Componential Analysis of Cognitive Effort in Choice. Organizational Behavior and Human Decision Processes, doi
  7. (1993). A Computerized Approach to Decision Process Tracing for Decision Support System Design. doi
  8. (1992). A constructive process view of decision making: doi
  9. (1978). A Contingency Model for the Selection of Decision Strategies doi
  10. (1992). A due process metaphor for performance appraisal.
  11. (2003). A Longitudinal Analysis of Organizational Fairness: An Examination of Reactions to Tenure and Promotion Decisions. doi
  12. (1989). A Note on the Assessment of Self-Insight doi
  13. (2001). A Passion for Justice: The Rationality and Morality of Revenge.
  14. (1983). A Policy-Capturing Investigation of the Role of Expectancies in Decisions to Pursue Job Alternatives. doi
  15. (1998). A Rejection Threshold doi
  16. (1992). A relational model of authority in groups. doi
  17. (2002). A Review and Analysis of the Policy-Capturing Methodology in Organizational Research: Guidelines for Research and Practice. doi
  18. (1978). A Study of the Interface Between Attitude Structure and Information Acquisition Using a Questionnaire-Based Information Display Sheet.
  19. (1987). A Taxonomy of Organizational Justice Theories. doi
  20. (1983). An Examination of the Linear and Retrospective Process Tracing Approach to Judgment Modelling. The Accounting Review,
  21. (1977). An Information Processing Model and Approach to the Study of Motivation. Organizational Behavior and Human Decision Processes, doi
  22. (1996). An integrative framework for explaining reactions to decision: Interactive effects of outcomes and procedures. doi
  23. (2002). Antecedents and consequences of justice perceptions in performance appraisals. doi
  24. (2002). Applied Multivariate Statistics for the Social Sciences, doi
  25. (1984). Approaches to personality inventory construction. doi
  26. (1991). Appropriate Moderated Regression and Inappropriate Research Strategy: A Demonstration of Information Loss Due to Scale Coarseness. doi
  27. (2003). Are Outcome Fairness and Outcome Favorability Distinguishable Psychological Constructs? A Meta-Analytic Review.
  28. (2005). Are Procedural Justice and Distributive Justice Conceptually Distinct?
  29. (2005). Are Procedural Justice and Interactional Justice Conceptually Distinct?
  30. (1993). Autonomy as a moderator of the relationship between the big five personality dimensions and job performance. doi
  31. (1984). Basic Cognitive Ability Meaures as Predictors of Consumer Information Processing Strategies. doi
  32. (1981). Behavioural Decision Theory: Processes of Judgment and Choice. doi
  33. (1980). Beyond Fairness: A theory of allocation preferences.
  34. (1990). Beyond formal procedures: The interpersonal context of procedural
  35. (1994). Bread and roses: Justice and the distribution of financial and socioemotional rewards in organizations. doi
  36. (1998). Brunswik's Challenge, The Brunswik Society,,
  37. (2001). Brunswik's Theoretical and Methodological Contributions to Research in Interpersonal Perception.
  38. (2005). Business Research Methods, Berkshire, McGraw-Hill Education.
  39. (1978). Can We Learn Anything About Interviewing Real People From "Interviews" of Paper People? Two Studies of the External Validity of a Paradigm. Organizational Behavior and Human Decision Processes, doi
  40. (1974). Capturing Judgment Policies: A Field Study of Performance Appraisal. doi
  41. (1977). Capturing Rater Policies for Processing Evaluation Data. Organizational Behavior and Human Decision Processes, doi
  42. (1981). Clarifying Performance Appraisal Criteria. Organizational Behavior and Human Decision Processes, doi
  43. (1972). Cognitive Control. doi
  44. (2005). Cognitive Reflection and Decision Making. doi
  45. (2001). COMMENT: Thinking about Error and Errors about Thinking. IN doi
  46. (1973). Comments On The "Lens Model" Equation And The Analysis of MultipleCue Judgment Tasks. doi
  47. (1998). Comments On The Distinction Between "Policy Capturing" And "Judgment Analysis", The Brunswik Society, September,
  48. (1971). Comparison of Bayesian and Regression Approaches to the Study of Information Processing doi
  49. (1992). Competence in Experts: The Role of Task Characteristics. Organizational Behavior and Human Decision Processes, doi
  50. (2002). Conducting Studies of Decision Making in Organizational Contexts: A Tutorial for Policy-Capturing and Other Regression-Based Techniques. doi
  51. (1996). Conscientiousness and task performance: Test of a cognitive process model. doi
  52. (2002). Contemporary Justice Research: A New Look at Familiar Questions. Organizational Behavior and Human Decision Processes, doi
  53. (1982). Contingent Decision Behavior. doi
  54. (1981). Correlates of Employee Reactions to Performance Appraisals and Appraisal Systems. doi
  55. (1978). Correlates of Perceived Fairness and Accuracy of Performance Evaluation. doi
  56. (2000). Determinants of Perceived Pay Inequities: The Effects of Comparison Other Characteristics and Pay-System Communication. doi
  57. (1977). Differences in Teachers' Judgment Policies for Varying Numbers of Verbal and Numerical Cues. Organizational Behavior and Human Decision Processes, doi
  58. (1996). Discussion of Measuring Cognitive Effort During Analytical Review: A Process-Tracing Framework with Experimental Results. Auditing:
  59. (2004). Does Experience Matter in Lending? A Process-Tracing Study on Experienced Loan Officers' and Novices Decision Behavior. doi
  60. (1980). Effects of Prior Knowledge and Experience and Phase of the Choice Process on Consumer Decision Processes: A Protocol Analysis. doi
  61. (1989). Effects of Procedural and Distributive Justice on Reactions to Pay Raise Decisions. doi
  62. (1992). Effects of Work Values on Job Choice Decisions. doi
  63. (1990). Employee theft as a reaction to underpayment inequity: The hidden cost of pay cuts. doi
  64. (1998). Employees' Perceptions of the Distributive Justice of Pay Raise Decisions: A Policy Capturing Approach.
  65. (2005). Encyclopedia of Social Measurement. doi
  66. (1975). Equity, equality, and need: What determines which value will be used as the basis for distributive justice? doi
  67. (2001). Expansion of Egon Brunswik's Psychology,
  68. (2007). Experience Sampling Method. Measuring the Quality of Everyday Life,
  69. (2000). Experimental Validity: Brunswik, Campbell, Cronbach, and Enduring Issues. doi
  70. (1994). Explanations: What factors enhance their perceived adequacy? Organizational Behavior and Human Decision Processes, doi
  71. (1982). External Validity Is More Than Skin Deep. Some Answers to Criticisms of Laboratory Experiments. doi
  72. (1993). Extracting" Policy from Judicial Opinions: The Dangers of Policy Capturing in a Field Setting. doi
  73. (1978). Eye Fixations Can Save The World: A Critical Evaluation and a Comparison Between Eye Fixations and Other Information Processing Methodologies.
  74. (2009). Fair Today, Fair Tomorrow? A Longitudinal Investigation of Overall Justice Perceptions. doi
  75. (1988). Fairness and Implied Contract Obligations in Job Terminations: A Policy-Capturing Study. Human Performance, doi
  76. (1993). Fairness and Implied Contract Obligations in Job Terminations: The Role of Remedies, Social Accounts, and Procedural Justice. Human Performance, doi
  77. (1998). Fairness as a moral virtue.
  78. (2001). Fairness heuristic theory: justice judgments as pivotal cognitions in organizational relations. doi
  79. (2007). Forming and reacting to overall fairness: A cross-cultural comparison. Organizational Behavior and Human Decision Processes, doi
  80. (2010). From justice events to justice climate: A multi-level temporal model of information aggregation and judgment. doi
  81. (2005). Fundamental Principles of Brunswik's Representative Design, The Brunswik Society, February,
  82. (2001). Fundamental Research by Means of Laboratory Experiments Is Essential for a Better Understanding of Organizational Justice. doi
  83. (1904). General intelligence", objectively determined and measured. doi
  84. (1986). Generalizing Over Conditions by Combining the Multitrait-Multimethod Matrix and the Representative Design of Experiments. doi
  85. (2008). How Do I Assess if my Supervisor and Organization Are Fair?: Identifying the Rules Underlying Entity-Based Justice Perceptions. doi
  86. (2001). How do I know what's fair? A categorization approach to fairness judgements.
  87. (2005). How Does Organizational Justice Affect Performance, Withdrawal, and Counterproductive Behavior?
  88. (2005). How Should Organizational Justice Be Measured?
  89. (2006). Human Processes of Control: Tracing the Goals and Strategies of Control Room Teams. doi
  90. (1986). Identifying principles of interactional justice: The case of corporate recruiting.
  91. (1965). Inequity in Social Exchange. doi
  92. (2000). Information Processing at Successive Stages of Decision Making: Need for Cognition and Inclusion-Exclusion Effects. Organizational Behavior and Human Decision Processes, doi
  93. (1987). Information Search and Decision Making: The Effects of Information Displays. doi
  94. (1998). Information Selection and Utilization doi
  95. (2001). Interactional (in)justice: The sacred and the
  96. (1986). Interactional Justice: Communication criteria of fairness.
  97. (1996). Judgement Analysis: Theory, Methods and Applications,
  98. (1988). Judgment Analysis: Procedures. doi
  99. (1984). Judgment and Decision: Theory and Application. doi
  100. (2010). Just Tell Me! Making Alternative Dispute Resolution Systems Fair. doi
  101. (2006). Justice and personality: Using integrative theories to derive moderators of justice effects. Organizational Behavior and Human Decision Processes, doi
  102. (1993). Justice as a mediator of the relationship between methods of monitoring and organizational citizenship behavior. doi
  103. (2001). Let's Not Forget the Organization in Organizational Justice: It Just Wouldn't Be Fair. doi
  104. (1979). Linear Regression and ProcessTracing Models of Judgment. doi
  105. (1987). Managerial Salary-Raise Decisions: A Policy-Capturing Approach. doi
  106. (1983). Measures of Compensatory and Noncompensatory Models of Decision Behavior: Process Tracing versus Policy Capturing. Organizational Behavior and Human Performance, doi
  107. (1996). Measuring Cognitive Effort During Analytical Review: A Process-Tracing Framework with Experimental Results. Auditing:
  108. (2008). Meta-Analytic Tests of Relationships Between Organizational Justice and Citizenship Behavior: Testing Agent-System and Shared-Variance Models. doi
  109. (1992). Moderated Regression Analysis and Likert Scales Too Coarse For Comfort. doi
  110. (2001). Moral Virtues, Fairness Heuristics, Social Entities and Other Denizens of Organizational Justice. doi
  111. (2001). Multidimensional Constructs in Organizational Behavior Research: An Integrative Analytical Framework Organizational Research Methods, doi
  112. (2008). Multiple-Reason Decision Making Based on Automatic Processing. doi
  113. (1987). New Directions in Behavioral Process Research: Implications for Social Psychology. doi
  114. (2003). Of Different Minds: An accessible identity model of justice reasoning. doi
  115. (2001). On the Dimensionality of Organizational Justice: A Construct Validation of a Measure. doi
  116. (2003). Organizational Justice: A Fair Assessment of the State of the Literature.
  117. (1990). Organizational justice: Yesterday, today, and tomorrow. doi
  118. (1998). Participation in the Performance Appraisal Process and Employee Reactions: A Meta-Analytic Review of Field Investigations. doi
  119. (1994). Pay Preferences and Job Search Decisions: A PersonOrganization Fit Perspective. doi
  120. (2004). Perceived Fairness of Web-Based Applicant Screening Procedures: Weighing the Rules of Justice and the Role of Individual Differences. doi
  121. (1998). Perceptions of Interest: A Lens Model Analysis. doi
  122. (1982). Performance Appraisal Decisions as a Function of Rater Training and Purpose of the Appraisal. doi
  123. (2008). Perspectives on organizational justice: Concept clarification, social context integration, time and links with morality. doi
  124. (1983). Policy Capturing as an Approach to Understanding and Improving Performance Appraisal: A Review of the Literature. doi
  125. (1986). Policy Capturing in the Employment Interview. doi
  126. (1978). Position Choice: Comparing the Importance of Organizational and Job Factors. doi
  127. (1955). Probabilistic Functioning and the Clinical Method. doi
  128. (2001). Procedural and Distributive Justice Are More Similar than You Think: A Monistic Perspective and a Research Agenda.
  129. (2005). Procedural and Distributive Justice Effects Moderated by Organizational Identification. doi
  130. (1997). Process and outcome: Gender differences in the assessment of justice. doi
  131. (1979). Process Descriptions of Decision Making. doi
  132. (1987). Process Tracing Methods in Decision Support Systems Research: Exploring the Black Box. doi
  133. (1989). Process tracing methods: Contributions, problems, and neglected research questions. Organizational Behavior and Human Decision Processes, doi
  134. (2004). Process Tracing of Complex Cognitive Work Tasks. doi
  135. (1997). Progress in Organizational Justice: Tunneling Through the
  136. (1995). Rational and Social Theories as Complementary Explanations of Communication Media Choices: Two Policy-Capturing Studies. doi
  137. (2001). Representative Design and Probabilistic Theory in a Functional Psychology. IN doi
  138. (1994). Residents' and Burglars' Assessment of Burglary Risk from Defensible Space Cues doi
  139. (1997). Retaliation in the workplace: The roles of distributive, procedural, and interactional justice. doi
  140. (2001). Setting the Justice Agenda: Seven Unanswered Questions about "What, Why and How". doi
  141. (1981). Social Desirability Response Bias in Self-Report Choice Situations. doi
  142. (1996). Social Judgement Theory. Thinking and Reasoning, doi
  143. (1976). Some Internal Psychological Factors Influencing Consumer Choice. doi
  144. (1964). Some Methodological Considerations in Multiple-Cue Probability Studies. doi
  145. (1999). Sometimes Unfair Procedures Have Nice Aspects: On the Psychology of the Fair Process Effect. doi
  146. (2007). SPSS Survival Manual, Berkshire,
  147. (1993). Stealing in the Name of Justice: Informational and Interpersonal Moderators of Theft Reactions to Underpayment Inequity. Organizational Behavior and Human Decision Processes, doi
  148. (1978). Stimulus Sampling In Clinical Research: Representative Design Reviewed. doi
  149. (2011). Strength-based performance appraisal and goal setting. doi
  150. (1948). Subject and Object Sampling - A Note. doi
  151. (1978). Subjects'
  152. (1949). Systematic and Representative Design of Psychological Experiments. Berkeley doi
  153. (2009). Take A Quick Click At That! Mouselab and EyeTracing as Tools to Measure Intuition.
  154. (1976). Task Complexity and Contingent Processing in Decision Making: An Information Search and Protocol Analysis. Organizational Behavior and Human Performance, doi
  155. (1977). Telling More Than We Can Know: Verbal Reports on Mental Processes. doi
  156. (1993). The Adaptive Decision Maker, Cambridge, doi
  157. (1992). The Assessment of Self-Insight in Judgment Policies. Organizational Behavior and Human Decision Processes, doi
  158. (1999). The Big-Five Trait Taxonomy: History, Measurement, and Theoretical Perspectives.
  159. (2005). The Challenge of Representative Design in Psychology and Economics. doi
  160. (2011). The cognitive reflection test as a predictor of performance on heuristics-and-biases tasks. Memory and Cognition, (in press). doi
  161. (2001). The Death of Justice Theory is Likely if Theorists Neglect the "Wheels" Already Invented and the Voices of the Injustice victims. doi
  162. (1976). The distribution of rewards and resources in groups and organizations. doi
  163. (1991). The effects of explanations on negative reactions to deceit. doi
  164. (1988). The effects of response mode and importance on decisionmaking strategies: Judgment versus choice. Organizational Behavior and Human Decision Processes, doi
  165. The Essential Brunswik: Beginnings, Explications, Applications.
  166. (2003). The Hawthorne Experiment. Western Electric Company. The Human Problems of an Industrial Civilization.
  167. (2001). The History of Organizational Justice: The Founders Speak.
  168. (1993). The intellectual adolescence of organizational justice: You've come a long way, maybe. doi
  169. (2009). The Mediating Role of Overall Fairness and the Moderating Role of Trust Certainty in Justice-Criteria Relationships: The Formation and Use of Fairness Heuristics in the Workplace. doi
  170. (1996). The Methodology of Social Judgement Theory. Thinking and Reasoning, doi
  171. (1990). The Moderating Role of Social Desirability, Age, and Experience in Human Judgment: Just how Indirect is Policy Capturing? Organizational Behavior and Human Decision Processes, doi
  172. (1957). The Need for Representative Design in Studies of Intepersonal Perception. doi
  173. (1960). The Paramorphic Representation of Clinical Judgment. doi
  174. (2003). The Perceived Fairness of Layoff Practices. doi
  175. (1987). The predicament of injustice: The management of moral outrage.
  176. (2001). The Realistic Accuracy Model and Brunswik's Approach to Social Judgment. IN
  177. (2007). The relationship between justice and attitudes: An examination of justice effects on event and system-related attitudes. Organizational Behavior and Human Decision Processes, doi
  178. (2008). The Role of Compensatory and Retributive Justice in Determining Damages in Employment Disputes. doi
  179. (1999). The Role of Influence Tactics in Perceptions of Performance Evaluations' Fairness. doi
  180. (2001). The Role of Justice in Organizations: A MetaAnalysis. Organizational Behavior and Human Decision Processes, doi
  181. (2009). The Role of Overall Justice Judgments in Organizational Justice Research: A Test of Mediation. doi
  182. (2004). The Role of Representative Design in an Ecological Approach to Cognition. doi
  183. (2007). The Self-Report Method.
  184. (1998). The social construction of injustice: Fairness judgments in response to own and other's unfair treatment by authorities. Organizational Behavior and Human Decision Processes, doi
  185. (1988). The social psychology of procedural justice, doi
  186. (1993). The structure of phenotypic personality traits. doi
  187. (2001). Thinking critically about Justice Judgments. doi
  188. (2005). Third-Party Reactions to Employee (Mis)Treatment: A Justice Perspective. doi
  189. (2001). Time: A new research lens. doi
  190. (2003). To Justify or Excuse?: A Meta-Analytic Review of the Effects of Explanations. doi
  191. (2005). Uncovering the ProblemSolving Process: Cues Retrospective Reporting Versus Concurrent and Retrospective Reporting. doi
  192. (2000). Understanding procedural justice and its impact on business organizations. doi
  193. (1994). Understanding Student Judgments of Teaching Effectiveness: A "Policy Capturing" doi
  194. (1996). Upon Reflection. Thinking and Reasoning, doi
  195. (1996). Using Multivariate Statistics, USA, HarperCollins College
  196. (1980). Validity of Information Display Boards: An Assessment Using Longitudinal Data. doi
  197. (2003). What constitutes fairness in work settings? A four-component model of procedural justice. doi
  198. (1988). What have we Learned about Human Judgment from Thirty Years of Policy Capturing? doi
  199. (2005). What is Organizational Justice? A historical Overview.
  200. (1990). What People Regard As Unjust: Types And Structures Of Everyday Experiences Of Injustice. doi
  201. (1980). What should be done with equity theory? doi
  202. (2009). What Types of Advice do Decision-Makers Prefer? Organizational Behavior and Human Decision Processes. doi
  203. (1995). When We Don't See Eye to Eye: Discrepancies Between Supervisors and Subordinates in Absence Disciplinary Decisions. doi
  204. (2006). Why do people care about procedural fairness? The importance of belongingness in responding and attending to procedures. doi
  205. (1985). Why We Are Fairer Than Others. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.