19 research outputs found
Appendix 15 all-users-results
No full textline Appendix 15. Combined results for all users. Details for Figure 3
Appendix 16 joint-predicted-difficulty
No full textOnline Appendix 16. Joint predicted difficulty. Predicted and Observed difficulty of each character based on a linear model fit to all of the character score data. Details for Figure 5
Appendix 3 Anemones-character-taxon-results
No full textOnline Appendix 3. Sea anemones character scores. For each character and taxon in the anemones matrix, we show the probability (âEstimateâ) that a crowd memberâs score would agree with the majority vote of the crowd. We also show the lower confidence interval on this probability (ci.lower), which is the crowd confidence score. Finally, we indicate whether the majority vote was correct, and compute an ROC curve for the crowdâs scores. The Threshold Plot worksheet provides a visualization of this information
Appendix 1 - List of six matrices developed for this study.
No full textOnline Appendix 1. List of six matrices developed for this study, including character names, types of characters, and assessment of character difficulty by experts. See also Morphobank (www.morphobank.org) projects P950, P2463, P2502, P2490, P2491, and P2577
Appendix 20 Instructions to Crowd
No full textOnline Appendix 20. Instruction sheets for the study participants (undergraduate students at Ohio State University)
Appendix 4 Anemones-user-results
No full textOnline Appendix 4. Sea anemones user scores. For each crowd member, we report the number of scores they provided and the number that were correct. The âEstimateâ column is the probability that this crowd member voted correctly, and the âci.lowerâ column gives the 95% lower confidence bound on this probability. These scores are for all characters (evaluation and test)
