User testing of an adaptation of fishbone diagrams to depict results of systematic reviews

Abstract Background Summary of findings tables in systematic reviews are highly informative but require epidemiological training to be interpreted correctly. The usage of fishbone diagrams as graphical displays could offer researchers an effective approach to simplify content for readers with limited epidemiological training. In this paper we demonstrate how fishbone diagrams can be applied to systematic reviews and present the results of an initial user testing. Methods Findings from two systematic reviews were graphically depicted in the form of the fishbone diagram. To test the utility of fishbone diagrams compared with summary of findings tables, we developed and pilot-tested an online survey using Qualtrics. Respondents were randomized to the fishbone diagram or a summary of findings table presenting the same body of evidence. They answered questions in both open-ended and closed-answer formats; all responses were anonymous. Measures of interest focused on first and second impressions, the ability to find and interpret critical information, as well as user experience with both displays. We asked respondents about the perceived utility of fishbone diagrams compared to summary of findings tables. We analyzed quantitative data by conducting t-tests and comparing descriptive statistics. Results Based on real world systematic reviews, we provide two different fishbone diagrams to show how they might be used to display complex information in a clear and succinct manner. User testing on 77 students with basic epidemiological training revealed that participants preferred summary of findings tables over fishbone diagrams. Significantly more participants liked the summary of findings table than the fishbone diagram (71.8% vs. 44.8%; p < .01); significantly more participants found the fishbone diagram confusing (63.2% vs. 35.9%, p < .05) or indicated that it was difficult to find information (65.8% vs. 45%; p < .01). However, more than half of the participants in both groups were unable to find critical information and answer three respective questions correctly (52.6% in the fishbone group; 51.3% in the summary of findings group). Conclusions Fishbone diagrams are compact visualizations that, theoretically, may prove useful for summarizing the findings of systematic reviews. Initial user testing, however, did not support the utility of such graphical displays

Communicative competence and institutional affiliation: interactional processes of identity construction by immigrant students in Catalonia

The growing presence of children of immigrant families in the public school system in the bilingual region of Catalonia provides us with an opportunity to study how young multilingual and multicultural speakers construct their social competencies and their identity within the specific context of a gate-keeping social institution such as the school. The study reported in this paper approaches language learning as a process of socialisation that involves not only learning how to make sense of linguistic signs but also learning how to enact different social roles in particular institutions. The analysis focuses on the interactional profiles of two immigrant students in two types of communicative activities that are representative of the school context: responding to questions from an adult and cooperating with a peer in the resolution of a learning task. By shifting the focus of analysis from a decontextualised notion of communicative competence to the notion of 'institutionally affiliated communicative competence' and concentrating on issues such as the (1) the relationship between knowledge and participation, (2) language choice inside and outside school and (3) definitions of correctness in language use, the study reveals how the two students construct a highly 'affiliated' identit

Sport for Yes? The role of sporting issues in pro-independence political discourse during the Scottish independence referendum campaign

This article critically considers the extent to which sporting issues were harnessed by pro-independence political campaigners during the Scottish independence referendum campaign. Developments such as the inclusion of sport within the Scottish Government’s White Paper on Scottish independence, the establishment of the ‘Working Group on Scottish Sport’ and the establishment of the ‘Sport for Yes’ campaign group demonstrate the harnessing of sporting issues as an additional, if somewhat peripheral, debate point in the referendum campaigns (Lafferty 2014, Scottish Government 2013, Working Group on Scottish Sport and Scottish Government 2013, 2014). The latter of these developments, the establishment of the ‘Sport for Yes’ campaign group, is of particular interest, offering evidence of the explicit political mobilisation of past and present athletes in support of the ‘Yes Scotland’ pro-independence campaign. The use of sport within pro-independence political discourse is therefore scrutinised, drawing upon the principles of critical discourse analysis to explore the ideological assumptions underpinning the discursive representation of sport in relation to Scottish independence

User testing of an adaptation of fishbone diagrams to depict results of systematic reviews

Abstract Background Summary of findings tables in systematic reviews are highly informative but require epidemiological training to be interpreted correctly. The usage of fishbone diagrams as graphical displays could offer researchers an effective approach to simplify content for readers with limited epidemiological training. In this paper we demonstrate how fishbone diagrams can be applied to systematic reviews and present the results of an initial user testing. Methods Findings from two systematic reviews were graphically depicted in the form of the fishbone diagram. To test the utility of fishbone diagrams compared with summary of findings tables, we developed and pilot-tested an online survey using Qualtrics. Respondents were randomized to the fishbone diagram or a summary of findings table presenting the same body of evidence. They answered questions in both open-ended and closed-answer formats; all responses were anonymous. Measures of interest focused on first and second impressions, the ability to find and interpret critical information, as well as user experience with both displays. We asked respondents about the perceived utility of fishbone diagrams compared to summary of findings tables. We analyzed quantitative data by conducting t-tests and comparing descriptive statistics. Results Based on real world systematic reviews, we provide two different fishbone diagrams to show how they might be used to display complex information in a clear and succinct manner. User testing on 77 students with basic epidemiological training revealed that participants preferred summary of findings tables over fishbone diagrams. Significantly more participants liked the summary of findings table than the fishbone diagram (71.8% vs. 44.8%; p < .01); significantly more participants found the fishbone diagram confusing (63.2% vs. 35.9%, p < .05) or indicated that it was difficult to find information (65.8% vs. 45%; p < .01). However, more than half of the participants in both groups were unable to find critical information and answer three respective questions correctly (52.6% in the fishbone group; 51.3% in the summary of findings group). Conclusions Fishbone diagrams are compact visualizations that, theoretically, may prove useful for summarizing the findings of systematic reviews. Initial user testing, however, did not support the utility of such graphical displays