Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Evaluating Preschoolers\u27 Comprehension of Educational Television: The Role of Viewer Characteristics, Stimuli Features, and Contextual Expectations

This study represents the first experimental investigation to simultaneously evaluate the impact of three key areas of a child’s television viewing experience—individual differences (story schema), the stimulus (narrative type), and the environment (perceived demand characteristics). Guided by the capacity model (Fisch, 2000, 2004), preschoolers’ comprehension of an educational television program was evaluated in a 2 (story schema: low, high) x 2 (perceived demand characteristics: fun (low), learning (high)) x 2 (narrative type: participatory cues absent, participatory cues present) between-subjects fully crossed factorial experiment. Comprehension was operationalized as both narrative (i.e. central, incidental, and inferential comprehension) and educational content comprehension. A total of 172 preschoolers (102 females) participated in the study (Mean Age = 4.2 years). Children were randomly assigned to one of four conditions created by crossing the perceived demand characteristic manipulation with the narrative type manipulation. Story schema level was assigned through a median-split procedure based on story schema scores. In addition to program comprehension, data was collected on expressive vocabulary, story schema skills, program familiarity, and engagement with and attention to stimuli. Advanced story schema supported narrative comprehension, and this reduction in narrative processing demands translated to educational content comprehension. Children’s television programmers are advised to design educational television content which conforms to a prototypical story structure while integrating educational content within the narrative. Additionally, while children seemed able to devote greater attention to content when asked to “watch to learn”, they appeared to struggle with how to differentially distribute this attention, resulting in minimally enhanced inferential processing and no additional benefits to educational content comprehension. Finally, the inclusion of participatory cues in children’s television programming was not sufficient to support comprehension. Rather, it seems that engagement with participatory cues is necessary to support comprehension—particularly for children with low story schema and children viewing “for fun”. When integrating the findings for perceived demand characteristics and narrative type, children’s television programmers are advised to use participatory cues strategically to highlight educational content

Content and person effects in media research: Studying differences in cognitive, emotional, and arousal responses to media content

Cognitive, emotional, and arousal responses to media content stem from two sources of variation: differences in content and differences between individuals. Although the first source of variation (content effects) has been well-studied, individual differences (person effects) in responses to media are investigated much less within communication science. To help build this comparatively thin area of scholarship, this study investigated how four theoretically relevant variables (need for cognition, affective empathy, sensation seeking, and sensory processing sensitivity) affected responses to positively and negatively valenced media entertainment. In a withinsubjects design, 243 youth aged 7–15 years (49.4% female) responded to a positive and negative film clip using both selfreported and physiological measures (heart rate and skin conductance), while parents reported on individual differences. Multilevel analysis was used to distinguish between media content effects and individual differences in responses. Results showed that more variation in responses was due to differences between participants than to differences between stimuli. However, need for cognition, affective empathy, sensation seeking, and sensory processing sensitivity did not significantly explain this between-participant variation in responses. Several conceptual and methodological take-aways are offered to advance our understanding of the relationships between stable individual differences and state responses to media

Content and person effects in media research: Studying differences in cognitive, emotional, and arousal responses to media content

Cognitive, emotional, and arousal responses to media content stem from two sources of variation: differences in content and differences between individuals. Although the first source of variation (content effects) has been well-studied, individual differences (person effects) in responses to media are investigated much less within communication science. To help build this comparatively thin area of scholarship, this study investigated how four theoretically relevant variables (need for cognition, affective empathy, sensation seeking, and sensory processing sensitivity) affected responses to positively and negatively valenced media entertainment. In a withinsubjects design, 243 youth aged 7–15 years (49.4% female) responded to a positive and negative film clip using both selfreported and physiological measures (heart rate and skin conductance), while parents reported on individual differences. Multilevel analysis was used to distinguish between media content effects and individual differences in responses. Results showed that more variation in responses was due to differences between participants than to differences between stimuli. However, need for cognition, affective empathy, sensation seeking, and sensory processing sensitivity did not significantly explain this between-participant variation in responses. Several conceptual and methodological take-aways are offered to advance our understanding of the relationships between stable individual differences and state responses to media

Child’s Play? Assessing the Bidirectional Longitudinal Relationship between Gaming and Intelligence in Early Childhood

This study investigated the longitudinal relationship between children’s digital game use and fluid and crystallized intelligence. Specifically, this study examined whether digital games affect children’s fluid and crystallized intelligence (an effects perspective), whether children with higher levels of fluid or crystallized intelligence are more attracted to digital games (a selection perspective), or whether evidence supports a reciprocal relationship between digital game play and intelligence. Using data from 934 children aged 3 to 7 years (52% girls) across four waves with one-year intervals, our evidence for fluid intelligence indicates partial support for the effects perspective and no support for the selection perspective. For crystallized intelligence, our findings did not reveal any significant relationship with digital game use. The results suggest that digital games can move the needle for fluid intelligence, but more insight is needed to identify how this effect occurs, in which situations, and for which children this is most likely

Screen media use and ADHD-related behaviors: Four decades of research

The diagnosis of attention-deficit/hyperactivity disorder (ADHD) among children and adolescents has increased considerably over the past decades. Scholars and health professionals alike have expressed concern about the role of screen media in the rise in ADHD diagnosis. However, the extent to which screen media use and ADHD are linked remains a point of debate. To understand the current state of the field and, ultimately, move the field forward, we provide a systematic review of the literature on the relationship between children and adolescents' screen media use and ADHD-related behaviors (i.e., attention problems, hyperactivity, and impulsivity). Using the Differential Susceptibility to Media effects Model as a theoretical lens, we systematically organize the existing literature, identify potential shortcomings in this literature, and provide directions for future research. The available evidence suggests a statistically small relationship between media and ADHD-related behaviors. Evidence also suggests that individual child differences, such as gender and trait aggression, may moderate this relationship. There is a clear need for future research that investigates causality, underlying mechanisms, and differential susceptibility to the effects of screen media use on ADHD-related behaviors. It is only through a richer empirical body that we will be able to fully understand the media-ADHD relationship.status: publishe

The longitudinal relationship between media violence and empathy : Was it sympathy all along?

Previous research with adolescents has reported a negative relationship between media violence and empathy. There are, however, two important conceptual issues in this earlier literature that deserve further research attention. First, studies often treat empathy as a one-dimensional construct while it consists of both an affective and cognitive component. Second, while aiming to measure empathy, several studies have measured sympathy instead. Driven by these concerns, this study was designed to investigate the longitudinal relationship between media violence, affective empathy, cognitive empathy and sympathy. Using data from a two-wave panel study with 943 adolescents (10-14 years old), a cross-lagged model tested whether media violence exposure negatively influences empathy and sympathy (desensitization) or whether empathy and sympathy negatively influence media violence exposure (selection). Results were in line with desensitization. However, rather than showing that media violence leads to a decrease in empathy (which previous studies have shown), results indicate a decrease in sympathy instead. These findings provide clarification to existing work as well as offer methodological and practical implications