Improving Usability of Social and Behavioral Sciences’ Evidence: A Call to Action for a National Infrastructure Project for Mining Our Knowledge

Over the last century, the social and behavioral sciences have accumulated a vast storehouse of knowledge with the potential to transform society and all its constituents. Unfortunately, this knowledge has accumulated in a form (e.g., journal papers) and scale that makes it extremely difficult to search, categorize, analyze, and integrate across studies. In this commentary based on a National Science Foundation-funded workshop, we describe the social and behavioral sciences’ knowledge-management problem. We discuss the knowledge-scale problem and how we lack a common language, a common format to represent knowledge, a means to analyze and summarize in an automated way, and approaches to visualize knowledge at a large scale. We then describe that we need a collaborative research program between information systems, information science, and computer science (IICS) researchers and social and behavioral science (SBS) researchers to develop information system artifacts to address the problem that many scientific disciplines share but that the social and behavioral sciences have uniquely not addressed

Behavior change interventions: the potential of ontologies for advancing science and practice

A central goal of behavioral medicine is the creation of evidence-based interventions for promoting behavior change. Scientific knowledge about behavior change could be more effectively accumulated using "ontologies." In information science, an ontology is a systematic method for articulating a "controlled vocabulary" of agreed-upon terms and their inter-relationships. It involves three core elements: (1) a controlled vocabulary specifying and defining existing classes; (2) specification of the inter-relationships between classes; and (3) codification in a computer-readable format to enable knowledge generation, organization, reuse, integration, and analysis. This paper introduces ontologies, provides a review of current efforts to create ontologies related to behavior change interventions and suggests future work. This paper was written by behavioral medicine and information science experts and was developed in partnership between the Society of Behavioral Medicine's Technology Special Interest Group (SIG) and the Theories and Techniques of Behavior Change Interventions SIG. In recent years significant progress has been made in the foundational work needed to develop ontologies of behavior change. Ontologies of behavior change could facilitate a transformation of behavioral science from a field in which data from different experiments are siloed into one in which data across experiments could be compared and/or integrated. This could facilitate new approaches to hypothesis generation and knowledge discovery in behavioral science

Characterizing and predicting person-specific, day-to-day, fluctuations in walking behavior

Despite the positive health effect of physical activity, one third of the world's population is estimated to be insufficiently active. Prior research has mainly investigated physical activity on an aggregate level over short periods of time, e.g., during 3 to 7 days at baseline and a few months later, post-intervention. To develop effective interventions, we need a better understanding of the temporal dynamics of physical activity. We proposed here an approach to studying walking behavior at "high-resolution" and by capturing the idiographic and day-to-day changes in walking behavior. We analyzed daily step count among 151 young adults with overweight or obesity who had worn an accelerometer for an average of 226 days (~25,000 observations). We then used a recursive partitioning algorithm to characterize patterns of change, here sudden behavioral gains and losses, over the course of the study. These behavioral gains or losses were defined as a 30% increase or reduction in steps relative to each participants' median level of steps lasting at least 7 days. After the identification of gains and losses, fluctuation intensity in steps from each participant's individual time series was computed with a dynamic complexity algorithm to identify potential early warning signals of sudden gains or losses. Results revealed that walking behavior change exhibits discontinuous changes that can be described as sudden gains and losses. On average, participants experienced six sudden gains or losses over the study. We also observed a significant and positive association between critical fluctuations in walking behavior, a form of early warning signals, and the subsequent occurrence of sudden behavioral losses in the next days. Altogether, this study suggests that walking behavior could be well understood under a dynamic paradigm. Results also provide support for the development of "just-in-time adaptive" behavioral interventions based on the detection of early warning signals for sudden behavioral losses

Behavior change interventions: the potential of ontologies for advancing science and practice

A central goal of behavioral medicine is the creation of evidence-based interventions for promoting behavior change. Scientific knowledge about behavior change could be more effectively accumulated using "ontologies." In information science, an ontology is a systematic method for articulating a "controlled vocabulary" of agreed-upon terms and their inter-relationships. It involves three core elements: (1) a controlled vocabulary specifying and defining existing classes; (2) specification of the inter-relationships between classes; and (3) codification in a computer-readable format to enable knowledge generation, organization, reuse, integration, and analysis. This paper introduces ontologies, provides a review of current efforts to create ontologies related to behavior change interventions and suggests future work. This paper was written by behavioral medicine and information science experts and was developed in partnership between the Society of Behavioral Medicine's Technology Special Interest Group (SIG) and the Theories and Techniques of Behavior Change Interventions SIG. In recent years significant progress has been made in the foundational work needed to develop ontologies of behavior change. Ontologies of behavior change could facilitate a transformation of behavioral science from a field in which data from different experiments are siloed into one in which data across experiments could be compared and/or integrated. This could facilitate new approaches to hypothesis generation and knowledge discovery in behavioral science

Thinking Health-related Behaviors in a Climate Change Context:A Narrative Review

Background: Human activities have changed the environment so profoundly over the past two centuries that human-induced climate change is now posing serious health-related threats to current and future generations. Rapid action from all scientific fields, including behavioral medicine, is needed to contribute to both mitigation of, and adaption to, climate change.Purpose: This article aims to identify potential bi-directional associations between climate change impacts and health-related behaviors, as well as a set of key actions for the behavioral medicine community.Methods: We synthesized the existing literature about (i) the impacts of rising temperatures, extreme weather events, air pollution, and rising sea level on individual behaviors (e.g., eating behaviors, physical activity, sleep, substance use, and preventive care) as well as the structural factors related to these behaviors (e.g., the food system); and (ii) the concurrent positive and negative roles that health-related behaviors can play in mitigation and adaptation to climate change.Results: Based on this literature review, we propose a first conceptual model of climate change and health-related behavior feedback loops. Key actions are proposed, with particular consideration for health equity implications of future behavioral interventions. Actions to bridge the fields of behavioral medicine and climate sciences are also discussed.Conclusions: We contend that climate change is among the most urgent issues facing all scientists and should become a central priority for the behavioral medicine community.</p

Reliability and validity of three questionnaires measuring context-specific sedentary behaviour and associated correlates in adolescents, adults and older adults

BACKGROUND: Reliable and valid measures of total sedentary time, context-specific sedentary behaviour (SB) and its potential correlates are useful for the development of future interventions. The purpose was to examine test-retest reliability and criterion validity of three newly developed questionnaires on total sedentary time, context-specific SB and its potential correlates in adolescents, adults and older adults. METHODS: Reliability and validity was tested in six different samples of Flemish (Belgium) residents. For the reliability study, 20 adolescents, 22 adults and 20 older adults filled out the age-specific SB questionnaire twice. Test-retest reliability was analysed using Kappa coefficients, Intraclass Correlation Coefficients and/or percentage agreement, separately for the three age groups. For the validity study, data were retrieved from 62 adolescents, 33 adults and 33 older adults, with activPAL as criterion measure. Spearman correlations and Bland-Altman plots (or non-parametric approach) were used to analyse criterion validity, separately for the three age groups and for weekday, weekend day and average day. RESULTS: The test-retest reliability for self-reported total sedentary time indicated following values: ICC = 0.37-0.67 in adolescents; ICC = 0.73-0.77 in adults; ICC = 0.68-0.80 in older adults. Item-specific reliability results (e.g. context-specific SB and its potential correlates) showed good-to-excellent reliability in 67.94%, 68.90% and 66.38% of the items in adolescents, adults and older adults respectively. All items belonging to sedentary-related equipment and simultaneous SB showed good reliability. The sections of the questionnaire with lowest reliability were: context-specific SB (adolescents), potential correlates of computer use (adults) and potential correlates of motorized transport (older adults). Spearman correlations between self-reported total sedentary time and the activPAL were different for each age group: rho = 0.02-0.42 (adolescents), rho = 0.06-0.52 (adults), rho = 0.38-0.50 (older adults). Participants over-reported total sedentary time (except for weekend day in older adults) compared to the activPAL, for weekday, weekend day and average day respectively by +57.05%, +46.29%, +53.34% in adolescents; +40.40%, +19.15%, +32.89% in adults; +10.10%, -6.24%, +4.11% in older adults. CONCLUSIONS: The questionnaires showed acceptable test-retest reliability and criterion validity. However, over-reporting of total SB was noticeable in adolescents and adults. Nevertheless, these questionnaires will be useful in getting context-specific information on SB

Patients' and dermatologists' preferences in artificial intelligence–driven skin cancer diagnostics: a prospective multicentric survey study

To the Editor: Artificial intelligence (AI) has shown promise for improving diagnostics of skin cancer by matching or surpassing experienced clinicians.1 However, the successful clinical application depends on acceptance by patients and dermatologists. In this prospective multicentric survey study with a response rate of 63%, we therefore investigate the criteria required for patients and dermatologists to accept AI-systems and assess their importance on patients’ and dermatologists’ decision-making when considering the use of such systems. To this end, we perform an adaptive choice-based conjoint analysis and analyze it using hierarchical Bayes estimation.2 By employing an adaptive choice-based conjoint analysis, we investigate multiple influencing AI-features simultaneously (see Table I) whilst accounting for possible trade-offs (see Fig 1). For details on questionnaire development, participant recruitment, and statistical analysis, see Supplementary Methods, available via Mendeley at https://data.mendeley.com/datasets/2chcwnhpwj/1

Human-computer collaboration for skin cancer recognition

The rapid increase in telemedicine coupled with recent advances in diagnostic artificial intelligence (AI) create the imperative to consider the opportunities and risks of inserting AI-based support into new paradigms of care. Here we build on recent achievements in the accuracy of image-based AI for skin cancer diagnosis to address the effects of varied representations of AI-based support across different levels of clinical expertise and multiple clinical workflows. We find that good quality AI-based support of clinical decision-making improves diagnostic accuracy over that of either AI or physicians alone, and that the least experienced clinicians gain the most from AI-based support. We further find that AI-based multiclass probabilities outperformed content-based image retrieval (CBIR) representations of AI in the mobile technology environment, and AI-based support had utility in simulations of second opinions and of telemedicine triage. In addition to demonstrating the potential benefits associated with good quality AI in the hands of non-expert clinicians, we find that faulty AI can mislead the entire spectrum of clinicians, including experts. Lastly, we show that insights derived from AI class-activation maps can inform improvements in human diagnosis. Together, our approach and findings offer a framework for future studies across the spectrum of image-based diagnostics to improve human-computer collaboration in clinical practice

Development of a questionnaire to assess sedentary time in older persons -- a comparative study using accelerometry

Background: There is currently no validated questionnaire available to assess total sedentary time in older adults. Most studies only used TV viewing time as an indicator of sedentary time. The first aim of our study was to investigate the self-reported time spent by older persons on a set of sedentary activities, and to compare this with objective sedentary time measured by accelerometry. The second aim was to determine what set of self-reported sedentary activities should be used to validly rank people's total sedentary time. Finally we tested the reliability of our newly developed questionnaire using the best performing set of sedentary activities. Methods. The study sample included 83 men and women aged 65-92 y, a random sample of Longitudinal Aging Study Amsterdam participants, who completed a questionnaire including ten sedentary activities and wore an Actigraph GT3X accelerometer for 8 days. Spearman correlation coefficients were calculated to examine the association between self-reported time and objective sedentary time. The test-retest reliability was calculated using the intraclass correlation coefficient (ICC). Results: Mean total self-reported sedentary time was 10.4 (SD 3.5) h/d and was not significantly different from mean total objective sedentary time (10.2 (1.2) h/d, p = 0.63). Total self-reported sedentary time on an average day (sum of ten activities) correlated moderately (Spearman's r = 0.35, p < 0.01) with total objective sedentary time. The correlation improved when using the sum of six activities (r = 0.46, p < 0.01), and was much higher than when using TV watching only (r = 0.22, p = 0.05). The test-retest reliability of the sum of six sedentary activities was 0.71 (95% CI 0.57-0.81). Conclusions: A questionnaire including six sedentary activities was moderately associated with accelerometry-derived sedentary time and can be used to reliably rank sedentary time in older persons. © 2013 Visser and Koster; licensee BioMed Central Ltd