Motifs in Temporal Networks

Networks are a fundamental tool for modeling complex systems in a variety of domains including social and communication networks as well as biology and neuroscience. Small subgraph patterns in networks, called network motifs, are crucial to understanding the structure and function of these systems. However, the role of network motifs in temporal networks, which contain many timestamped links between the nodes, is not yet well understood. Here we develop a notion of a temporal network motif as an elementary unit of temporal networks and provide a general methodology for counting such motifs. We define temporal network motifs as induced subgraphs on sequences of temporal edges, design fast algorithms for counting temporal motifs, and prove their runtime complexity. Our fast algorithms achieve up to 56.5x speedup compared to a baseline method. Furthermore, we use our algorithms to count temporal motifs in a variety of networks. Results show that networks from different domains have significantly different motif counts, whereas networks from the same domain tend to have similar motif counts. We also find that different motifs occur at different time scales, which provides further insights into structure and function of temporal networks

Lost in the Middle: How Language Models Use Long Contexts

While recent language models have the ability to take long contexts as input, relatively little is known about how well the language models use longer context. We analyze language model performance on two tasks that require identifying relevant information within their input contexts: multi-document question answering and key-value retrieval. We find that performance is often highest when relevant information occurs at the beginning or end of the input context, and significantly degrades when models must access relevant information in the middle of long contexts. Furthermore, performance substantially decreases as the input context grows longer, even for explicitly long-context models. Our analysis provides a better understanding of how language models use their input context and provides new evaluation protocols for future long-context models.Comment: 15 pages, 17 figure

Evaluating Human-Language Model Interaction

Many real-world applications of language models (LMs), such as writing assistance and code autocomplete, involve human-LM interaction. However, most benchmarks are non-interactive in that a model produces output without human involvement. To evaluate human-LM interaction, we develop a new framework, Human-AI Language-based Interaction Evaluation (HALIE), that defines the components of interactive systems and dimensions to consider when designing evaluation metrics. Compared to standard, non-interactive evaluation, HALIE captures (i) the interactive process, not only the final output; (ii) the first-person subjective experience, not just a third-party assessment; and (iii) notions of preference beyond quality (e.g., enjoyment and ownership). We then design five tasks to cover different forms of interaction: social dialogue, question answering, crossword puzzles, summarization, and metaphor generation. With four state-of-the-art LMs (three variants of OpenAI's GPT-3 and AI21 Labs' Jurassic-1), we find that better non-interactive performance does not always translate to better human-LM interaction. In particular, we highlight three cases where the results from non-interactive and interactive metrics diverge and underscore the importance of human-LM interaction for LM evaluation.Comment: Authored by the Center for Research on Foundation Models (CRFM) at the Stanford Institute for Human-Centered Artificial Intelligence (HAI

Reducing the environmental impact of surgery on a global scale: systematic review and co-prioritization with healthcare workers in 132 countries

Abstract Background Healthcare cannot achieve net-zero carbon without addressing operating theatres. The aim of this study was to prioritize feasible interventions to reduce the environmental impact of operating theatres. Methods This study adopted a four-phase Delphi consensus co-prioritization methodology. In phase 1, a systematic review of published interventions and global consultation of perioperative healthcare professionals were used to longlist interventions. In phase 2, iterative thematic analysis consolidated comparable interventions into a shortlist. In phase 3, the shortlist was co-prioritized based on patient and clinician views on acceptability, feasibility, and safety. In phase 4, ranked lists of interventions were presented by their relevance to high-income countries and low–middle-income countries. Results In phase 1, 43 interventions were identified, which had low uptake in practice according to 3042 professionals globally. In phase 2, a shortlist of 15 intervention domains was generated. In phase 3, interventions were deemed acceptable for more than 90 per cent of patients except for reducing general anaesthesia (84 per cent) and re-sterilization of ‘single-use’ consumables (86 per cent). In phase 4, the top three shortlisted interventions for high-income countries were: introducing recycling; reducing use of anaesthetic gases; and appropriate clinical waste processing. In phase 4, the top three shortlisted interventions for low–middle-income countries were: introducing reusable surgical devices; reducing use of consumables; and reducing the use of general anaesthesia. Conclusion This is a step toward environmentally sustainable operating environments with actionable interventions applicable to both high– and low–middle–income countries

Unsupervised Word Sense Disambiguation Using Markov Random Field and Dependency Parser

Word Sense Disambiguation is a difficult problem to solve in the unsupervised setting. This is because in this setting inference becomes more dependent on the interplay between different senses in the context due to unavailability of learning resources. Using two basic ideas, sense dependency and selective dependency, we model the WSD problem as a Maximum A Posteriori (MAP) Inference Query on a Markov Random Field (MRF) built using WordNet and Link Parser or Stanford Parser. To the best of our knowledge this combination of dependency and MRF is novel, and our graph-based unsupervised WSD system beats state-of-the-art system on SensEval-2, SensEval-3 and SemEval-2007 English all-words datasets while being over 35 times faster

Networks beyond pairwise interactions: Structure and dynamics

The complexity of many biological, social and technological systems stems from the richness of the interactions among their units. Over the past decades, a great variety of complex systems has been successfully described as networks whose interacting pairs of nodes are connected by links. Yet, in face-to-face human communication, chemical reactions and ecological systems, interactions can occur in groups of three or more nodes and cannot be simply described just in terms of simple dyads. Until recently, little attention has been devoted to the higher-order architecture of real complex systems. However, a mounting body of evidence is showing that taking the higher-order structure of these systems into account can greatly enhance our modeling capacities and help us to understand and predict their emerging dynamical behaviors. Here, we present a complete overview of the emerging field of networks beyond pairwise interactions. We first discuss the methods to represent higher-order interactions and give a unified presentation of the different frameworks used to describe higher-order systems, highlighting the links between the existing concepts and representations. We review the measures designed to characterize the structure of these systems and the models proposed in the literature to generate synthetic structures, such as random and growing simplicial complexes, bipartite graphs and hypergraphs. We introduce and discuss the rapidly growing research on higher-order dynamical systems and on dynamical topology. We focus on novel emergent phenomena characterizing landmark dynamical processes, such as diffusion, spreading, synchronization and games, when extended beyond pairwise interactions. We elucidate the relations between higher-order topology and dynamical properties, and conclude with a summary of empirical applications, providing an outlook on current modeling and conceptual frontiers.Comment: Accepted for publication in Physics Reports. 109 pages, 47 figure

Effects of pre-operative isolation on postoperative pulmonary complications after elective surgery: an international prospective cohort study an international prospective cohort study

We aimed to determine the impact of pre-operative isolation on postoperative pulmonary complications after elective surgery during the global SARS-CoV-2 pandemic. We performed an international prospective cohort study including patients undergoing elective surgery in October 2020. Isolation was defined as the period before surgery during which patients did not leave their house or receive visitors from outside their household. The primary outcome was postoperative pulmonary complications, adjusted in multivariable models for measured confounders. Pre-defined sub-group analyses were performed for the primary outcome. A total of 96,454 patients from 114 countries were included and overall, 26,948 (27.9%) patients isolated before surgery. Postoperative pulmonary complications were recorded in 1947 (2.0%) patients of which 227 (11.7%) were associated with SARS-CoV-2 infection. Patients who isolated pre-operatively were older, had more respiratory comorbidities and were more commonly from areas of high SARS-CoV-2 incidence and high-income countries. Although the overall rates of postoperative pulmonary complications were similar in those that isolated and those that did not (2.1% vs 2.0%, respectively), isolation was associated with higher rates of postoperative pulmonary complications after adjustment (adjusted OR 1.20, 95%CI 1.05–1.36, p = 0.005). Sensitivity analyses revealed no further differences when patients were categorised by: pre-operative testing; use of COVID-19-free pathways; or community SARS-CoV-2 prevalence. The rate of postoperative pulmonary complications increased with periods of isolation longer than 3 days, with an OR (95%CI) at 4–7 days or ≥ 8 days of 1.25 (1.04–1.48), p = 0.015 and 1.31 (1.11–1.55), p = 0.001, respectively. Isolation before elective surgery might be associated with a small but clinically important increased risk of postoperative pulmonary complications. Longer periods of isolation showed no reduction in the risk of postoperative pulmonary complications. These findings have significant implications for global provision of elective surgical care. We aimed to determine the impact of pre-operative isolation on postoperative pulmonary complications after elective surgery during the global SARS-CoV-2 pandemic. We performed an international prospective cohort study including patients undergoing elective surgery in October 2020. Isolation was defined as the period before surgery during which patients did not leave their house or receive visitors from outside their household. The primary outcome was postoperative pulmonary complications, adjusted in multivariable models for measured confounders. Pre-defined sub-group analyses were performed for the primary outcome. A total of 96,454 patients from 114 countries were included and overall, 26,948 (27.9%) patients isolated before surgery. Postoperative pulmonary complications were recorded in 1947 (2.0%) patients of which 227 (11.7%) were associated with SARS-CoV-2 infection. Patients who isolated pre-operatively were older, had more respiratory comorbidities and were more commonly from areas of high SARS-CoV-2 incidence and high-income countries. Although the overall rates of postoperative pulmonary complications were similar in those that isolated and those that did not (2.1% vs 2.0%, respectively), isolation was associated with higher rates of postoperative pulmonary complications after adjustment (adjusted OR 1.20, 95%CI 1.05–1.36, p = 0.005). Sensitivity analyses revealed no further differences when patients were categorised by: pre-operative testing; use of COVID-19-free pathways; or community SARS-CoV-2 prevalence. The rate of postoperative pulmonary complications increased with periods of isolation longer than 3 days, with an OR (95%CI) at 4–7 days or ≥ 8 days of 1.25 (1.04–1.48), p = 0.015 and 1.31 (1.11–1.55), p = 0.001, respectively. Isolation before elective surgery might be associated with a small but clinically important increased risk of postoperative pulmonary complications. Longer periods of isolation showed no reduction in the risk of postoperative pulmonary complications. These findings have significant implications for global provision of elective surgical care