On the naturalness of software

Natural languages like English are rich, complex, and powerful. The highly creative and graceful use of languages like English and Tamil, by masters like Shakespeare and Avvaiyar, can certainly delight and inspire. But in practice, given cognitive constraints and the exigencies of daily life, most human utterances are far simpler and much more repetitive and predictable. In fact, these utterances can be very usefully modeled using modern statistical methods. This fact has led to the phenomenal success of statistical approaches to speech recognition, natural language translation, question-answering, and text mining and comprehension. We begin with the conjecture that most software is also natural, in the sense that it is created by humans at work, with all the attendant constraints and limitations---and thus, like natural language, it is also likely to be repetitive and predictable. We then proceed to ask whether (a) code can be usefully modeled by statistical language models and (b) such models can be leveraged to support software engineers. Using the widely adopted n-gram model, we provide empirical evidence supportive of a positive answer to both these questions. We show that code is also very regular, and, in fact, even more so than natural languages. As an example use of the model, we have developed a simple code completion engine for Java that, despite its simplicity, already improves Eclipse's completion capability. We conclude the paper by laying out a vision for future research in this area

Some approximation problems in the theory of stationary processes

AbstractIn this paper, necessary and sufficient conditions for the regularity of a general (multivariate) stationary process are obtained. These subsume all the known criteria of regularity for such processes

Cumulative weather effects can impact across the whole life cycle

Predicting how species will be affected by future climatic change requires the underlying environmental drivers to be identified. As vital rates vary over the lifecycle, structured population models derived from statistical environment-demography relationships are often used to inform such predictions. Environmental drivers are typically identified independently for different vital rates and demographic classes. However, these rates often exhibit positive temporal covariance, suggesting the vital rates respond to common environmental drivers. Additionally, models often only incorporate average weather conditions during a single, a priori chosen time window (e.g. monthly means). Mismatches between these windows and the period when the vital rates are sensitive to variation in climate decrease the predictive performance of such approaches. We used a demographic structural equation model (SEM) to demonstrate that a single axis of environmental variation drives the majority of the (co)variation in survival, reproduction, and twinning across six age-sex classes in a Soay sheep population. This axis provides a simple target for the complex task of identifying the drivers of vital rate variation. We used functional linear models (FLMs) to determine the critical windows of three local climatic drivers, allowing the magnitude and direction of the climate effects to differ over time. Previously unidentified lagged climatic effects were detected in this well-studied population. The FLMs had a better predictive performance than selecting a critical window a priori, but not than a large-scale climate index. Positive covariance amongst vital rates and temporal variation in the effects of environmental drivers are common, suggesting our SEM-FLM approach is a widely applicable tool for exploring the joint responses of vital rates to environmental change

Relational trauma and its impact on late-adopted children

This paper describes work with two children, placed for late adoption who have suffered relational trauma. The paper explores the long-term consequences of such trauma, which includes problems with affect regulation, difficulties in generalising from one experience to another and shifts between phantasies of omnipotent control and sudden helplessness. Using drawings from one boy's therapy, it is argued that many children adopted at a later age live in two worlds, both internal and external, and internal objects and memories from the past vie with new experiences and representations for ascendancy within the child's mind. Which is more real: the world of the past or the present? The paper describes how these children experienced sudden and troubling shifts in focus as they were catapulted from feeling states belonging to one world to the other. The paper ends with a consideration of how findings from neuroscience may help us to understand these sudden shifts and overall argues for a pulling together of psychoanalytic thinking and child development research findings to support the child in psychotherapy

Castratie van biggen met CO2 /O2-verdoving = Castration of piglets using CO2 /O2-anaesthesia

In this study the safety was investigated of the use of carbon dioxide anaesthesia during castration of piglets. In addition, the technical and practical criteria were determined for anaesthetic devices that can be used by a farme

A response to the House of Commons Education Committee report on Multi-Academy Trusts

The number of schools joining multi-academy trusts has grown over the last five years, and it is expected that this growth will continue. The House of Commons Education Committee has, as a result, looked into the performance and role of these trusts. Steven J Courtney, Ruth McGinity, Steven Jones, Robert Hindle, Stephen M Rayner and Belinda Hughes focus on four key aspects of the Committee’s report and argue that broader questions about the government’s policy remain untouched

AIGO: towards a unified framework for the analysis and the inter-comparison of GO functional annotations

BACKGROUND: In response to the rapid growth of available genome sequences, efforts have been made to develop automatic inference methods to functionally characterize them. Pipelines that infer functional annotation are now routinely used to produce new annotations at a genome scale and for a broad variety of species. These pipelines differ widely in their inference algorithms, confidence thresholds and data sources for reasoning. This heterogeneity makes a comparison of the relative merits of each approach extremely complex. The evaluation of the quality of the resultant annotations is also challenging given there is often no existing gold-standard against which to evaluate precision and recall. RESULTS: In this paper, we present a pragmatic approach to the study of functional annotations. An ensemble of 12 metrics, describing various aspects of functional annotations, is defined and implemented in a unified framework, which facilitates their systematic analysis and inter-comparison. The use of this framework is demonstrated on three illustrative examples: analysing the outputs of state-of-the-art inference pipelines, comparing electronic versus manual annotation methods, and monitoring the evolution of publicly available functional annotations. The framework is part of the AIGO library (http://code.google.com/p/aigo) for the Analysis and the Inter-comparison of the products of Gene Ontology (GO) annotation pipelines. The AIGO library also provides functionalities to easily load, analyse, manipulate and compare functional annotations and also to plot and export the results of the analysis in various formats. CONCLUSIONS: This work is a step toward developing a unified framework for the systematic study of GO functional annotations. This framework has been designed so that new metrics on GO functional annotations can be added in a very straightforward way