Evaluation campaigns and TRECVid

The TREC Video Retrieval Evaluation (TRECVid) is an international benchmarking activity to encourage research in video information retrieval by providing a large test collection, uniform scoring procedures, and a forum for organizations interested in comparing their results. TRECVid completed its fifth annual cycle at the end of 2005 and in 2006 TRECVid will involve almost 70 research organizations, universities and other consortia. Throughout its existence, TRECVid has benchmarked both interactive and automatic/manual searching for shots from within a video corpus, automatic detection of a variety of semantic and low-level video features, shot boundary detection and the detection of story boundaries in broadcast TV news. This paper will give an introduction to information retrieval (IR) evaluation from both a user and a system perspective, highlighting that system evaluation is by far the most prevalent type of evaluation carried out. We also include a summary of TRECVid as an example of a system evaluation benchmarking campaign and this allows us to discuss whether such campaigns are a good thing or a bad thing. There are arguments for and against these campaigns and we present some of them in the paper concluding that on balance they have had a very positive impact on research progress

KidzPass:authenticating pre-literate children

Many online services require users to authenticate themselves to prove their identity. Text-based passwords are the most widely-used authentication mechanism. Yet a number of population groups struggle with text-based passwords. One of these groups is made up of children aged 3-5. This is an important sector of society, because many of these children use the Internet at home. This was especially true during the COVID-19 pandemic.Young children can struggle with text-based passwords due to their emerging literacy and immature development. The majority of children do not learn to read fluently until age seven. At age four or five, they generally do not have the required skills to create, retain and manage alphanumeric passwords. This might well leave young children vulnerable when online or impose unrealistic demands on their care givers who support them in authenticating themselves.Here, we report on the development and evaluation of two versions of KidzPass, a graphical authentication mechanism that specifically relies on the abilities 3-5 year old children can be expected to possess. We conclude by reporting on lessons learned about designing authentication for this target user group

Towards End-to-End Acoustic Localization using Deep Learning: from Audio Signal to Source Position Coordinates

This paper presents a novel approach for indoor acoustic source localization using microphone arrays and based on a Convolutional Neural Network (CNN). The proposed solution is, to the best of our knowledge, the first published work in which the CNN is designed to directly estimate the three dimensional position of an acoustic source, using the raw audio signal as the input information avoiding the use of hand crafted audio features. Given the limited amount of available localization data, we propose in this paper a training strategy based on two steps. We first train our network using semi-synthetic data, generated from close talk speech recordings, and where we simulate the time delays and distortion suffered in the signal that propagates from the source to the array of microphones. We then fine tune this network using a small amount of real data. Our experimental results show that this strategy is able to produce networks that significantly improve existing localization methods based on \textit{SRP-PHAT} strategies. In addition, our experiments show that our CNN method exhibits better resistance against varying gender of the speaker and different window sizes compared with the other methods.Comment: 18 pages, 3 figures, 8 table

Working Together for Children and Families: A Community Guide to Making the Most of Out-of-School Time

Outlines the MOST Initiative's approach to building a community-based, collaborative out-of-school time system in Boston, Chicago, and Seattle. Illustrates how each city interpreted the MOST process and provides a sampling of their activities

Innovative Teaching and Digital Literacy in Preschool. App Content Analysis and Experimental Case Studies in a Sociological Perspective

The objective of this article is to illustrate, from the theoretical and methodological perspective, the construction of an experimental process of a “digital education app” in several preschools in the municipality of Rome. The general objective the project fits into is related to a sociological analysis, based on the relationship between theory and empirical research, of the effects of introducing digital media into preschool didactics. Preschools are a privileged site for observing and analyzing the formation and development of children’s capabilities (Nussbaum, 2000), since the plasticity of the child’s thought begins to be configured as early as preschool and evolves progressively taking into account the perceptive, sociocultural and behavioural conditions emerging from different educational agencies (Piaget, Inhelder, 1950). The article refers to the research project of the Mediamonitor Minori Observatory of the Sapienza University of Rome entitled “Media Usage in Pre-school. Analysis and Evaluation of the Influence of Digital Media on the Socialization of Children between 0-6”. The article retraces in particular the stages of the research strategy designed to structure a formative, experimental protocol to be experimented in some case studies in Rome and illustrates the main results

Positioning Children’s Voice in Clinical Trials Research: A New Model for Planning, Collaboration, and Reflection

Following the United Nations Convention on the Rights of the Child, there has been considerable growth in research with children about health and services that affect them. Creative methods to engage with children have also been developed. One area where progress has been slower is the inclusion of children’s perspectives in qualitative research in the context of clinical trials or feasibility studies. Addressing this gap, this article discusses experiences of, and reflections on, the process of researching children’s views as part of a clinical feasibility study. The article considers what worked well and highlights remaining dilemmas. A new continuum of children’s engagement in research is presented, designed to assist researchers to make explicit the contingent demands on their research, and to suggest a range of techniques from within the broader fields of health, childhood studies, and education research that could be used to forward qualitative research in clinical contexts