Digital Image Access & Retrieval

The 33th Annual Clinic on Library Applications of Data Processing, held at the University of Illinois at Urbana-Champaign in March of 1996, addressed the theme of "Digital Image Access & Retrieval." The papers from this conference cover a wide range of topics concerning digital imaging technology for visual resource collections. Papers covered three general areas: (1) systems, planning, and implementation; (2) automatic and semi-automatic indexing; and (3) preservation with the bulk of the conference focusing on indexing and retrieval.published or submitted for publicatio

Emergency Stroke Calls: Obtaining Rapid Telephone Triage (ESCORTT) - a programme of research to facilitate recognition of stroke by emergency medical dispatchers

Background: Rapid access to emergency stroke care can reduce death and disability by enabling immediate provision of interventions such as thrombolysis, physiological monitoring and stabilisation. One of the ways that access to services can be facilitated is through emergency medical service (EMS)dispatchers. The sensitivity of EMS dispatchers for identifying stroke is < 50%. Studies have shown that activation of the EMSs is the single most important factor in the rapid triage and treatment of acute stroke patients. Objectives: To facilitate recognition of stroke by emergency medical dispatchers (EMDs). Design: An eight-phase mixed-methods study. Phase 1: a retrospective cohort study exploring stroke diagnosis. Phase 2: semi-structured interviews exploring public and EMS interactions. Phases 3 and 4: a content analysis of 999 calls exploring the interaction between the public and EMDs. Phases 5–7: development and implementation of stroke-specific online training (based on phases 1–4). Phase 8: an interrupted time series exploring the impact of the online training. Setting: One ambulance service and four hospitals. Participants: Patients arriving at hospital by ambulance with stroke suspected somewhere on the stroke pathway (phases 1 and 8). Patients arriving at hospital by ambulance with a final diagnosis of stroke (phase 2). Calls to the EMSs relating to phase 1 patients (phases 3 and 4). EMDs (phase 7). Interventions: Stroke-specific online training package, designed to improve recognition of stroke for EMDs. Main outcome measures: Phase 1: symptoms indicative of a final and dispatch diagnosis of stroke. Phase 2: factors involved in the decision to call the EMSs when stroke is suspected. Phases 3 and 4: keywords used by the public when describing stroke and non-stroke symptoms to EMDs. Phase 8: proportion of patients with a final diagnosis of stroke correctly dispatched as stroke by EMDs. Results: Phase 1: for patients with a final diagnosis of stroke, facial weakness and speech problems were significantly associated with an EMD code of stroke. Phase 2: four factors were identified – perceived seriousness; seeking and receiving lay or professional advice; caller’s description of symptoms and emotional response to symptoms. Phases 3 and 4: mention of ‘stroke’ or one or more Face Arm Speech Test (FAST) items is much more common in stroke compared with non-stroke calls. Consciousness level was often difficult for callers to determine and/or communicate. Phase 8: there was a significant difference (p = 0.003) in proportions correctly dispatched as stroke – before the training was implemented 58 out of 92 (63%); during implementation of training 42 out of 48 (88%); and after training implemented 47 out of 59 (80%). Conclusions: EMDs should be aware that callers are likely to describe loss of function (e.g. unable to grip) rather than symptoms (e.g. weakness) and that callers using the word ‘stroke’ or describing facial weakness, limb weakness or speech problems are likely to be calling about a stroke. Ambiguities and contradictions in dialogue about consciousness level arise during ambulance calls for suspected and confirmed stroke. The online training package improved recognition of stroke by EMDs. Recommendations for future research include testing the effectiveness of the Emergency Stroke Calls: Obtaining Rapid Telephone Triage (ESCORTT) training package on the recognition of stroke across other EMSs in England; and exploring the impact of the early identification of stroke by call handlers on patient and process outcomes. Funding: The National Institute for Health Research Programme Grants for Applied Research programme

CHORUS Deliverable 2.1: State of the Art on Multimedia Search Engines

Based on the information provided by European projects and national initiatives related to multimedia search as well as domains experts that participated in the CHORUS Think-thanks and workshops, this document reports on the state of the art related to multimedia content search from, a technical, and socio-economic perspective. The technical perspective includes an up to date view on content based indexing and retrieval technologies, multimedia search in the context of mobile devices and peer-to-peer networks, and an overview of current evaluation and benchmark inititiatives to measure the performance of multimedia search engines. From a socio-economic perspective we inventorize the impact and legal consequences of these technical advances and point out future directions of research

An examination of automatic video retrieval technology on access to the contents of an historical video archive

Purpose – This paper aims to provide an initial understanding of the constraints that historical video collections pose to video retrieval technology and the potential that online access offers to both archive and users. Design/methodology/approach – A small and unique collection of videos on customs and folklore was used as a case study. Multiple methods were employed to investigate the effectiveness of technology and the modality of user access. Automatic keyframe extraction was tested on the visual content while the audio stream was used for automatic classification of speech and music clips. The user access (search vs browse) was assessed in a controlled user evaluation. A focus group and a survey provided insight on the actual use of the analogue archive. The results of these multiple studies were then compared and integrated (triangulation). Findings – The amateur material challenged automatic techniques for video and audio indexing, thus suggesting that the technology must be tested against the material before deciding on a digitisation strategy. Two user interaction modalities, browsing vs searching, were tested in a user evaluation. Results show users preferred searching, but browsing becomes essential when the search engine fails in matching query and indexed words. Browsing was also valued for serendipitous discovery; however the organisation of the archive was judged cryptic and therefore of limited use. This indicates that the categorisation of an online archive should be thought of in terms of users who might not understand the current classification. The focus group and the survey showed clearly the advantage of online access even when the quality of the video surrogate is poor. The evidence gathered suggests that the creation of a digital version of a video archive requires a rethinking of the collection in terms of the new medium: a new archive should be specially designed to exploit the potential that the digital medium offers. Similarly, users' needs have to be considered before designing the digital library interface, as needs are likely to be different from those imagined. Originality/value – This paper is the first attempt to understand the advantages offered and limitations held by video retrieval technology for small video archives like those often found in special collections

Speech recognition: The interpretation of training and using speech recognition software from the perspectives of postsecondary students with learning challenges

This study examined the utilization of speech recognition programs by five college students with learning difficulties. A qualitative approach was implemented over the course of two semesters, Fall 2003 and Spring 2004, to: (a) ascertain students\u27 perspectives on speech recognition, and (b) understand how students used speech recognition programs as a tool to meet the academic demands of postsecondary education. Data collection for this study included interviews, participant observations, field notes, videotape, and course assignments. This study provided qualitative data regarding an assistive technology tool that has traditionally been studied within a quantitative paradigm. Environment, individual characteristics, and life demands were found to impact student use of their speech recognition program. Implications for users, educational professionals, and researchers are presented in the final chapter of this paper

Audio-as-Data Tools: Replicating Computational Data Processing

The rise of audio-as-data in social science research accentuates a fundamental challenge: establishing reproducible and reliable methodologies to guide this emerging area of study. In this study, we focus on the reproducibility of audio-as-data preparation methods in computational communication research and evaluate the accuracy of popular audio-as-data tools. We analyze automated transcription and computational phonology tools applied to 200 episodes of conservative talk shows hosted by Rush Limbaugh and Alex Jones. Our findings reveal that the tools we tested are highly accurate. However, despite different transcription and audio signal processing tools yield similar results, subtle yet significant variations could impact the findings’ reproducibility. Specifically, we find that discrepancies in automated transcriptions and auditory features such as pitch and intensity underscore the need for meticulous reproduction of data preparation procedures. These insights into the variability introduced by different tools stress the importance of detailed methodological reporting and consistent processing techniques to ensure the replicability of research outcomes. Our study contributes to the broader discourse on replicability and reproducibility by highlighting the nuances of audio data preparation and advocating for more transparent and standardized practices in this area