On Semantic Similarity in Video Retrieval

Current video retrieval efforts all found their evaluation on an instance-based assumption, that only a single caption is relevant to a query video and vice versa. We demonstrate that this assumption results in performance comparisons often not indicative of models' retrieval capabilities. We propose a move to semantic similarity video retrieval, where (i) multiple videos/captions can be deemed equally relevant, and their relative ranking does not affect a method's reported performance and (ii) retrieved videos/captions are ranked by their similarity to a query. We propose several proxies to estimate semantic similarities in large-scale retrieval datasets, without additional annotations. Our analysis is performed on three commonly used video retrieval datasets (MSR-VTT, YouCook2 and EPIC-KITCHENS).Comment: Accepted in CVPR 2021. Project Page: https://mwray.github.io/SSVR

Rescaling Egocentric Vision:Collection Pipeline and Challenges for EPIC-KITCHENS-100

This paper introduces the pipeline to extend the largest dataset in egocentric vision, EPIC-KITCHENS. The effort culminates in EPIC-KITCHENS-100, a collection of 100 hours, 20M frames, 90K actions in 700 variable-length videos, capturing long-term unscripted activities in 45 environments, using head-mounted cameras. Compared to its previous version (Damen in Scaling egocentric vision: ECCV, 2018), EPIC-KITCHENS-100 has been annotated using a novel pipeline that allows denser (54% more actions per minute) and more complete annotations of fine-grained actions (+128% more action segments). This collection enables new challenges such as action detection and evaluating the “test of time”—i.e. whether models trained on data collected in 2018 can generalise to new footage collected two years later. The dataset is aligned with 6 challenges: action recognition (full and weak supervision), action detection, action anticipation, cross-modal retrieval (from captions), as well as unsupervised domain adaptation for action recognition. For each challenge, we define the task, provide baselines and evaluation metrics.Published versionResearch at Bristol is supported by Engineering and Physical Sciences Research Council (EPSRC) Doctoral Training Program (DTP), EPSRC Fellowship UMPIRE (EP/T004991/1). Research at Catania is sponsored by Piano della Ricerca 2016-2018 linea di Intervento 2 of DMI, by MISE - PON I&C 2014-2020, ENIGMA project (CUP: B61B19000520008) and by MIUR AIM - Attrazione e Mobilita Internazionale Linea 1 - AIM1893589 - CUP E64118002540007

Resuscitation with pre-hospital blood products in adults with trauma-related haemorrhagic shock:the RePHILL RCT

Background: The treatment of traumatic haemorrhagic shock has been transformed through better haemorrhage control, use of tranexamic acid and use of blood products. The improved survival seen from these strategies has stimulated an interest in pre-hospital transfusion.Objectives: To determine if the clinical effectiveness of resuscitation with red blood cells and lyophilised plasma was superior to 0.9% saline for improving tissue perfusion and reducing mortality in adults with haemorrhagic shock following major trauma.Design: A multi-centre, allocation concealed, open-label, parallel group, randomised controlled trial (with internal pilot).Setting: The trial was conducted in four civilian pre-hospital critical care services who operated within the National Health Service (NHS) England Major Trauma Networks.Participants: Adults (aged ≥16 years) who had sustained traumatic injuries, were attended by a pre-hospital emergency medical team and were hypotensive (systolic blood pressure &lt;90 mmHg or absence of radial pulse) as a consequence of traumatic haemorrhage were eligible for inclusion. The exclusion criteria were known or apparently &lt;16 years, blood administered on scene prior to the arrival of the RePHILL team, traumatic cardiac arrest where (1) the arrest occurred prior to arrival of the team and/or (2) the primary cause is not hypovolaemia, refusal of blood product administration, known Jehovah’s Witness, pregnancy, isolated head injury without evidence of external haemorrhage, prisoners in the custody of HM Prison and Probation Service.Interventions: Participants were randomised to receive up to either two units each of red blood cells and lyophilised plasma or up to 1 L 0.9% saline. Treatment was administered through the intravenous or intraosseous route.Main outcome measures: The primary outcome was a composite of episode mortality and/or impaired lactate clearance. The secondary outcomes included the individual components of the primary outcome.Results: From 6 December 2016 to 2 January 2021, pre-hospital medical teams randomised 432 participants to red blood cell/lyophilised plasma (n = 209) or 0.9% saline (n = 223) out of a target sample size of 490. Most participants were white (62%), males (82%), median age 38 (interquartile range 26 to 58), involved in a road traffic collision (62%) with severe injuries (median injury severity score 36, interquartile range 25 to 50). Prior to randomisation participants had received on average 430 ml crystalloid fluids and tranexamic acid (90%). The primary outcome occurred in 128/199 (64.3%) of participants randomised to red blood cell/lyophilised plasma and 136/210 (64.8%) randomised to 0.9% saline [adjusted risk difference –0.025% (95% confidence interval –9.0% to 9.0%), p = 0.996]. The event rates for the individual components of the primary outcome, episode mortality and lactate clearance were not statistically different between groups [adjusted average differences −3% (−12% to 7%); p = 0.57 and −5% (−14% to 5%), p = 0.33, respectively].Limitations: Recruitment stopped prematurely due to disruption caused by the COVID-19 pandemic.Future work: Identify the characteristics of patients who may benefit from pre-hospital blood products and whether alternative transfusion regimens are superior to standard care.Conclusions: The trial did not demonstrate that pre-hospital red blood cell/lyophilised plasma resuscitation was superior to 0.9% saline for trauma-related haemorrhagic shock.Trial registration: This trial is registered as ISRCTN62326938.Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Efficacy and Mechanism Evaluation Programme (NIHR award ref: 14/152/14) and is published in full in Efficacy and Mechanism Evaluation; Vol. 11, No. 2. See the NIHR Funding and Awards website for further award information.<br/

Abstracts from the NIHR INVOLVE Conference 2017

n/

The EPIC-KITCHENS Dataset:Collection, Challenges and Baselines

Since its introduction in 2018, EPIC-KITCHENS has attracted attention as the largest egocentric video benchmark, offering a unique viewpoint on people's interaction with objects, their attention, and even intention. In this paper, we detail how this large-scale dataset was captured by 32 participants in their native kitchen environments, and densely annotated with actions and object interactions. Our videos depict nonscripted daily activities, as recording is started every time a participant entered their kitchen. Recording took place in 4 countries by participants belonging to 10 different nationalities, resulting in highly diverse kitchen habits and cooking styles. Our dataset features 55 hours of video consisting of 11.5M frames, which we densely labelled for a total of 39.6K action segments and 454.2K object bounding boxes. Our annotation is unique in that we had the participants narrate their own videos after recording, thus reflecting true intention, and we crowd-sourced ground-truths based on these. We describe our object, action and. anticipation challenges, and evaluate several baselines over two test splits, seen and unseen kitchens. We introduce new baselines that highlight the multimodal nature of the dataset and the importance of explicit temporal modelling to discriminate fine-grained actions e.g. 'closing a tap' from 'opening' it up.Comment: Preprint for paper at IEEE TPAMI. arXiv admin note: substantial text overlap with arXiv:1804.0274

Resuscitation with blood products in patients with trauma-related haemorrhagic shock receiving prehospital care (RePHILL): a multicentre, open-label, randomised, controlled, phase 3 trial.

BACKGROUND Time to treatment matters in traumatic haemorrhage but the optimal prehospital use of blood in major trauma remains uncertain. We investigated whether use of packed red blood cells (PRBC) and lyophilised plasma (LyoPlas) was superior to use of 0·9% sodium chloride for improving tissue perfusion and reducing mortality in trauma-related haemorrhagic shock. METHODS Resuscitation with pre-hospital blood products (RePHILL) is a multicentre, allocation concealed, open-label, parallel group, randomised, controlled, phase 3 trial done in four civilian prehospital critical care services in the UK. Adults (age ≥16 years) with trauma-related haemorrhagic shock and hypotension (defined as systolic blood pressure <90 mm Hg or absence of palpable radial pulse) were assessed for eligibility by prehospital critial care teams. Eligible participants were randomly assigned to receive either up to two units each of PRBC and LyoPlas or up to 1 L of 0·9% sodium chloride administered through the intravenous or intraosseous route. Sealed treatment packs which were identical in external appearance, containing PRBC-LyoPlas or 0·9% sodium chloride were prepared by blood banks and issued to participating sites according to a randomisation schedule prepared by the co-ordinating centre (1:1 ratio, stratified by site). The primary outcome was a composite of episode mortality or impaired lactate clearance, or both, measured in the intention-to-treat population. This study is completed and registered with ISRCTN.com, ISRCTN62326938. FINDINGS From Nov 29, 2016 to Jan 2, 2021, prehospital critical care teams randomly assigned 432 participants to PRBC-LyoPlas (n=209) or to 0·9% sodium chloride (n=223). Trial recruitment was stopped before it achieved the intended sample size of 490 participants due to disruption caused by the COVID-19 pandemic. The median follow-up was 9 days (IQR 1 to 34) for participants in the PRBC-LyoPlas group and 7 days (0 to 31) for people in the 0·9% sodium chloride group. Participants were mostly white (62%) and male (82%), had a median age of 38 years (IQR 26 to 58), and were mostly involved in a road traffic collision (62%) with severe injuries (median injury severity score 36, IQR 25 to 50). Before randomisation, participants had received on average 430 mL crystalloid fluids and tranexamic acid (90%). The composite primary outcome occurred in 128 (64%) of 199 participants randomly assigned to PRBC-LyoPlas and 136 (65%) of 210 randomly assigned to 0·9% sodium chloride (adjusted risk difference -0·025% [95% CI -9·0 to 9·0], p=0·996). The rates of transfusion-related complications in the first 24 h after ED arrival were similar across treatment groups (PRBC-LyoPlas 11 [7%] of 148 compared with 0·9% sodium chloride nine [7%] of 137, adjusted relative risk 1·05 [95% CI 0·46-2·42]). Serious adverse events included acute respiratory distress syndrome in nine (6%) of 142 patients in the PRBC-LyoPlas group and three (2%) of 130 in 0·9% sodium chloride group, and two other unexpected serious adverse events, one in the PRBC-LyoPlas (cerebral infarct) and one in the 0·9% sodium chloride group (abnormal liver function test). There were no treatment-related deaths. INTERPRETATION The trial did not show that prehospital PRBC-LyoPlas resuscitation was superior to 0·9% sodium chloride for adult patients with trauma related haemorrhagic shock. Further research is required to identify the characteristics of patients who might benefit from prehospital transfusion and to identify the optimal outcomes for transfusion trials in major trauma. The decision to commit to routine prehospital transfusion will require careful consideration by all stakeholders. FUNDING National Institute for Health Research Efficacy and Mechanism Evaluation