Multimodal Explanations: Justifying Decisions and Pointing to the Evidence

Deep models that are both effective and explainable are desirable in many settings; prior explainable models have been unimodal, offering either image-based visualization of attention weights or text-based generation of post-hoc justifications. We propose a multimodal approach to explanation, and argue that the two modalities provide complementary explanatory strengths. We collect two new datasets to define and evaluate this task, and propose a novel model which can provide joint textual rationale generation and attention visualization. Our datasets define visual and textual justifications of a classification decision for activity recognition tasks (ACT-X) and for visual question answering tasks (VQA-X). We quantitatively show that training with the textual explanations not only yields better textual justification models, but also better localizes the evidence that supports the decision. We also qualitatively show cases where visual explanation is more insightful than textual explanation, and vice versa, supporting our thesis that multimodal explanation models offer significant benefits over unimodal approaches.Comment: arXiv admin note: text overlap with arXiv:1612.0475

“Wandering and Wondering”: Theory and Representation in Feminist Physical Cultural Studies

In this paper we explore the potential of physical cultural studies for collaborative, interdisciplinary, theoretically-informed, reflexive research on the physically active female body. We use the metaphors of "wandering and wondering" to interrogate our experiences of movement within and across physical cultural fields and academic borders. Grounded in an ethnographic narrative approach, we revisit the ways in which different aspects of our identities were highlighted during our waka ama, snowboarding and basketball experiences. Drawing upon feminist readings of Bourdieu’s work, we challenged each other to reflect critically upon previously unquestioned or unexplored aspects of our subjectivities. While the paper focuses on the results of these discussions, we also offer insights into the collaborative process. Ultimately we argue that sharing narratives of our experiences and exploring them further with theory offers a good place to begin new interdisciplinary conversations that may push physical cultural studies research in new directions

ISBS 2018 AUCKLAND CONFERENCE SPRINZ-HPSNZ-AUT MILLENNIUM APPLIED PROGRAMME

An interactive afternoon of sessions delivered by High Performance Sport New Zealand (HPSNZ) and AUT SPRINZ Biomechanists, Performance Analysts and other biomechanics relevant sport facing practitioners. The 11 sessions are at AUT Millennium (AUTM), which is a satellite site of AUT University and the Auckland training hub for many HPSNZ supported sports such as athletics, sailing, and swimming. These sports and others (cycling, rowing, snow sports etc.) will be represented in the line-up. The applied sessions involve practical demonstrations of aspects of analysis and/or tools used to deliver in the field to directly positively impact athletes performances on the world stage. Following these engaging sessions there will be tasting of New Zealand wine, allowing for further discussion and networking. Sir Graeme Avery will be acknowledged for his contribution to sport science. Mike Stanley is AUT Millennium Chief Executive & NZ Olympic Committee President will explain the partners in the facility. AUT Millennium is a charitable trust established to help New Zealanders live longer and healthier lives, and to enjoy and excel in sport through the provision of world-class facilities, services, research and education. Founded in 2002 as Millennium Institute of Sport and Health (MISH) by Sir Stephen Tindall and Sir Graeme Avery as a premium health and fitness facility for both athletes and the public alike. Partnered with AUT University in 2009, forming AUT Millennium, to expand research and education in the sporting sector. Professor Barry Wilson is an Adjunct Professor with SPRINZ at Auckland University of Technology and will be outlining the research and student opportunities. Martin Dowson is the General Manager Athlete Performance Support at High Performance Sport New Zealand and has overall responsibility for the programme. Simon Briscoe, AUT Millennium Applied Session Coordinator, is the head of the Performance and Technique Analysis discipline within HPSNZ. Simon is coordinating the applied sessions along with technical support from Dr Allan Carman, Research Fellow, AUT SPRINZ. Jodi Cossor and Matt Ingram will provide a demonstration of a multidisciplinary approach driven by biomechanical analysis for Paralympic swimmers. Justin Evans and Sarah-Kate Millar will provide a practical session assessing the athletes rowing stroke to assist the coach on technical changes. This session will demonstrate various rowing traits and how the biomechanist and coach can work together to optimise boat speed. Mike Schofield and Kim Hébert-Losier will provide a session looking at shotput and the evidence based approach to coaching. Dr Craig Harrison and Professor John Cronin will provide examples from the AUTM Athlete Development programme. Kim Simperingham and Jamie Douglas who work with high performance rugby athletes will outline sprinting mechanics in practice. Dr Bruce Hamilton, Fiona Mather, Justin Ralph and Rone Thompson will demonstrate the approach of HPSNZ and Cycling NZ performance health teams in the use of some specific tools for prevention of injury and optimisation of performance. Kelly Sheerin, Denny Wells and Associate Professor Thor Besier will provide examples of using IMU and motion capture methods for running and basketball biomechanics research, education and service. Dr Rodrigo Bini and Associate Professor Andrew Kilding will show how linking of biomechanics and physiology improves injury prevention and performance enhancement. Robert Tang, Andre de Jong and Farhan Tinwala discuss select projects developed by Goldmine, HPSNZ’s in-house engineering team, and how these innovations have enabled unprecedented levels of biomechanics feedback. Cameron Ross and Paul McAlpine demonstrate the technology being used at the Snow Sports NZ training centre in Cadrona to enhance load monitoring of athletes. This application allows greater insight into training performances and biomechanical loads than has been previously possible in the training environment. AUT Millennium tour guides are coordinated by Josh McGeown and include Enora Le Flao, Dustin Oranchuk, Erika Ikeda, Jono Neville, Aaron Uthoff, Andrew Pichardo, Farhan Tinwala, Shelley Diewald, Renata Bastos Gottgtroy, Jessica Yeoman, Casey Watkins, Eric Harbour, Anja Zoellner, Alyssa Joy Spence, Victor Lopez Jr, and Albert Chang

CENTRE OF MASS TRAJECTORY IN SNOWBOARD GIANT SLALOM USING INERTIAL SENSORS: LABORATORY AND IN-FIELD PRELIMINARY EVALUATION

The purpose of the present study was to evaluate the reconstruction accuracy of the centre of mass during snowboard giant slalom using inertial sensors (Opal, APDM, 128 Hz). Two approaches were implemented and tested: i) a multi-segment model using 7 inertial sensors on the trunk, the pelvis, the thighs, the shanks, and the board; and ii) a double integration of the acceleration at L5 level measured with one inertial sensor. The accuracy of the algorithms was verified in two laboratory conditions: a) the multi-segment model approach was tested indoor during controlled movements using stereo-photogrammetry as gold standard, and b) the double integration of acceleration approach was tested outdoor in simulated movements on a longboard using GPS as gold standard. Successively, to verify the application in real conditions, an in-field acquisition of a forerunner athlete during a snowboard world cup competition was performed. The position of the centre of mass estimated indoor with multi-segmental model approach reported in the local reference frame of the board showed high correlation with respect to stereo-photogrammetry (r=0.87) and a RMS error of 3.8 [%] expressed as percentage of the range of motion during the trial (1.32m). For the simulated movements test in outdoor conditions on the longboard applying the double integration approach, high correlation was found with respect to the GPS data (r=0.95) on the trajectory but , for the 4 turns trial, a RMS difference on the distance equal to 15.3 [%] expressed as percentage of the whole distance covered (46m). Finally, the in-field acquisition showed how using inertial sensors is a viable option for collecting centre of mass data during training session useful for coaches and athletes. The approach using one sensors at L5 level showed low level of accuracy with respect to the one using a multi-segment model. Further developments should be performed in the direction of a better estimation of the orientation of the inertial sensors and of the boundary conditions for the integration algorithm