DNNShifter: An Efficient DNN Pruning System for Edge Computing

Deep neural networks (DNNs) underpin many machine learning applications. Production quality DNN models achieve high inference accuracy by training millions of DNN parameters which has a significant resource footprint. This presents a challenge for resources operating at the extreme edge of the network, such as mobile and embedded devices that have limited computational and memory resources. To address this, models are pruned to create lightweight, more suitable variants for these devices. Existing pruning methods are unable to provide similar quality models compared to their unpruned counterparts without significant time costs and overheads or are limited to offline use cases. Our work rapidly derives suitable model variants while maintaining the accuracy of the original model. The model variants can be swapped quickly when system and network conditions change to match workload demand. This paper presents DNNShifter, an end-to-end DNN training, spatial pruning, and model switching system that addresses the challenges mentioned above. At the heart of DNNShifter is a novel methodology that prunes sparse models using structured pruning. The pruned model variants generated by DNNShifter are smaller in size and thus faster than dense and sparse model predecessors, making them suitable for inference at the edge while retaining near similar accuracy as of the original dense model. DNNShifter generates a portfolio of model variants that can be swiftly interchanged depending on operational conditions. DNNShifter produces pruned model variants up to 93x faster than conventional training methods. Compared to sparse models, the pruned model variants are up to 5.14x smaller and have a 1.67x inference latency speedup, with no compromise to sparse model accuracy. In addition, DNNShifter has up to 11.9x lower overhead for switching models and up to 3.8x lower memory utilisation than existing approaches.Comment: 14 pages, 7 figures, 5 table

DNNShifter : an efficient DNN pruning system for edge computing

Funding: This research is funded by Rakuten Mobile, Japan .Deep neural networks (DNNs) underpin many machine learning applications. Production quality DNN models achieve high inference accuracy by training millions of DNN parameters which has a significant resource footprint. This presents a challenge for resources operating at the extreme edge of the network, such as mobile and embedded devices that have limited computational and memory resources. To address this, models are pruned to create lightweight, more suitable variants for these devices. Existing pruning methods are unable to provide similar quality models compared to their unpruned counterparts without significant time costs and overheads or are limited to offline use cases. Our work rapidly derives suitable model variants while maintaining the accuracy of the original model. The model variants can be swapped quickly when system and network conditions change to match workload demand. This paper presents DNNShifter  , an end-to-end DNN training, spatial pruning, and model switching system that addresses the challenges mentioned above. At the heart of DNNShifter  is a novel methodology that prunes sparse models using structured pruning - combining the accuracy-preserving benefits of unstructured pruning with runtime performance improvements of structured pruning. The pruned model variants generated by DNNShifter  are smaller in size and thus faster than dense and sparse model predecessors, making them suitable for inference at the edge while retaining near similar accuracy as of the original dense model. DNNShifter  generates a portfolio of model variants that can be swiftly interchanged depending on operational conditions. DNNShifter  produces pruned model variants up to 93x faster than conventional training methods. Compared to sparse models, the pruned model variants are up to 5.14x smaller and have a 1.67x inference latency speedup, with no compromise to sparse model accuracy. In addition, DNNShifter  has up to 11.9x lower overhead for switching models and up to 3.8x lower memory utilisation than existing approaches. DNNShifter  is available for public use from https://github.com/blessonvar/DNNShifter.Publisher PDFPeer reviewe

Positive youth development in swimming: clarification and consensus of key psychosocial assets

The purpose of this study was to gain a more cohesive understanding of the assets considered necessary to develop in young swimmers to ensure both individual and sport specific development. This two stage study involved (a) a content analysis of key papers to develop a list of both psychosocial skills for performance enhancement and assets associated with positive youth development, and (b) in-depth interviews involving ten expert swim coaches, practitioners and youth sport scholars. Five higher order categories containing seventeen individual assets emerged. These results are discussed in relation to both existing models of positive youth development and implications for coaches, practitioners and parents when considering the psychosocial development of young British swimmers

’You’re in this world now’: Students’, teachers’, and parents’ experiences of school transition and how they feel it can be improved.

BACKGROUND: Primary-secondary school transition is a major life event for 11-year-old children in the United Kingdom and can also be a stressful period for parents and teachers. However, most research focuses on the impact of transition on children’s academic performance and social well-being and we have a limited understanding of their emotional experiences in the lead up to and during the transition, from the perspective of key stakeholders: students, parents, and teachers. AIMS: To explore transfer students’, parents’, and teachers’ experiences in the lead up to and over the transition period, and how they feel it could be improved. SAMPLE: The sample consisted of 45 year seven students, 8 year seven parents, 8 year seven teachers, and 8 year six teachers, recruited from five primary and five secondary schools. METHOD: Students participated in face-to-face semi-structured focus groups and adults in asynchronous online focus groups. Transcribed audio-recordings were analysed using inductive thematic analysis. RESULTS: Students, parents, and teachers were shown to navigate a similar process over primary-secondary school transition. All talked about managing their own and others’ emotions, relationships, and expectations. These were shaped by shared communication across primary and secondary schools and between the stakeholders, and impacted by how good transition provision was seen to be. CONCLUSIONS: There is a need to understand the transition period from the perspective of students, teachers, and parents, to improve school transition. This information will allow us to design emotional centred support interventions that reflect these lived experiences

Anthropometric indices of Gambian children after one or three annual rounds of mass drug administration with azithromycin for trachoma control.

BACKGROUND: Mass drug administration (MDA) with azithromycin, carried out for the control of blinding trachoma, has been linked to reduced mortality in children. While the mechanism behind this reduction is unclear, it may be due, in part, to improved nutritional status via a potential reduction in the community burden of infectious disease. To determine whether MDA with azithromycin improves anthropometric indices at the community level, we measured the heights and weights of children aged 1 to 4 years in communities where one (single MDA arm) or three annual rounds (annual MDA arm) of azithromycin had been distributed. METHODS: Data collection took place three years after treatment in the single MDA arm and one year after the final round of treatment in the annual MDA arm. Mean height-for-age, weight-for-age and weight-for-height z scores were compared between treatment arms. RESULTS: No significant differences in mean height-for-age, weight-for-age or weight-for-height z scores were found between the annual MDA and single MDA arms, nor was there a significant reduction in prevalence of stunting, wasting or underweight between arms. CONCLUSIONS: Our data do not provide evidence that community MDA with azithromycin improved anthropometric outcomes of children in The Gambia. This may suggest reductions in mortality associated with azithromycin MDA are due to a mechanism other than improved nutritional status

Countries with Higher Levels of Gender Equality Show Larger National Sex Differences in Mathematics Anxiety and Relatively Lower Parental Mathematics Valuation for Girls.

Despite international advancements in gender equality across a variety of societal domains, the underrepresentation of girls and women in Science, Technology, Engineering, and Mathematics (STEM) related fields persists. In this study, we explored the possibility that the sex difference in mathematics anxiety contributes to this disparity. More specifically, we tested a number of predictions from the prominent gender stratification model, which is the leading psychological theory of cross-national patterns of sex differences in mathematics anxiety and performance. To this end, we analyzed data from 761,655 15-year old students across 68 nations who participated in the Programme for International Student Assessment (PISA). Most importantly and contra predictions, we showed that economically developed and more gender equal countries have a lower overall level of mathematics anxiety, and yet a larger national sex difference in mathematics anxiety relative to less developed countries. Further, although relatively more mothers work in STEM fields in more developed countries, these parents valued, on average, mathematical competence more in their sons than their daughters. The proportion of mothers working in STEM was unrelated to sex differences in mathematics anxiety or performance. We propose that the gender stratification model fails to account for these national patterns and that an alternative model is needed. In the discussion, we suggest how an interaction between socio-cultural values and sex-specific psychological traits can better explain these patterns. We also discuss implications for policies aiming to increase girls' STEM participation

Jaw Laterality and Related Handedness in the Hunting Behavior of a Scale-Eating Characin, Exodon paradoxus

BACKGROUND: Asymmetry in animal bodies and behavior has evolved several times, but our knowledge of their linkage is limited. Tanganyikan scale-eating cichlids have well-known antisymmetry in their bodies and behavior; individuals open their mouths leftward (righty) or rightward (lefty), and righties always attack the right flank of the prey, whereas lefties attack the left. This study analyzed the morphological asymmetry in a scale-eating characiform, Exodon paradoxus, and its behavioral handedness. METHODOLOGY/PRINCIPAL FINDINGS: Each eight E. paradoxus was observed for 1-h with a prey goldfish in an aquarium to detect the behavioral handedness. Following the experiment, the lateral differences in the mandibles and head-inclination of these eight and ten additional specimens were analyzed. Both measurements on the morphology showed a bimodal distribution, and the laterality identified by these two methods was always consistent within a given individual, indicating that the characin has morphological antisymmetry. Furthermore, this laterality significantly corresponded to behavioral handedness; that is, lefties more often rasped scales from the right flank of the prey and vice versa. However, the correlation between laterality and handedness is the opposite of that in the cichlids. This is due to differences in the feeding apparatus and technique. The characin has cuspids pointing forward on the external side of the premaxilla, and it thrusts its dominant body side outward from its body axis on the flank of the prey to tear off scales. By contrast, the cichlids draw their dominant body side inward toward the axis or rotate it to scrape or wrench off scales with the teeth lined in the opened mouth. CONCLUSIONS/SIGNIFICANCE: This study demonstrated that the antisymmetry in external morphology and the corresponding behavioral handedness have evolved in two lineages of scale-eating fishes independently, and these fishes adopt different utilization of their body asymmetry to tear off scales

Vision and visual history in elite-/near-elite level cricketers and rugby-league players

Background: The importance of optimal and/or superior vision for participation in high-level sport remains the subject of considerable clinical research interest. Here we examine the vision and visual history of elite/near-elite cricketers and rugby-league players. Methods: Stereoacuity (TNO), colour vision, and distance (with/without pinhole) and near visual acuity (VA) were measured in two cricket squads (elite/international-level, female, n=16; near-elite, male, n=23) and one professional rugby-league squad (male, n=20). Refractive error was determined, and details of any correction worn and visual history were recorded. Results: Overall, 63% had their last eye-examination within 2 years. However, some had not had an eye examination for 5 years, or had never had one (near-elite-cricketers: 30%; rugby-league players: 15%; elite-cricketers: 6%). Comparing our results for all participants to published data for young, optimally-corrected, non-sporting adults, distance VA was ~1 line of letters worse than expected. Adopting α=0.01, the deficit in distance-VA deficit was significant, but only for elite-cricketers (p0.02 for all comparisons). On average, stereoacuity was better than in young adults, but only in elite-cricketers (p<0.001; p=0.03, near-elite-cricketers; p=0.47, rugby-league -players). On-field visual issues were present in 27% of participants, and mostly (in 75% of cases) comprised uncorrected ametropia. Some cricketers (near-elite: 17.4%; elite: 38%) wore refractive correction during play but no rugby-league player did. Some individuals with prescribed correction choose not to wear it when playing. Conclusion: Aside from near stereoacuity in elite-cricketers, these basic visual abilities were not better than equivalent, published data for optimally-corrected adults. 20-25% exhibited sub-optimal vision, suggesting that the clearest possible vision might not be critical for participation at the highest levels in the sports of cricket or rugby-league. Although vision could be improved in a sizeable proportion of our sample, the impact of correcting these, mostly subtle, refractive anomalies on playing performance is unknown

A case study of the use of verbal reports for talent identification purposes in soccer: A Messi affair!

Using a two-study approach, the main purpose of this case study was to explore the use of a verbal reporting methodology to better understand the thought processes of soccer talent scouts during an in-situ talent identification environment. Study 1 developed a standardized coding-scheme to examine verbal cognitions during a single soccer game. Study 2 then utilized this methodology to examine two full-time recruitment staff trained in the use of concurrent verbal reporting before undertaking a live, in-game task. Participants also participated in a debrief interview following the game. The findings of the two studies suggest that developing a verbal reporting protocol is viable, however when applied in a live-game environment it is problematic. Future research should therefore consider a modified version of this task to further explore the cognitions of scouts whilst observing and identifying potential talent