AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks

Convolutional neural networks (CNNs) are trained using stochastic gradient descent (SGD)-based optimizers. Recently, the adaptive moment estimation (Adam) optimizer has become very popular due to its adaptive momentum, which tackles the dying gradient problem of SGD. Nevertheless, existing optimizers are still unable to exploit the optimization curvature information efficiently. This paper proposes a new AngularGrad optimizer that considers the behavior of the direction/angle of consecutive gradients. This is the first attempt in the literature to exploit the gradient angular information apart from its magnitude. The proposed AngularGrad generates a score to control the step size based on the gradient angular information of previous iterations. Thus, the optimization steps become smoother as a more accurate step size of immediate past gradients is captured through the angular information. Two variants of AngularGrad are developed based on the use of Tangent or Cosine functions for computing the gradient angular information. Theoretically, AngularGrad exhibits the same regret bound as Adam for convergence purposes. Nevertheless, extensive experiments conducted on benchmark data sets against state-of-the-art methods reveal a superior performance of AngularGrad. The source code will be made publicly available at: https://github.com/mhaut/AngularGrad

Memory systems in schizophrenia: Modularity is preserved but deficits are generalized

OBJECTIVE: Schizophrenia patients exhibit impaired working and episodic memory, but this may represent generalized impairment across memory modalities or performance deficits restricted to particular memory systems in subgroups of patients. Furthermore, it is unclear whether deficits are unique from those associated with other disorders. METHOD: Healthy controls (n=1101) and patients with schizophrenia (n=58), bipolar disorder (n=49) and attention-deficit-hyperactivity-disorder (n=46) performed 18 tasks addressing primarily verbal and spatial episodic and working memory. Effect sizes for group contrasts were compared across tasks and the consistency of subjects\u27 distributional positions across memory domains was measured. RESULTS: Schizophrenia patients performed poorly relative to the other groups on every test. While low to moderate correlation was found between memory domains (r=.320), supporting modularity of these systems, there was limited agreement between measures regarding each individual\u27s task performance (ICC=.292) and in identifying those individuals falling into the lowest quintile (kappa=0.259). A general ability factor accounted for nearly all of the group differences in performance and agreement across measures in classifying low performers. CONCLUSIONS: Pathophysiological processes involved in schizophrenia appear to act primarily on general abilities required in all tasks rather than on specific abilities within different memory domains and modalities. These effects represent a general shift in the overall distribution of general ability (i.e., each case functioning at a lower level than they would have if not for the illness), rather than presence of a generally low-performing subgroup of patients. There is little evidence that memory impairments in schizophrenia are shared with bipolar disorder and ADHD

Pilot Randomized Trial of Active Music Engagement Intervention Parent Delivery for Young Children With Cancer

Objectives: To examine the feasibility/acceptability of a parent-delivered Active Music Engagement (AME + P) intervention for young children with cancer and their parents. Secondary aim to explore changes in AME + P child emotional distress (facial affect) and parent emotional distress (mood; traumatic stress symptoms) relative to controls. Methods: A pilot two-group randomized trial was conducted with parents/children (ages 3-8 years) receiving AME + P ( n  =  9) or attention control ( n  =  7). Feasibility of parent delivery was assessed using a delivery checklist and child engagement; acceptability through parent interviews; preliminary outcomes at baseline, postintervention, 30 days postintervention. Results: Parent delivery was feasible, as they successfully delivered AME activities, but interviews indicated parent delivery was not acceptable to parents. Emotional distress was lower for AME + P children, but parents derived no benefit. Conclusions: Despite child benefit, findings do not support parent delivery of AME + P

Impact testing to determine the mechanical properties of articular cartilage in isolation and on bone

The original publication is available at www.springerlink.comNon peer reviewedPostprin

Use of controlled low dose gamma irradiation to sterilize allograft tendons for ACL reconstruction: biomechanical and clinical perspective

As reviewed here, numerous biomechanical and clinical studies support the use of controlled, low temperature irradiation of allograft tendons, to provide both excellent clinical results and medical-device grade sterile allografts with minimal risk of disease transmission

Osteochondral Grafting: Effect of Graft Alignment, Material Properties, and Articular Geometry

Osteochondral grafting for cartilage lesions is an attractive surgical procedure; however, the clinical results have not always been successful. Surgical recommendations differ with respect to donor site and graft placement technique. No clear biomechanical analysis of these surgical options has been reported. We hypothesized that differences in graft placement, graft biomechanical properties, and graft topography affect cartilage stresses and strains. A finite element model of articular cartilage and meniscus in a normal knee was constructed. The model was used to analyze the magnitude and the distribution of contact stresses, von Mises stresses, and compressive strains in the intact knee, after creation of an 8-mm diameter osteochondral defect, and after osteochondral grafting of the defect. The effects of graft placement, articular surface topography, and biomechanical properties were evaluated. The osteochondral defect generated minimal changes in peak contact stress (3.6 MPa) relative to the intact condition (3.4 MPa) but significantly increased peak von Mises stress (by 110%) and peak compressive strain (by 63%). A perfectly matched graft restored stresses and strains to near intact conditions. Leaving the graft proud by 0.5 mm generated the greatest increase in local stresses (peak contact stresses = 6.7 MPa). Reducing graft stiffness and curvature of articular surface had lesser effects on local stresses. Graft alignment, graft biomechanical properties, and graft topography all affected cartilage stresses and strains. Contact stresses, von Mises stresses, and compressive strains are biomechanical markers for potential tissue damage and cell death. Leaving the graft proud tends to jeopardize the graft by increasing the stresses and strains on the graft. From a biomechanical perspective, the ideal surgical procedure is a perfectly aligned graft with reasonably matched articular cartilage surface from a lower load-bearing region of the knee

Neuroanatomical heterogeneity and homogeneity in individuals at clinical high risk for psychosis

Individuals at Clinical High Risk for Psychosis (CHR-P) demonstrate heterogeneity in clinical profiles and outcome features. However, the extent of neuroanatomical heterogeneity in the CHR-P state is largely undetermined. We aimed to quantify the neuroanatomical heterogeneity in structural magnetic resonance imaging measures of cortical surface area (SA), cortical thickness (CT), subcortical volume (SV), and intracranial volume (ICV) in CHR-P individuals compared with healthy controls (HC), and in relation to subsequent transition to a first episode of psychosis. The ENIGMA CHR-P consortium applied a harmonised analysis to neuroimaging data across 29 international sites, including 1579 CHR-P individuals and 1243 HC, offering the largest pooled CHR-P neuroimaging dataset to date. Regional heterogeneity was indexed with the Variability Ratio (VR) and Coefficient of Variation (CV) ratio applied at the group level. Personalised estimates of heterogeneity of SA, CT and SV brain profiles were indexed with the novel Person-Based Similarity Index (PBSI), with two complementary applications. First, to assess the extent of within-diagnosis similarity or divergence of neuroanatomical profiles between individuals. Second, using a normative modelling approach, to assess the 'normativeness' of neuroanatomical profiles in individuals at CHR-P. CHR-P individuals demonstrated no greater regional heterogeneity after applying FDR corrections. However, PBSI scores indicated significantly greater neuroanatomical divergence in global SA, CT and SV profiles in CHR-P individuals compared with HC. Normative PBSI analysis identified 11 CHR-P individuals (0.70%) with marked deviation (>1.5?SD) in SA, 118 (7.47%) in CT and 161 (10.20%) in SV. Psychosis transition was not significantly associated with any measure of heterogeneity. Overall, our examination of neuroanatomical heterogeneity within the CHR-P state indicated greater divergence in neuroanatomical profiles at an individual level, irrespective of psychosis conversion. Further large-scale investigations are required of those who demonstrate marked deviation.© 2022. The Author(s)

Properties of a Yeast Cytochrome P-450-Containing Enzyme System which Catalyzes the Hydroxylation of Fatty Acids, Alkanes, and Drugs

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/65977/1/j.1432-1033.1973.tb02948.x.pd

Influence of Shear-Thinning Rheology on the Mixing Dynamics in Taylor-Couette Flow

Non‐Newtonian rheology can have a significant effect on mixing efficiency, which remains poorly understood. The effect of shear‐thinning rheology in a Taylor‐Couette reactor is studied using a combination of particle image velocimetry and flow visualization. Shear‐thinning is found to alter the critical Reynolds numbers for the formation of Taylor vortices and the higher‐order wavy instability, and is associated with an increase in the axial wavelength. Strong shear‐thinning and weak viscoelasticity can also lead to sudden transitions in wavelength as the Reynolds number is varied. Finally, it is shown that shear‐thinning causes an increase in the mixing time within vortices, due to a reduction in their circulation, but enhances the axial dispersion of fluid in the reactor