A Recipe for Efficient SBIR Models: Combining Relative Triplet Loss with Batch Normalization and Knowledge Distillation

Sketch-Based Image Retrieval (SBIR) is a crucial task in multimedia retrieval, where the goal is to retrieve a set of images that match a given sketch query. Researchers have already proposed several well-performing solutions for this task, but most focus on enhancing embedding through different approaches such as triplet loss, quadruplet loss, adding data augmentation, and using edge extraction. In this work, we tackle the problem from various angles. We start by examining the training data quality and show some of its limitations. Then, we introduce a Relative Triplet Loss (RTL), an adapted triplet loss to overcome those limitations through loss weighting based on anchors similarity. Through a series of experiments, we demonstrate that replacing a triplet loss with RTL outperforms previous state-of-the-art without the need for any data augmentation. In addition, we demonstrate why batch normalization is more suited for SBIR embeddings than l2-normalization and show that it improves significantly the performance of our models. We further investigate the capacity of models required for the photo and sketch domains and demonstrate that the photo encoder requires a higher capacity than the sketch encoder, which validates the hypothesis formulated in [34]. Then, we propose a straightforward approach to train small models, such as ShuffleNetv2 [22] efficiently with a marginal loss of accuracy through knowledge distillation. The same approach used with larger models enabled us to outperform previous state-of-the-art results and achieve a recall of 62.38% at k = 1 on The Sketchy Database [30]

One-Cycle Pruning: Pruning ConvNets Under a Tight Training Budget

Introducing sparsity in a neural network has been an efficient way to reduce its complexity while keeping its performance almost intact. Most of the time, sparsity is introduced using a three-stage pipeline: 1) train the model to convergence, 2) prune the model according to some criterion, 3) fine-tune the pruned model to recover performance. The last two steps are often performed iteratively, leading to reasonable results but also to a time-consuming and complex process. In our work, we propose to get rid of the first step of the pipeline and to combine the two other steps in a single pruning-training cycle, allowing the model to jointly learn for the optimal weights while being pruned. We do this by introducing a novel pruning schedule, named One-Cycle Pruning, which starts pruning from the beginning of the training, and until its very end. Adopting such a schedule not only leads to better performing pruned models but also drastically reduces the training budget required to prune a model. Experiments are conducted on a variety of architectures (VGG-16 and ResNet-18) and datasets (CIFAR-10, CIFAR-100 and Caltech-101), and for relatively high sparsity values (80%, 90%, 95% of weights removed). Our results show that One-Cycle Pruning consistently outperforms commonly used pruning schedules such as One-Shot Pruning, Iterative Pruning and Automated Gradual Pruning, on a fixed training budget.Comment: Accepted at Sparsity in Neural Networks (SNN 2021

Measurement Instruments of Productivity Loss of Paid and Unpaid Work:A Systematic Review and Assessment of Suitability for Health Economic Evaluations From a Societal Perspective

OBJECTIVES: This study aimed (1) to perform a systematic literature review of instruments for measuring productivity loss of paid and unpaid work and (2) to assess the suitability (in terms of identification, measurement, and valuation) of these instruments for use in health economic evaluations from a societal perspective. METHODS: Articles published from 2018 were sourced from PubMed/Medline, PsycInfo, Embase, and Econlit. Using 2 separate search strategies, eligible economic evaluations and validation studies were selected and unique measurement instruments identified. A data-extraction form was developed by studying previous literature and consulting an international panel of experts in the field of productivity costs. This data-extraction form was applied to assess the suitability of instruments for use in economic evaluations. RESULTS: A total of 5982 articles were retrieved from the databases, of which 99 economic evaluations and 9 validation studies were included in the review. A total of 42 unique measurement instruments were identified. Nine instruments provided quantified measures of absenteeism, presenteeism, and unpaid work. Five instruments supplied the necessary information to enable the use of at least 1 common valuation method. The Health and Labour Questionnaire-Short Form, Health and Labour Questionnaire, and Institute for Medical Technology Assessment Productivity Cost Questionnaire met both criteria. Nevertheless, the developers replaced the Health and Labour Questionnaire-Short Form and Health and Labour Questionnaire by the more recently developed Institute for Medical Technology Assessment Productivity Cost Questionnaire. CONCLUSIONS: Although many instruments for measuring productivity loss were identified, most were not suitable for capturing productivity changes for economic evaluations from a societal perspective. Future research can benefit from this study by making an informed instrument choice for the measurement of productivity loss of paid and unpaid work

Measurement and evaluation of quality of life and well-being in individuals having or having had fertility problems: a systematic review

__Objectives:__ The aims of this study were: (1) to identify which measurement instruments are used in practice to assess the quality of life or well-being of individuals with and without (sub)fertility; (2) to describe the design and outcomes of studies comparing quality of life or well-being of individuals with and without fertility problems; and (3) to determine which of the outcomes of the identified studies could be used in cost-utility studies. __Methods:__ A systematic literature review was performed of studies published before July 2018, using multiple databases. Included studies investigated (health-related) quality of life or well-being of individuals with fertility problems. The applied instruments were assessed, as were the outcomes and suitability for use in cost-utility studies. __Results:__ Twenty-six studies met the inclusion criteria. Twelve distinct instruments of measurement were applied: two generic quality-of-life instruments, five generic well-being instruments and five disease-specific instruments. Most studies found negative associations in one or more domains assessing fertility problems and quality of life or well-being. However, two studies found the opposite. None of the studies reported outcomes relevant for cost-utility studies. __Conclusion:__ Quality of life and well-being related to having fertility problems are regularly studied. However, the reported information is not suitable for use in cost-utility studies. There is a clear need for studies investigating the impact of fertility problems on quality of life in a way that outcomes can be compared across studies and disease areas

Microvessel quantification in primary colorectal carcinoma: an immunohistochemical study.

The vascularisation of human primary colorectal carcinomas was studied immunohistochemically using the endothelial cell markers CD31 and factor VIII-related antigen. Tumour sections were systematically scanned at a magnification of x 100 to find areas of intense neovascularisation. Microvessel counts within these vascular 'hotspots' were performed at magnification x 250. Regions in which tumour cords were surrounded by a collagen IV-positive basement membrane were compared with those in which this was absent and with normal mucosa. CD31 appeared to be a more sensitive marker for endothelial cells than factor VIII-related antigen (mean 185 +/- 59 and 120 +/- 38 microvessels mm-2). Within individual tumour sections microvessel counts in vascular hotspots with highest vessel density correlated significantly with microvessel counts in vascular hotspots with second highest vessel density (P < 0.01). Microvessel counts in tumour areas where collagen IV-positive basement membrane were absent exceeded those in areas where it was present (factor of 1.7) and those in normal mucosa (factor of 1.6). The differences in vessel density between individual tumours and the low variability in vessel density within individual tumours using this quantification technique allow us to investigate the prognostic value of vessel density in areas of intense neovascularisation in human primary colorectal carcinomas

Relation of gallbladder function and Helicobacter pylori infection to gastric mucosa inflammation in patients with symptomatic cholecystolithiasis

Background. Inflammatory alterations of the gastric mucosa are commonly caused by Helicobacter pylori (Hp) infection in patients with symptomatic gallstone disease. However, the additional pathogenetic role of an impaired gallbladder function leading to an increased alkaline duodenogastric reflux is controversially discussed. Aim:To investigate the relation of gallbladder function and Hp infection to gastric mucosa inflammation in patients with symptomatic gallstones prior to cholecystectomy. Patients: Seventy-three patients with symptomatic gallstones were studied by endoscopy and Hp testing. Methods: Gastritis classification was performed according to the updated Sydney System and gallbladder function was determined by total lipid concentration of gallbladder bile collected during mainly laparoscopic cholecystectomy. Results: Fifteen patients revealed no, 39 patients mild, and 19 moderate to marked gastritis. No significant differences for bile salts, phospholipids, cholesterol, or total lipids in gallbladder bile were found between these three groups of patients. However, while only 1 out of 54 (< 2%) patients with mild or no gastritis was found histologically positive for Hp, this infection could be detected in 14 (74%) out of 19 patients with moderate to marked gastritis. Conclusion: Moderate to marked gastric mucosa inflammation in gallstone patients is mainly caused by Hp infection, whereas gallbladder function is not related to the degree of gastritis. Thus, an increased alkaline duodenogastric reflux in gallstone patients seems to be of limited pathophysiological relevance. Copyright (c) 2006 S. Karger AG, Basel

Low Cerebrospinal Fluid Levels of Melanotransferrin Are Associated With Conversion of Mild Cognitively Impaired Subjects to Alzheimer’s Disease

The disruption of iron metabolism and iron transport proteins have been implicated in the pathogenesis of Alzheimer’s disease (AD). Serum melanotransferrin (MTf), a transferrin homolog capable of reversibly binding iron, has been proposed as a biochemical marker of AD. MTf has also been shown to be elevated in iron-rich reactive microglia near amyloid plaques in AD. We examined the association of CSF MTf to hippocampal volumes and cognitive tests in 86 cognitively normal, 135 mild cognitive impairment (MCI) and 66 AD subjects. CSF was collected at baseline for MTf, Aβ, total-tau and phosphorylated-tau measurements. Serial cognitive testing with ADAS-Cog13, Rey’s auditory visual learning test (RAVLT), mini-mental state examination (MMSE) were performed alongside hippocampal MRI volumetric analysis for up to 10 years after baseline measurements. High levels of baseline CSF MTf were positively associated with baseline hippocampal volume (R2 = 22%, β = 0.202, and p = 0.017) and RAVLT scores (R2 = 7.30%, β = -0.178, and p = 0.043) and negatively correlated to ADAS-Cog13 (R2 = 17.3%, β = 0.247, and p = 0.003) scores in MCI subjects. Interestingly, MCI subjects that converted to AD demonstrated significantly lower levels of CSF MTf (p = 0.020) compared to MCI non-converters at baseline. We suggest the diminished CSF MTf observed in MCI-converters to AD may arise from impaired transport of MTf from blood into the brain tissue/CSF and/or increased MTf export from the CSF into the blood arising from attenuated competition with reduced levels of CSF Aβ. Further investigations are required to determine the source of CSF MTf and how brain MTf is regulated by cellular barriers, Aβ and activated microglia that surround plaques in AD pathophysiology. In conclusion, low CSF MTf may identify those MCI individuals at risk of converting to AD

Neuronal RARβ signaling modulates PTEN activity directly in neurons and via exosome transfer in astrocytes to prevent glial scar formation and induce spinal cord regeneration

Failure of axonal regeneration in the central nervous system (CNS) is mainly attributed to a lack of intrinsic neuronal growth programs and an inhibitory environment from a glial scar. Phosphatase and tensin homolog (PTEN) is a major negative regulator of neuronal regeneration and, as such, inhibiting its activity has been considered a therapeutic target for spinal cord (SC) injuries (SCIs). Using a novel model of rat cervical avulsion, we show that treatment with a retinoic acid receptor β (RARβ) agonist results in locomotor and sensory recovery. Axonal regeneration from the severed roots into the SC could be seen by biotinylated dextran amine labeling. Light micrographs of the dorsal root entry zone show the peripheral nervous system (PNS)–CNS transition of regrown axons. RARβ agonist treatment also resulted in the absence of scar formation. Mechanism studies revealed that, in RARβ-agonist-treated neurons, PTEN activity is decreased by cytoplasmic phosphorylation and increased secretion in exosomes. These are taken up by astrocytes, resulting in hampered proliferation and causing them to arrange in a normal-appearing scaffold around the regenerating axons. Attribution of the glial modulation to neuronal PTEN in exosomes was demonstrated by the use of an exosome inhibitor in vivo and PTEN siRNA in vitro assays. The dual effect of RARβ signaling, both neuronal and neuronal–glial, results in axonal regeneration into the SC after dorsal root neurotmesis. Targeting this pathway may open new avenues for the treatment of SCIs. SIGNIFICANCE STATEMENT Spinal cord injuries (SCIs) often result in permanent damage in the adult due to the very limited capacity of axonal regeneration. Intrinsic neuronal programs and the formation of a glial scar are the main obstacles. Here, we identify a single target, neuronal retinoic acid receptor β (RARβ), which modulates these two aspects of the postinjury physiological response. Activation of RARβ in the neuron inactivates phosphatase and tensin homolog and induces its transfer into the astrocytes in small vesicles, where it prevents scar formation. This may open new therapeutic avenues for SCIs

Mapping mRNA Expression of Glaucoma Genes in the Healthy Mouse Eye

Purpose/Aim: Many genes have been associated with primary open-angle glaucoma (POAG). Knowing exactly where they are expressed in the eye helps to unravel POAG pathology and to select optimal targets for intervention. We investigated whether RNA in situ hybridization (RNA-ISH) is a convenient technique to obtain detailed pan-ocular expression data of these genes. We tested this for four diverse candidate POAG genes, selected because of unclear ocular distribution (F5 and Dusp1) and relevance for potential new therapies (Tnf, Tgfβr3). Optn, a POAG gene with well-known ocular expression pattern served as control. Methods: We made a list of candidate glaucoma genes reported in genetic studies. A table of their ocular expression at the tissue level was compiled using publicly available microarray data (the ocular tissue database). To add cellular detail we performed RNA-ISH for Optn, Tnf, Tgfβr3, F5, and Dusp1 on eyes of healthy, 2-month-old, pigmented, and albino mice. Results: Expression of the Optn control matched with published immunohistochemistry data. Ocular expression of Tnf was generally low, with patches of higher Tnf expression, superficially in the corneal epithelium. F5 had a restricted expression pattern with high expression in the nonpigmented ciliary body epithelium and moderate expression in the peripapillary region. Tgfβr3 and Dusp1 showed ubiquitous expression. Conclusions: RNA-ISH is a suitable technique to determine the ocular expression pattern of POAG genes, adding meaningful cellular detail to existing microarray expression data. For instance, the high expression of F5 in the nonpigmented ciliary body epithelium suggests a role of this gene in aqueous humor dynamics and intraocular pressure. In addition, the ubiquitous expression of Tgfβr3 has implications for designing TGF-β-related glaucoma therapies, with respect to side effects. Creating pan-ocular expression maps of POAG genes with RNA-ISH will help to identify POAG pathways in speci