20 research outputs found

    EfficientBioAI: Making Bioimaging AI Models Efficient in Energy, Latency and Representation

    Full text link
    Artificial intelligence (AI) has been widely used in bioimage image analysis nowadays, but the efficiency of AI models, like the energy consumption and latency is not ignorable due to the growing model size and complexity, as well as the fast-growing analysis needs in modern biomedical studies. Like we can compress large images for efficient storage and sharing, we can also compress the AI models for efficient applications and deployment. In this work, we present EfficientBioAI, a plug-and-play toolbox that can compress given bioimaging AI models for them to run with significantly reduced energy cost and inference time on both CPU and GPU, without compromise on accuracy. In some cases, the prediction accuracy could even increase after compression, since the compression procedure could remove redundant information in the model representation and therefore reduce over-fitting. From four different bioimage analysis applications, we observed around 2-5 times speed-up during inference and 30-80%\% saving in energy. Cutting the runtime of large scale bioimage analysis from days to hours or getting a two-minutes bioimaging AI model inference done in near real-time will open new doors for method development and biomedical discoveries. We hope our toolbox will facilitate resource-constrained bioimaging AI and accelerate large-scale AI-based quantitative biological studies in an eco-friendly way, as well as stimulate further research on the efficiency of bioimaging AI.Comment: 17 pages, 6 figure

    Calibration by differentiation – Self‐supervised calibration for X‐ray microscopy using a differentiable cone‐beam reconstruction operator

    Get PDF
    High‐resolution X‐ray microscopy (XRM) is gaining interest for biological investigations of extremely small‐scale structures. XRM imaging of bones in living mice could provide new insights into the emergence and treatment of osteoporosis by observing osteocyte lacunae, which are holes in the bone of few micrometres in size. Imaging living animals at that resolution, however, is extremely challenging and requires very sophisticated data processing converting the raw XRM detector output into reconstructed images. This paper presents an open‐source, differentiable reconstruction pipeline for XRM data which analytically computes the final image from the raw measurements. In contrast to most proprietary reconstruction software, it offers the user full control over each processing step and, additionally, makes the entire pipeline deep learning compatible by ensuring differentiability. This allows fitting trainable modules both before and after the actual reconstruction step in a purely data‐driven way using the gradient‐based optimizers of common deep learning frameworks. The value of such differentiability is demonstrated by calibrating the parameters of a simple cupping correction module operating on the raw projection images using only a self‐supervisory quality metric based on the reconstructed volume and no further calibration measurements. The retrospective calibration directly improves image quality as it avoids cupping artefacts and decreases the difference in grey values between outer and inner bone by 68–94%. Furthermore, it makes the reconstruction process entirely independent of the XRM manufacturer and paves the way to explore modern deep learning reconstruction methods for arbitrary XRM and, potentially, other flat‐panel computed tomography systems. This exemplifies how differentiable reconstruction can be leveraged in the context of XRM and, hence, is an important step towards the goal of reducing the resolution limit of in vivo bone imaging to the single micrometre domain

    IL-33-induced metabolic reprogramming controls the differentiation of alternatively activated macrophages and the resolution of inflammation

    Get PDF
    Alternatively activated macrophages (AAMs) contribute to the resolution of inflammation and tissue repair. However, molecular pathways that govern their differentiation have remained incompletely understood. Here, we show that uncoupling protein-2-mediated mitochondrial reprogramming and the transcription factor GATA3 specifically controlled the differentiation of pro-resolving AAMs in response to the alarmin IL-33. In macrophages, IL-33 sequentially triggered early expression of pro-inflammatory genes and subsequent differentiation into AAMs. Global analysis of underlying signaling events revealed that IL-33 induced a rapid metabolic rewiring of macrophages that involved uncoupling of the respiratory chain and increased production of the metabolite itaconate, which subsequently triggered a GATA3-mediated AAM polarization. Conditional deletion of GATA3 in mononuclear phagocytes accordingly abrogated IL-33-induced differentiation of AAMs and tissue repair upon muscle injury. Our data thus identify an IL-4-independent and GATA3-dependent pathway in mononuclear phagocytes that results from mitochondrial rewiring and controls macrophage plasticity and the resolution of inflammation

    Stunning of neutrophils accounts for the anti-inflammatory effects of clodronate liposomes.

    Get PDF
    Clodronate liposomes (Clo-Lip) have been widely used to deplete mononuclear phagocytes (MoPh) to study the function of these cells in vivo. Here, we revisited the effects of Clo-Lip together with genetic models of MoPh deficiency, revealing that Clo-Lip exert their anti-inflammatory effects independent of MoPh. Notably, not only MoPh but also polymorphonuclear neutrophils (PMN) ingested Clo-Lip in vivo, which resulted in their functional arrest. Adoptive transfer of PMN, but not of MoPh, reversed the anti-inflammatory effects of Clo-Lip treatment, indicating that stunning of PMN rather than depletion of MoPh accounts for the anti-inflammatory effects of Clo-Lip in vivo. Our data highlight the need for a critical revision of the current literature on the role of MoPh in inflammation.This work was supported by the Deutsche Forschungsgemeinschaft (FG 2886 “PANDORA” – B01/B02/A03/ B04 to G. Kronke, F. Nimmerjahn, G. Schett, and M.H. Hoff- ¨ mann, respectively, and the CRC1181-A03/A01/A02/A07/C03 Z2 to G. Kronke, G. Schett, F. Nimmerjahn, and M.H. Hoffmann), ¨ the Emerging Field Initiative of the Friedrich-Alexander University Erlangen-Nürnberg (EFI_Verbund_Med_05_MIRACLE to G. Kronke), the Bundesministerium für Bildung und For- ¨ schung (MASCARA to G. Kronke and G. Schett; MelAutim to G. ¨ Kronke), and the European Union (Horizon 2020 ERC-2014-StG ¨ 640087 – SOS and ERC-2020-CoG 101001866 – INSPIRE to G. Kronke; and ERC-2018-SyG nanoSCOPE and RTCure to G. ¨ Schett). This work was supported by grants R01AI165661 from the National Institutes of Health/National Institute of Allergy and Infectious Diseases, H2020-FET-OPEN-2018- 2020 (no. 861878) from the European Commission to A. Hidalgo and M.H. Hoffmann, and HR17_00527 from Fundacion La Caixa to A. Hidalgo. The CNIC is supported by the Ministerio de Ciencia e Innovacion and the Pro-CNIC Foundation and is a Severo Ochoa Center of Excellence (MICINN award CEX2020-001041-S).S

    Phenotypical and Myopathological Consequences of Compound Heterozygous Missense and Nonsense Variants in SLC18A3

    No full text
    Background: Presynaptic forms of congenital myasthenic syndromes (CMS) due to pathogenic variants in SLC18A3 impairing the synthesis and recycling of acetylcholine (ACh) have recently been described. SLC18A3 encodes the vesicular ACh transporter (VAChT), modulating the active transport of ACh at the neuromuscular junction, and homozygous loss of VAChT leads to lethality. Methods: Exome sequencing (ES) was carried out to identify the molecular genetic cause of the disease in a 5-year-old male patient and histological, immunofluorescence as well as electron- and CARS-microscopic studies were performed to delineate the muscle pathology, which has so far only been studied in VAChT-deficient animal models. Results: ES unraveled compound heterozygous missense and nonsense variants (c.315G>A, p.Trp105* and c.1192G>C, p.Asp398His) in SLC18A3. Comparison with already-published cases suggests a more severe phenotype including impaired motor and cognitive development, possibly related to a more severe effect of the nonsense variant. Therapy with pyridostigmine was only partially effective while 3,4 diaminopyridine showed no effect. Microscopic investigation of the muscle biopsy revealed reduced fibre size and a significant accumulation of lipid droplets. Conclusions: We suggest that nonsense variants have a more detrimental impact on the clinical manifestation of SLC18A3-associated CMS. The impact of pathogenic SLC18A3 variants on muscle fibre integrity beyond the effect of denervation is suggested by the build-up of lipid aggregates. This in turn implicates the importance of proper VAChT-mediated synthesis and recycling of ACh for lipid homeostasis in muscle cells. This hypothesis is further supported by the pathological observations obtained in previously published VAChT-animal models

    Neutrophil Extracellular Traps Promote the Development and Growth of Human Salivary Stones

    No full text
    Salivary gland stones, or sialoliths, are the most common cause of the obstruction of salivary glands. The mechanism behind the formation of sialoliths has been elusive. Symptomatic sialolithiasis has a prevalence of 0.45% in the general population, is characterized by recurrent painful periprandial swelling of the affected gland, and often results in sialadenitis with the need for surgical intervention. Here, we show by the use of immunohistochemistry, immunofluorescence, computed tomography (CT) scans and reconstructions, special dye techniques, bacterial genotyping, and enzyme activity analyses that neutrophil extracellular traps (NETs) initiate the formation and growth of sialoliths in humans. The deposition of neutrophil granulocyte extracellular DNA around small crystals results in the dense aggregation of the latter, and the subsequent mineralization creates alternating layers of dense mineral, which are predominantly calcium salt deposits and DNA. The further agglomeration and appositional growth of these structures promotes the development of macroscopic sialoliths that finally occlude the efferent ducts of the salivary glands, causing clinical symptoms and salivary gland dysfunction. These findings provide an entirely novel insight into the mechanism of sialolithogenesis, in which an immune system-mediated response essentially participates in the physicochemical process of concrement formation and growth
    corecore