Demand Layering for Real-Time DNN Inference with Minimized Memory Usage

When executing a deep neural network (DNN), its model parameters are loaded into GPU memory before execution, incurring a significant GPU memory burden. There are studies that reduce GPU memory usage by exploiting CPU memory as a swap device. However, this approach is not applicable in most embedded systems with integrated GPUs where CPU and GPU share a common memory. In this regard, we present Demand Layering, which employs a fast solid-state drive (SSD) as a co-running partner of a GPU and exploits the layer-by-layer execution of DNNs. In our approach, a DNN is loaded and executed in a layer-by-layer manner, minimizing the memory usage to the order of a single layer. Also, we developed a pipeline architecture that hides most additional delays caused by the interleaved parameter loadings alongside layer executions. Our implementation shows a 96.5% memory reduction with just 14.8% delay overhead on average for representative DNNs. Furthermore, by exploiting the memory-delay tradeoff, near-zero delay overhead (under 1 ms) can be achieved with a slightly increased memory usage (still an 88.4% reduction), showing the great potential of Demand Layering.Comment: 14 pages, 16 figures. Accepted to the 43rd IEEE Real-Time Systems Symposium (RTSS), 202

Extracting regulatory modules from gene expression data by sequential pattern mining

Abstract Background Identifying a regulatory module (RM), a bi-set of co-regulated genes and co-regulating conditions (or samples), has been an important challenge in functional genomics and bioinformatics. Given a microarray gene-expression matrix, biclustering has been the most common method for extracting RMs. Among biclustering methods, order-preserving biclustering by a sequential pattern mining technique has native advantage over the conventional biclustering approaches since it preserves the order of genes (or conditions) according to the magnitude of the expression value. However, previous sequential pattern mining-based biclustering has several weak points in that they can easily be computationally intractable in the real-size of microarray data and sensitive to inherent noise in the expression value. Results In this paper, we propose a novel sequential pattern mining algorithm that is scalable in the size of microarray data and robust with respect to noise. When applied to the microarray data of yeast, the proposed algorithm successfully found long order-preserving patterns, which are biologically significant but cannot be found in randomly shuffled data. The resulting patterns are well enriched to known annotations and are consistent with known biological knowledge. Furthermore, RMs as well as inter-module relations were inferred from the biologically significant patterns. Conclusions Our approach for identifying RMs could be valuable for systematically revealing the mechanism of gene regulation at a genome-wide level.</p

Does Diabetes Mellitus Influence Standardized Uptake Values of Fluorodeoxyglucose Positron Emission Tomography in Colorectal Cancer?

Background/AimsHyperglycemia is associated with decreased 2-18[F]fluoro-2-deoxy-D-glucose (FDG) uptake by tumors assessed by positron emission tomography (PET). In this retrospective study we investigated a comparison of standardized uptake values (SUVs) in patients with primary colorectal cancers who either had diabetes mellitus (DM) or were otherwise healthy.MethodsThe medical records of 397 patients who were diagnosed with colorectal cancer and underwent PET-CT between January 2006 and December 2012 were analyzed. Eighty patients with DM and 317 patients without DM were included. Clinical characteristics were reviewed and maximal standardized uptake values (SUVmax) were calculated in the primary colorectal lesions.ResultsThere was no significant difference between tumor SUVmax in DM patients (10.60±5.78) and those without DM (10.92±5.44). In addition, no significant difference was detected between tumor SUVmax in DM patients with glycated hemoglobin (HbA1c) levels <8% (10.34±5.17) and those with HbA1c levels ≥8% (10.61±7.27). The maximum size of the primary colorectal tumor was associated with SUVmax in a linear regression analysis.ConclusionThe results of this study showed that DM did not influence FDG uptake values in colorectal cancer patients regardless of glucose levels

Mesenchymal Stem Cells Transfer Mitochondria to the Cells with Virtually No Mitochondrial Function but Not with Pathogenic mtDNA Mutations

It has been reported that human mesenchymal stem cells (MSCs) can transfer mitochondria to the cells with severely compromised mitochondrial function. We tested whether the reported intercellular mitochondrial transfer could be replicated in different types of cells or under different experimental conditions, and tried to elucidate possible mechanism. Using biochemical selection methods, we found exponentially growing cells in restrictive media (uridine− and bromodeoxyuridine [BrdU]+) during the coculture of MSCs (uridine-independent and BrdU-sensitive) and 143B-derived cells with severe mitochondrial dysfunction induced by either long-term ethidium bromide treatment or short-term rhodamine 6G (R6G) treatment (uridine-dependent but BrdU-resistant). The exponentially growing cells had nuclear DNA fingerprint patterns identical to 143B, and a sequence of mitochondrial DNA (mtDNA) identical to the MSCs. Since R6G causes rapid and irreversible damage to mitochondria without the removal of mtDNA, the mitochondrial function appears to be restored through a direct transfer of mitochondria rather than mtDNA alone. Conditioned media, which were prepared by treating mtDNA-less 143B ρ0 cells under uridine-free condition, induced increased chemotaxis in MSC, which was also supported by transcriptome analysis. Cytochalasin B, an inhibitor of chemotaxis and cytoskeletal assembly, blocked mitochondrial transfer phenomenon in the above condition. However, we could not find any evidence of mitochondrial transfer to the cells harboring human pathogenic mtDNA mutations (A3243G mutation or 4,977 bp deletion). Thus, the mitochondrial transfer is limited to the condition of a near total absence of mitochondrial function. Elucidation of the mechanism of mitochondrial transfer will help us create a potential cell therapy-based mitochondrial restoration or mitochondrial gene therapy for human diseases caused by mitochondrial dysfunction

Blind Signal Processing Algorithmsbased based on Recursive Gradient Estimation

Blind algorithms based on the Euclidean distance (ED) between the output distribution function and a set of Dirac delta functions have a heavy computational burden of  due to some double summation operations for the sample size and symbol points. In this paper, a recursive approach to the estimation of the ED and its gradient is proposed to reduce the computational complexity for efficient implementation of the algorithm. The ED of the algorithm is comprised of information potentials (IPs), and the IPs at the next iteration can be calculated recursively based on the currently obtained IPs. Utilizing the recursively estimated IPs, the next step gradient for the weight update of the algorithm can be estimated recursively with the present gradient. With this recursive approach, the computational complexity of gradient calculation has only . The simulation results show that the proposed gradient estimation method holds significantly reduced computational complexity keeping the same performance as the block processing metho

A Sub-50 µm2, Voltage-Scalable, Digital-Standard-Cell-Compatible Thermal Sensor Frontend for On-Chip Thermal Monitoring

This paper presents an on-chip temperature sensor circuit for dynamic thermal management in VLSI systems. The sensor directly senses the threshold voltage that contains temperature information using a single PMOS device. This simple structure enables the sensor to achieve an ultra-compact footprint. The sensor also exhibits high accuracy and voltage-scalability down to 0.4 V, allowing the sensor to be used in dynamic voltage frequency scaling systems without requiring extra power distribution or regulation. The compact footprint and voltage scalability enables our proposed sensor to be implemented in a digital standard-cell format, allowing aggressive sensor placement very close to target hotspots in digital blocks. The proposed sensor frontend prototyped in a 65 nm CMOS technology has a footprint of 30.1 &micro;m2, 3&sigma;-error of &plusmn;1.1 &deg;C across 0 to 100 &deg;C after one temperature point calibration, marking a significant improvement over existing sensors designed for dynamic thermal management in VLSI systems

The Effects of an Online&ndash;Offline Hybrid Exercise Program on the Lives of Children with Cerebral Palsy Using Wheelchairs during the COVID-19 Pandemic in Korea

Due to the ongoing COVID-19 pandemic, many online programs for social meetings, education, leisure, and physical activities have been developed and provided; however, children with cerebral palsy (CP) cannot enjoy online programs in the same way that those without disabilities can. The aim of this study was to investigate the differences in reintegration to normal living (RNL), social interaction, and quality of life among school-age children with CP after participation in a game-based online&ndash;offline hybrid group exercise program. The current study was conducted on 26 children with CP who participated in a hybrid exercise program. The RNL, social interaction, and quality of life were measured before and after the six-week program. The scores of RNL and quality of life were improved (p &lt; 0.05) after program participation. Online or hybrid exercise programs incorporating interactive methods (i.e., competition and cooperating) could enhance RNL and quality of life of children with CP. Thus, well-designed online or hybrid exercise programs should be developed and provided for children with CP to enhance overall quality of life during the pandemic

Regulation of Expression in the Uterine Endometrium during Early Pregnancy in Pigs

Calcium ions play an important role in the establishment and maintenance of pregnancy, but molecular and cellular regulatory mechanisms of calcium ion action in the uterine endometrium are not fully understood in pigs. Previously, we have shown that calcium regulatory molecules, transient receptor potential vanilloid type 5 (TRPV6) and calbindin-D9k (S100G), are expressed in the uterine endometrium during the estrous cycle and pregnancy in a pregnancy status- and stage-specific manner, and that estrogen of conceptus origin increases endometrial TRPV6 expression. However, regulation of S100G expression in the uterine endometrium and conceptus expression of S100G has been not determined during early pregnancy. Thus, we investigated regulation of S100G expression by estrogen and interleukin-1β (IL1B) in the uterine endometrium and conceptus expression of S100G during early pregnancy in pigs. We obtained uterine endometrial tissues from day (D) 12 of the estrous cycle and treated with combinations of steroid hormones, estradiol-17β (E2) and progesterone (P4), and increasing doses of IL1B. Real-time RT-PCR analysis showed that E2 and IL1B increased S100G mRNA levels in the uterine endometrium, and conceptuses expressed S100G mRNA during early pregnancy, as determined by RT-PCR analysis. To determine if endometrial expression of S100G mRNA during the implantation period was affected by the somatic cell nuclear transfer (SCNT) procedure, we compared S100G mRNA levels in the uterine endometrium from gilts with SCNT-derived conceptuses with those from gilts with conceptuses derived from natural mating on D12 of pregnancy. Real-time RT-PCR analysis showed that levels of S100G mRNA in the uterine endometrium from gilts carrying SCNT-derived conceptuses was significantly lower than those from gilts carrying conceptuses derived from natural mating. These results showed that S100G expression in the uterine endometrium was regulated by estrogen and IL1B of conceptus origin, and affected by the SCNT procedure during early pregnancy. These suggest that conceptus signals regulate S100G, an intracellular calcium transport protein, for the establishment of pregnancy in pigs