Modeling the Resource Requirements of Convolutional Neural Networks on Mobile Devices

Convolutional Neural Networks (CNNs) have revolutionized the research in computer vision, due to their ability to capture complex patterns, resulting in high inference accuracies. However, the increasingly complex nature of these neural networks means that they are particularly suited for server computers with powerful GPUs. We envision that deep learning applications will be eventually and widely deployed on mobile devices, e.g., smartphones, self-driving cars, and drones. Therefore, in this paper, we aim to understand the resource requirements (time, memory) of CNNs on mobile devices. First, by deploying several popular CNNs on mobile CPUs and GPUs, we measure and analyze the performance and resource usage for every layer of the CNNs. Our findings point out the potential ways of optimizing the performance on mobile devices. Second, we model the resource requirements of the different CNN computations. Finally, based on the measurement, pro ling, and modeling, we build and evaluate our modeling tool, Augur, which takes a CNN configuration (descriptor) as the input and estimates the compute time and resource usage of the CNN, to give insights about whether and how e ciently a CNN can be run on a given mobile platform. In doing so Augur tackles several challenges: (i) how to overcome pro ling and measurement overhead; (ii) how to capture the variance in different mobile platforms with different processors, memory, and cache sizes; and (iii) how to account for the variance in the number, type and size of layers of the different CNN configurations

DFT-Spread Spectrally Overlapped Hybrid OFDM-Digital Filter Multiple Access IMDD PONs

A novel transmission technique—namely, a DFT-spread spectrally overlapped hybrid OFDM–digital filter multiple access (DFMA) PON based on intensity modulation and direct detection (IMDD)—is here proposed by employing the discrete Fourier transform (DFT)-spread technique in each optical network unit (ONU) and the optical line terminal (OLT). Detailed numerical simulations are carried out to identify optimal ONU transceiver parameters and explore their maximum achievable upstream transmission performances on the IMDD PON systems. The results show that the DFT-spread technique in the proposed PON is effective in enhancing the upstream transmission performance to its maximum potential, whilst still maintaining all of the salient features associated with previously reported PONs. Compared with previously reported PONs excluding DFT-spread, a significant peak-to-average power ratio (PAPR) reduction of over 2 dB is achieved, leading to a 1 dB reduction in the optimal signal clipping ratio (CR). As a direct consequence of the PAPR reduction, the proposed PON has excellent tolerance to reduced digital-to-analogue converter/analogue-to-digital converter (DAC/ADC) bit resolution, and can therefore ensure the utilization of a minimum DAC/ADC resolution of only 6 bits at the forward error correction (FEC) limit (1 × 10−3). In addition, the proposed PON can improve the upstream power budget by >1.4 dB and increase the aggregate upstream signal transmission rate by up to 10% without degrading nonlinearity tolerances

Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decomposition

While dynamic Neural Radiance Fields (NeRF) have shown success in high-fidelity 3D modeling of talking portraits, the slow training and inference speed severely obstruct their potential usage. In this paper, we propose an efficient NeRF-based framework that enables real-time synthesizing of talking portraits and faster convergence by leveraging the recent success of grid-based NeRF. Our key insight is to decompose the inherently high-dimensional talking portrait representation into three low-dimensional feature grids. Specifically, a Decomposed Audio-spatial Encoding Module models the dynamic head with a 3D spatial grid and a 2D audio grid. The torso is handled with another 2D grid in a lightweight Pseudo-3D Deformable Module. Both modules focus on efficiency under the premise of good rendering quality. Extensive experiments demonstrate that our method can generate realistic and audio-lips synchronized talking portrait videos, while also being highly efficient compared to previous methods.Comment: Project page: https://me.kiui.moe/radnerf

Effect of family-centered interventions for perinatal depression: an overview of systematic reviews

This study aimed to evaluate and conclude the quality of critically systematic reviews (SRs) of the efficacy of family-centered interventions on perinatal depression.SRs of the efficacy of family-centered interventions on perinatal depression were systematically searched in nine databases. The retrieval period was from the inception of the database to December 31, 2022. In addition, two reviewers conducted an independent evaluation of the quality of reporting, bias risk, methodologies, and evidence using ROBIS (an instrument for evaluating the bias risk of SRs), Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), AMSTAR 2 (an assessment tool for SRs), and grading of recommendations, assessment, development and evaluations (GRADE).A total of eight papers satisfied the inclusion criteria. In particular, AMSTAR 2 rated five SRs as extremely low quality and three SRs as low quality. ROBIS graded four out of eight SRs as “low risk.” Regarding PRISMA, four of the eight SRs were rated over 50%. Based on the GRADE tool, two out of six SRs rated maternal depressive symptoms as “moderate;” one out of five SRs rated paternal depressive symptoms as “moderate;” one out of six SRs estimated family functioning as “moderate,” and the other evidence was rated as “very low” or “low.” Of the eight SRs, six (75%) reported that maternal depressive symptoms were significantly reduced, and two SRs (25%) were not reported.Family-centered interventions may improve maternal depressive symptoms and family function, but not paternal depressive symptoms. However, the quality of methodologies, evidence, reporting, and bias of risk in the included SRs of family-centered interventions for perinatal depression was not satisfactory. The above-mentioned demerits may negatively affect SRs and then cause inconsistent outcomes. Therefore, SRs with a low risk of bias, high-quality evidence, standard reporting, and strict methodology are necessary to provide evidence of the efficacy of family-centered interventions for perinatal depression

Development of a short-term nutritional risk prediction model for hepatocellular carcinoma patients: a retrospective cohort study

Malnutrition in patients is associated with reduced tolerance to treatment-related side effects and higher risks of complications, directly impacting patient prognosis. Consequently, a pressing requirement exists for the development of uncomplicated yet efficient screening methods to detect patients at heightened nutritional risk. The aim of this study was to formulate a concise nutritional risk prediction model for prompt assessment by oncology medical personnel, facilitating the effective identification of hepatocellular carcinoma patients at an elevated nutritional risk. Retrospective cohort data were collected from hepatocellular carcinoma patients who met the study's inclusion and exclusion criteria between March 2021 and April 2022. The patients were categorized into two groups: a normal nutrition group and a malnutrition group based on body composition assessments. Subsequently, the collected data were analyzed, and predictive models were constructed, followed by simplification. A total of 220 hepatocellular carcinoma patients were included in this study, and the final model incorporated four predictive factors: age, tumor diameter, TNM stage, and anemia. The area under the ROC curve for the short-term nutritional risk prediction model was 0.990 [95% CI (0.966–0.998)]. Further simplification of the scoring rule resulted in an area under the ROC curve of 0.986 [95% CI (0.961, 0.997)]. The developed model provides a rapid and efficient approach to assess the short-term nutritional risk of hepatocellular carcinoma patients. With easily accessible and swift indicators, the model can identify patients with potential nutritional risk more effectively and timely