Analyzing the Hardware-Software Implications of Multi-modal DNN Workloads using MMBench

The explosive growth of various types of big data and advances in AI technologies have catalyzed a new type of applications called multi-modal DNNs. Multi-modal DNNs are capable of interpreting and reasoning about information from multiple modalities, making them more applicable to real-world AI scenarios. In recent research, multi-modal DNNs have outperformed the best uni-modal DNN in a wide range of applications from traditional multimedia to emerging autonomous systems. However, despite their importance and superiority, very limited research attention has been devoted to understand the characteristics of multi-modal DNNs and their implications on current computing software/hardware platforms. To facilitate research and advance the understanding of these multi-modal DNN workloads, we first present MMbench, an open-source benchmark suite consisting of a set of real-world multi-modal DNN workloads with relevant performance metrics for evaluation. Then we use MMbench to conduct an in-depth analysis on the characteristics of multi-modal DNNs. We study their implications on application and programming framework, operating and scheduling system, as well as execution hardware. Finally, we conduct a case study and extend our benchmark to edge devices. We hope that our work can provide guidance for future software/hardware design and optimization to underpin multi-modal DNNs on both cloud and edge computing platforms

Case report of a Li-Fraumeni syndrome-like phenotype with a de novo mutation in <i>CHEK2</i>

BACKGROUND: Cases of multiple tumors are rarely reported in China. In our study, a 57-year-old female patient had concurrent squamous cell carcinoma, mucoepidermoid carcinoma, brain cancer, bone cancer, and thyroid cancer, which has rarely been reported to date. METHODS: To determine the relationship among these multiple cancers, available DNA samples from the thyroid, lung, and skin tumors and from normal thyroid tissue were sequenced using whole exome sequencing. RESULTS: The notable discrepancies of somatic mutations among the 3 tumor tissues indicated that they arose independently, rather than metastasizing from 1 tumor. A novel deleterious germline mutation (chr22:29091846, G->A, p.H371Y) was identified in CHEK2, a Li–Fraumeni syndrome causal gene. Examining the status of this novel mutation in the patient's healthy siblings revealed its de novo origin. CONCLUSION: Our study reports the first case of Li–Fraumeni syndrome-like in Chinese patients and demonstrates the important contribution of de novo mutations in this type of rare disease

Genomic Analyses Reveal Mutational Signatures and Frequently Altered Genes in Esophageal Squamous Cell Carcinoma

Esophageal squamous cell carcinoma (ESCC) is one of the most common cancers worldwide and the fourth most lethal cancer in China. However, although genomic studies have identified some mutations associated with ESCC, we know little of the mutational processes responsible. To identify genome-wide mutational signatures, we performed either whole-genome sequencing (WGS) or whole-exome sequencing (WES) on 104 ESCC individuals and combined our data with those of 88 previously reported samples. An APOBEC-mediated mutational signature in 47% of 192 tumors suggests that APOBEC-catalyzed deamination provides a source of DNA damage in ESCC. Moreover, PIK3CA hotspot mutations (c.1624G>A [p.Glu542Lys] and c.1633G>A [p.Glu545Lys]) were enriched in APOBEC-signature tumors, and no smoking-associated signature was observed in ESCC. In the samples analyzed by WGS, we identified focal (<100 kb) amplifications of CBX4 and CBX8. In our combined cohort, we identified frequent inactivating mutations in AJUBA, ZNF750, and PTCH1 and the chromatin-remodeling genes CREBBP and BAP1, in addition to known mutations. Functional analyses suggest roles for several genes (CBX4, CBX8, AJUBA, and ZNF750) in ESCC. Notably, high activity of hedgehog signaling and the PI3K pathway in approximately 60% of 104 ESCC tumors indicates that therapies targeting these pathways might be particularly promising strategies for ESCC. Collectively, our data provide comprehensive insights into the mutational signatures of ESCC and identify markers for early diagnosis and potential therapeutic targets

Investigate protein S-palmitoylation as a novel post-translational mechanism underlying the crosstalk between circadian clocks and metabolism

Nutrient-dependent post-translational modifications (PTMs) bridge animal circadian clock and metabolism. Previous studies showed that daily cycling of protein OGlcNAcylation, a sugar-derived PTM, is driven by circadian clocks and can feedback to reinforce clock functions and daily biological rhythms. Like O-GlcNAcylation, Spalmitoylation is also a dynamic and nutrient-dependent PTM. High fat diet and palmitate treatment that may potentially affect protein S-palmitoylation are known to impact the functions of circadian clocks. I therefore hypothesize that S-palmitoylation is also a nutrient-dependent PTM underlying the interplay between metabolism and circadian clocks to regulate daily biological rhythms. Using Drosophila as an animal model, I identified many S-palmitoylation regulators with clock-controlled expression at the transcript level, suggesting that S-palmitoylation of some cellular proteins may be a clockmediated process. Among them, CG1407 that codes for a palmitoyltransferase exhibits 24-hour cycles robustly. I knocked down CG1407 genetically using RNA interference and observed the slowing down of the circadian clock and impact on daily activity rhythm. Overall, my results suggest that protein S-palmitoylation could be important for regulating daily biological rhythms. My results also highlight the utility of manipulating CG1407 expression as an experimental tool to study the interplay between S-palmitoylation cycling and biological rhythms

Analysis on anti-wear mechanism of bionic non-smooth surface based on discrete phase model

In order to study the lubrication and anti-wear mechanism of the pit-type bionic non-smooth surface used in the low-speed and high-torque seawater hydraulic motor valve plate pair, the discrete phase models of the four pits are simulated under different working conditions. In this study, the trajectories of different diameters particles in the hemispherical pits are analysed, which can reflect the movement of different sizes and masses wear debris in the pits. The discrete phase concentration distributions of the four-kind pits, hemispherical pits, cylindrical pits, four-prism pits and tri-prism pits, are simulation under the same working conditions, which reflects the effect of pit geometry on the movement of wear debris. The discrete phase concentration distributions of four pits moving at different rotation speeds and different rotation radii are calculated, which indicates that the rotation speed of the motor and the distribution of pits on the valve plate will affect the ability of the pit to store wear debris

Design of Lumped Disturbance Observer in Current Loop of IPMSM Based on Recursive Integral Sliding Mode Surface

To overcome the problem of current control effect being reduced by unideal factors in a motor control system, such as motor parameter variation, inverter dead time, nonlinearity of the system, etc., a sliding mode disturbance observer for an interior permanent magnet synchronous motor is proposed in this paper. The model of an interior permanent magnet synchronous motor with unideal factors is designed, and the unideal factors are unified into lumped disturbances of motor stator voltage. Then, the observer for lumped disturbance is designed. A recursive integral sliding surface is used to replace the terminal sliding surface to avoid the noise sensitivity and singularity problem of the traditional terminal sliding mode observer. The observer can estimate the lumped disturbance of the current loop without relying on the accurate system model in finite time. Moreover, the structure of the current loop does not need to be adjusted while using the observer to observe and compensate for disturbances. Experiments are carried out to verify the effectiveness of the proposed observer

miR-210 controls the evening phase of circadian locomotor rhythms through repression of Fasciclin 2.

Circadian clocks control the timing of animal behavioral and physiological rhythms. Fruit flies anticipate daily environmental changes and exhibit two peaks of locomotor activity around dawn and dusk. microRNAs are small non-coding RNAs that play important roles in post-transcriptional regulation. Here we identify Drosophila miR-210 as a critical regulator of circadian rhythms. Under light-dark conditions, flies lacking miR-210 (miR-210KO) exhibit a dramatic 2 hrs phase advance of evening anticipatory behavior. However, circadian rhythms and molecular pacemaker function are intact in miR-210KO flies under constant darkness. Furthermore, we identify that miR-210 determines the evening phase of activity through repression of the cell adhesion molecule Fasciclin 2 (Fas2). Ablation of the miR-210 binding site within the 3' UTR of Fas2 (Fas2ΔmiR-210) by CRISPR-Cas9 advances the evening phase as in miR-210KO. Indeed, miR-210 genetically interacts with Fas2. Moreover, Fas2 abundance is significantly increased in the optic lobe of miR-210KO. In addition, overexpression of Fas2 in the miR-210 expressing cells recapitulates the phase advance behavior phenotype of miR-210KO. Together, these results reveal a novel mechanism by which miR-210 regulates circadian locomotor behavior

Efficient Online Model Adaptation by Incremental Simplex Tableau

Online multi-kernel learning is promising in the era of mobile computing, in which a combined classifier with multiple kernels are offline trained, and online adapts to personalized features for serving the end user precisely and smartly. The online adaptation is mainly carried out at the end-devices, which requires the adaptation algorithms to be light, efficient and accurate. Previous results focused mainly on efficiency. This paper proposes an novel online model adaptation framework for not only efficiency but also optimal online adaptation. At first, an online optimal incremental simplex tableau (IST)algorithm is proposed, which approaches the model adaption by linear programming and produces the optimized model update in each step when a personalized training data is collected.But keeping online optimal in each step is expensive and may cause over-fitting especially when the online data is noisy. A Fast-IST approach is therefore proposed, which measures the deviation between the training data and the current model. It schedules updating only when enough deviation is detected. The efficiency of each update is further enhanced by running IST only limited iterations, which bounds the computation complexity. Theoretical analysis and extensive evaluations show that Fast-IST saves computation cost greatly, while achieving speedy and accurate model adaptation.It provides better model adaptation speed and accuracy while using even lower computing cost than the state-of-the art

Test and Simulation Study on the Static Load and Pure Longitudinal Slip Characteristics of Non-Pneumatic Tire

Compared with pneumatic tires, non-pneumatic tires have incomparable performance, in terms of load bearing and safety. In this paper, the static load characteristics and pure longitudinal slip characteristics of the non-pneumatic tire are studied by combining experiments and simulations. The test results show that the radial stiffness of the original structure is nonlinear, the pure longitudinal sliding characteristics are seriously inconsistent, the brakes are very sensitive, and the driving is slightly soft. A series of designs have been carried out from the aspects of load-bearing mode and anti-symmetry of the structure, and numerical simulations have been carried out. The results show that the radial secant stiffness of the optimized structure II is increased by 58.8%, and the radial tangent stiffness is increased by 2.96 times, under the premise of ensuring the mass reduction. Additionally, the R square is 0.9932, and the linearity of the radial stiffness curve is greatly improved. The braking and driving conditions under pure longitudinal sliding characteristics are more antisymmetric, which greatly improves the braking sensitivity, but the driving performance is not as good as the original structure. In addition, this paper establishes the evaluation index of the non-pneumatic tire carrying mode, which lays the foundation for further exploration of the non-pneumatic tire carrying mechanism