Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledge

Modern deep learning-based 3D pose estimation approaches require plenty of 3D pose annotations. However, existing 3D datasets lack diversity, which limits the performance of current methods and their generalization ability. Although existing methods utilize 2D pose annotations to help 3D pose estimation, they mainly focus on extracting 2D structural constraints from 2D poses, ignoring the 3D information hidden in the images. In this paper, we propose a novel method to extract weak 3D information directly from 2D images without 3D pose supervision. Firstly, we utilize 2D pose annotations and perspective prior knowledge to generate the relationship of that keypoint is closer or farther from the camera, called relative depth. We collect a 2D pose dataset (MCPC) and generate relative depth labels. Based on MCPC, we propose a weakly-supervised pre-training (WSP) strategy to distinguish the depth relationship between two points in an image. WSP enables the learning of the relative depth of two keypoints on lots of in-the-wild images, which is more capable of predicting depth and generalization ability for 3D human pose estimation. After fine-tuning on 3D pose datasets, WSP achieves state-of-the-art results on two widely-used benchmarks

DMIS: Dynamic Mesh-based Importance Sampling for Training Physics-Informed Neural Networks

Modeling dynamics in the form of partial differential equations (PDEs) is an effectual way to understand real-world physics processes. For complex physics systems, analytical solutions are not available and numerical solutions are widely-used. However, traditional numerical algorithms are computationally expensive and challenging in handling multiphysics systems. Recently, using neural networks to solve PDEs has made significant progress, called physics-informed neural networks (PINNs). PINNs encode physical laws into neural networks and learn the continuous solutions of PDEs. For the training of PINNs, existing methods suffer from the problems of inefficiency and unstable convergence, since the PDE residuals require calculating automatic differentiation. In this paper, we propose Dynamic Mesh-based Importance Sampling (DMIS) to tackle these problems. DMIS is a novel sampling scheme based on importance sampling, which constructs a dynamic triangular mesh to estimate sample weights efficiently. DMIS has broad applicability and can be easily integrated into existing methods. The evaluation of DMIS on three widely-used benchmarks shows that DMIS improves the convergence speed and accuracy in the meantime. Especially in solving the highly nonlinear Schr\"odinger Equation, compared with state-of-the-art methods, DMIS shows up to 46% smaller root mean square error and five times faster convergence speed. Code are available at https://github.com/MatrixBrain/DMIS.Comment: Accepted to AAAl-2

MM-NeRF: Multimodal-Guided 3D Multi-Style Transfer of Neural Radiance Field

3D style transfer aims to render stylized novel views of 3D scenes with the specified style, which requires high-quality rendering and keeping multi-view consistency. Benefiting from the ability of 3D representation from Neural Radiance Field (NeRF), existing methods learn the stylized NeRF by giving a reference style from an image. However, they suffer the challenges of high-quality stylization with texture details for multi-style transfer and stylization with multimodal guidance. In this paper, we reveal that the same objects in 3D scenes show various states (color tone, details, etc.) from different views after stylization since previous methods optimized by single-view image-based style loss functions, leading NeRF to tend to smooth texture details, further resulting in low-quality rendering. To tackle these problems, we propose a novel Multimodal-guided 3D Multi-style transfer of NeRF, termed MM-NeRF, which achieves high-quality 3D multi-style rendering with texture details and can be driven by multimodal-style guidance. First, MM-NeRF adopts a unified framework to project multimodal guidance into CLIP space and extracts multimodal style features to guide the multi-style stylization. To relieve the problem of lacking details, we propose a novel Multi-Head Learning Scheme (MLS), in which each style head predicts the parameters of the color head of NeRF. MLS decomposes the learning difficulty caused by the inconsistency of multi-style transfer and improves the quality of stylization. In addition, the MLS can generalize pre-trained MM-NeRF to any new styles by adding heads with small training costs (a few minutes). Extensive experiments on three real-world 3D scene datasets show that MM-NeRF achieves high-quality 3D multi-style stylization with multimodal guidance, keeps multi-view consistency, and keeps semantic consistency of multimodal style guidance. Codes will be released later

Spatial Heterogeneity of Soil and Vegetation Characteristics and Soil-Vegetation Relationships along an Ecotone in Southern Mu Us Sandy Land, China

Spatial pattern analysis is an essential component of spatial heterogeneity studies on soil properties and vegetation characteristics. It was conducted in several studies for both soil and vegetation characteristics (Strand et al., 2007; Dick and Gilliam, 2007; Zuo et al., 2010). This study aims to examine the changes in the spatial heterogeneity of soil properties at different soil layers, the spatial heterogeneity of soil and vegetation characteristics along an ecotone, and soil-vegetation relationships along the ecotone in a critical area of desertification

Overexpression of SIRT1 in Mouse Forebrain Impairs Lipid/Glucose Metabolism and Motor Function

SIRT1 plays crucial roles in glucose and lipid metabolism, and has various functions in different tissues including brain. The brain-specific SIRT1 knockout mice display defects in somatotropic signaling, memory and synaptic plasticity. And the female mice without SIRT1 in POMC neuron are more sensitive to diet-induced obesity. Here we created transgenic mice overexpressing SIRT1 in striatum and hippocampus under the control of CaMKIIα promoter. These mice, especially females, exhibited increased fat accumulation accompanied by significant upregulation of adipogenic genes in white adipose tissue. Glucose tolerance of the mice was also impaired with decreased Glut4 mRNA levels in muscle. Moreover, the SIRT1 overexpressing mice showed decreased energy expenditure, and concomitantly mitochondria-related genes were decreased in muscle. In addition, these mice showed unusual spontaneous physical activity pattern, decreased activity in open field and rotarod performance. Further studies demonstrated that SIRT1 deacetylated IRS-2, and upregulated phosphorylation level of IRS-2 and ERK1/2 in striatum. Meanwhile, the neurotransmitter signaling in striatum and the expression of endocrine hormones in hypothalamus and serum T3, T4 levels were altered. Taken together, our findings demonstrate that SIRT1 in forebrain regulates lipid/glucose metabolism and motor function

Cirrhosis Classification Based on Texture Classification of Random Features

Accurate staging of hepatic cirrhosis is important in investigating the cause and slowing down the effects of cirrhosis. Computer-aided diagnosis (CAD) can provide doctors with an alternative second opinion and assist them to make a specific treatment with accurate cirrhosis stage. MRI has many advantages, including high resolution for soft tissue, no radiation, and multiparameters imaging modalities. So in this paper, multisequences MRIs, including T1-weighted, T2-weighted, arterial, portal venous, and equilibrium phase, are applied. However, CAD does not meet the clinical needs of cirrhosis and few researchers are concerned with it at present. Cirrhosis is characterized by the presence of widespread fibrosis and regenerative nodules in the hepatic, leading to different texture patterns of different stages. So, extracting texture feature is the primary task. Compared with typical gray level cooccurrence matrix (GLCM) features, texture classification from random features provides an effective way, and we adopt it and propose CCTCRF for triple classification (normal, early, and middle and advanced stage). CCTCRF does not need strong assumptions except the sparse character of image, contains sufficient texture information, includes concise and effective process, and makes case decision with high accuracy. Experimental results also illustrate the satisfying performance and they are also compared with typical NN with GLCM

Desertification Reversal Promotes the Complexity of Plant Community by Increasing Plant Species Diversity of Each Plant Functional Type

Desertification reversal is globally significant for the sustainable development of land resources. However, the mechanisms of desertification reversal at the level of plant community are still unclear. We hypothesized that desertification reversal has clear effects on plant community composition, plant functional types (PFTs), and other vegetation characteristics, including plant diversity and biomass, and their changes in the early stages of reversal are more dramatic than in later stages. We investigated the vegetation of four to five different stages of desertification reversal at each of seven large study sites in southwestern Mu Us Sandy Land, China. The results show that the dominant species in very severe desertification areas were replaced by perennial grasses in potential desertification areas. The importance values of annual forbs and perennial sub-shrubs decreased dramatically (from 42.59 and 32.98 to 22.13 and 5.54, respectively), whereas those of perennial grasses and perennial forbs increased prominently (from 13.26 and 2.71 to 53.94 and 11.79, respectively) with the reversal of desertification. Desertification reversal increased the complexity of plant community composition by increasing plant species in each PFT, and C3 plants replaced C4 plants to become the dominant PFT with reversal. Plant species richness and species diversity rose overall, and aboveground plant biomass significantly (p < 0.05) increased with the reversal of desertification. Most vegetation characteristics changed more strikingly in the early stages of desertification reversal than in later stages. Our results indicate that the type and composition of the plant community were dramatically affected by desertification reversal. Anthropogenic measures are more applicable to being employed in early stages than in later stages, and Amaranthaceae C4 plants are suggested to be planted in mobile dunes for the acceleration of desertification reversal. This study is useful for designing strategies of land management and ecological restoration in arid and semiarid regions

A Hybrid Approach to Protect Palmprint Templates

Biometric template protection is indispensable to protect personal privacy in large-scale deployment of biometric systems. Accuracy, changeability, and security are three critical requirements for template protection algorithms. However, existing template protection algorithms cannot satisfy all these requirements well. In this paper, we propose a hybrid approach that combines random projection and fuzzy vault to improve the performances at these three points. Heterogeneous space is designed for combining random projection and fuzzy vault properly in the hybrid scheme. New chaff point generation method is also proposed to enhance the security of the heterogeneous vault. Theoretical analyses of proposed hybrid approach in terms of accuracy, changeability, and security are given in this paper. Palmprint database based experimental results well support the theoretical analyses and demonstrate the effectiveness of proposed hybrid approach

Chronic jet lag alters gut microbiome and mycobiome and promotes the progression of MAFLD in HFHFD-fed mice

Metabolic dysfunction-associated fatty liver disease (MAFLD) is the most common chronic liver disease worldwide. Circadian disruptors, such as chronic jet lag (CJ), may be new risk factors for MAFLD development. However, the roles of CJ on MAFLD are insufficiently understood, with mechanisms remaining elusive. Studies suggest a link between gut microbiome dysbiosis and MAFLD, but most of the studies are mainly focused on gut bacteria, ignoring other components of gut microbes, such as gut fungi (mycobiome), and few studies have addressed the rhythm of the gut fungi. This study explored the effects of CJ on MAFLD and its related microbiotic and mycobiotic mechanisms in mice fed a high fat and high fructose diet (HFHFD). Forty-eight C57BL6J male mice were divided into four groups: mice on a normal diet exposed to a normal circadian cycle (ND-NC), mice on a normal diet subjected to CJ (ND-CJ), mice on a HFHFD exposed to a normal circadian cycle (HFHFD-NC), and mice on a HFHFD subjected to CJ (HFHFD-CJ). After 16 weeks, the composition and rhythm of microbiota and mycobiome in colon contents were compared among groups. The results showed that CJ exacerbated hepatic steatohepatitis in the HFHFD-fed mice. Compared with HFHFD-NC mice, HFHFD-CJ mice had increases in Aspergillus, Blumeria and lower abundances of Akkermansia, Lactococcus, Prevotella, Clostridium, Bifidobacterium, Wickerhamomyces, and Saccharomycopsis genera. The fungi-bacterial interaction network became more complex after HFHFD and/or CJ interventions. The study revealed that CJ altered the composition and structure of the gut bacteria and fungi, disrupted the rhythmic oscillation of the gut microbiota and mycobiome, affected interactions among the gut microbiome, and promoted the progression of MAFLD in HFHFD mice