37 research outputs found
Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstruction
Reconstructing 3D clothed human avatars from single images is a challenging
task, especially when encountering complex poses and loose clothing. Current
methods exhibit limitations in performance, largely attributable to their
dependence on insufficient 2D image features and inconsistent query methods.
Owing to this, we present the Global-correlated 3D-decoupling Transformer for
clothed Avatar reconstruction (GTA), a novel transformer-based architecture
that reconstructs clothed human avatars from monocular images. Our approach
leverages transformer architectures by utilizing a Vision Transformer model as
an encoder for capturing global-correlated image features. Subsequently, our
innovative 3D-decoupling decoder employs cross-attention to decouple tri-plane
features, using learnable embeddings as queries for cross-plane generation. To
effectively enhance feature fusion with the tri-plane 3D feature and human body
prior, we propose a hybrid prior fusion strategy combining spatial and
prior-enhanced queries, leveraging the benefits of spatial localization and
human body prior knowledge. Comprehensive experiments on CAPE and THuman2.0
datasets illustrate that our method outperforms state-of-the-art approaches in
both geometry and texture reconstruction, exhibiting high robustness to
challenging poses and loose clothing, and producing higher-resolution textures.
Codes will be available at https://github.com/River-Zhang/GTA.Comment: Accepted by NeurIPS 2023. Project page:
https://river-zhang.github.io/GTA-projectpage
First Place Solution to the CVPR'2023 AQTC Challenge: A Function-Interaction Centric Approach with Spatiotemporal Visual-Language Alignment
Affordance-Centric Question-driven Task Completion (AQTC) has been proposed
to acquire knowledge from videos to furnish users with comprehensive and
systematic instructions. However, existing methods have hitherto neglected the
necessity of aligning spatiotemporal visual and linguistic signals, as well as
the crucial interactional information between humans and objects. To tackle
these limitations, we propose to combine large-scale pre-trained
vision-language and video-language models, which serve to contribute stable and
reliable multimodal data and facilitate effective spatiotemporal visual-textual
alignment. Additionally, a novel hand-object-interaction (HOI) aggregation
module is proposed which aids in capturing human-object interaction
information, thereby further augmenting the capacity to understand the
presented scenario. Our method achieved first place in the CVPR'2023 AQTC
Challenge, with a Recall@1 score of 78.7\%. The code is available at
https://github.com/tomchen-ctj/CVPR23-LOVEU-AQTC.Comment: Winner of CVPR2023 Long-form Video Understanding and Generation
Challenge (Track 3
Comparative Effects and Safety of Full-Endoscopic Versus Microscopic Spinal Decompression for Lumbar Spinal Stenosis: A Meta-Analysis and Statistical Power Analysis of 6 Randomized Controlled Trials
Objective This meta-analysis with statistical power analysis aimed to evaluate the difference between full-endoscopic and microscopic spinal decompression in treating spinal stenosis. Methods We searched PubMed, Embase, CENTRAL (Cochrane Central Register of Controlled Trials), and CNKI (China National Knowledge Infrastructure) for relevant randomized controlled trials (RCTs) regarding the comparison of full-endoscopic versus microscopic spinal decompression in treating lumbar spinal stenosis through February 28, 2022. Two independent investigators selected studies, extracted information, and appraised methodological quality. Meta-analysis was conducted using RevMan 5.4 and STATA 14.0, and statistical power analysis was performed using G*Power 3.1. Results Six RCTs involving 646 patients met selection criteria. Meta-analysis suggested that, compared with microscopic decompression, full-endoscopic spinal decompression achieved more leg pain improvement (mean difference [MD], -0.20; 95% confidence interval [CI], -0.30 to -0.10; p = 0.001), shortened operative time (MD, -12.71; 95% CI, -18.27 to -7.15; p < 0.001), and decreased the incidence of complications (risk ratio, 0.43; 95% CI, 0.22–0.82; p = 0.01), which was supported by a statistical power of 98.57%, 99.97%, and 81.88%, respectively. Conclusion Full-endoscopic spinal decompression is a better treatment for lumbar spinal stenosis, showing more effective leg pain improvement, shorter operative time, and fewer complications than microscopic decompression
Survival outcomes of stage I colorectal cancer:development and validation of the ACEPLY model using two prospective cohorts
BACKGROUND: Approximately 10% of stage I colorectal cancer (CRC) patients experience unfavorable clinical outcomes after surgery. However, little is known about the subset of stage I patients who are predisposed to high risk of recurrence or death. Previous evidence was limited by small sample sizes and lack of validation. METHODS: We aimed to identify early indicators and develop a risk stratification model to inform prognosis of stage I patients by employing two large prospective cohorts. Prognostic factors for stage II tumors, including T stage, number of nodes examined, preoperative carcinoma embryonic antigen (CEA), lymphovascular invasion, perineural invasion (PNI), and tumor grade were investigated in the discovery cohort, and significant findings were further validated in the other cohort. We adopted disease-free survival (DFS) as the primary outcome for maximum statistical power and recurrence rate and overall survival (OS) as secondary outcomes. Hazard ratios (HRs) were estimated from Cox proportional hazard models, which were subsequently utilized to develop a multivariable model to predict DFS. Predictive performance was assessed in relation to discrimination, calibration and net benefit. RESULTS: A total of 728 and 413 patients were included for discovery and validation. Overall, 6.7% and 4.1% of the patients developed recurrences during follow-up. We identified consistent significant effects of PNI and higher preoperative CEA on inferior DFS in both the discovery (PNI: HR = 4.26, 95% CI: 1.70–10.67, p = 0.002; CEA: HR = 1.46, 95% CI: 1.13–1.87, p = 0.003) and the validation analysis (PNI: HR = 3.31, 95% CI: 1.01–10.89, p = 0.049; CEA: HR = 1.58, 95% CI: 1.10–2.28, p = 0.014). They were also significantly associated with recurrence rate. Age at diagnosis was a prominent determinant of OS. A prediction model on DFS using Age at diagnosis, CEA, PNI, and number of LYmph nodes examined (ACEPLY) showed significant discriminative performance (C-index: 0.69, 95% CI:0.60–0.77) in the external validation cohort. Decision curve analysis demonstrated added clinical benefit of applying the model for risk stratification. CONCLUSIONS: PNI and preoperative CEA are useful indicators for inferior survival outcomes of stage I CRC. Identification of stage I patients at high risk of recurrence is feasible using the ACEPLY model, although the predictive performance is yet to be improved. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12916-022-02693-7
Co-infusion of haplo-identical CD19-chimeric antigen receptor T cells and stem cells achieved full donor engraftment in refractory acute lymphoblastic leukemia
Abstract Background Elderly patients with relapsed and refractory acute lymphoblastic leukemia (ALL) have poor prognosis. Autologous CD19 chimeric antigen receptor-modified T (CAR-T) cells have potentials to cure patients with B cell ALL; however, safety and efficacy of allogeneic CD19 CAR-T cells are still undetermined. Case presentation We treated a 71-year-old female with relapsed and refractory ALL who received co-infusion of haplo-identical donor-derived CD19-directed CAR-T cells and mobilized peripheral blood stem cells (PBSC) following induction chemotherapy. Undetectable minimal residual disease by flow cytometry was achieved, and full donor cell engraftment was established. The transient release of cytokines and mild fever were detected. Significantly elevated serum lactate dehydrogenase, alanine transaminase, bilirubin and glutamic-oxalacetic transaminase were observed from days 14 to 18, all of which were reversible after immunosuppressive therapy. Conclusions Our preliminary results suggest that co-infusion of haplo-identical donor-derived CAR-T cells and mobilized PBSCs may induce full donor engraftment in relapsed and refractory ALL including elderly patients, but complications related to donor cell infusions should still be cautioned. Trial registration Allogeneic CART-19 for Elderly Relapsed/Refractory CD19+ ALL. NCT0279955
Forest Fire Spread Monitoring and Vegetation Dynamics Detection Based on Multi-Source Remote Sensing Images
With the increasingly severe damage wreaked by forest fires, their scientific and effective prevention and control has attracted the attention of countries worldwide. The breakthrough of remote sensing technologies implemented in the monitoring of fire spread and early warning has become the development direction for their prevention and control. However, a single remote sensing data collection point cannot simultaneously meet the temporal and spatial resolution requirements of fire spread monitoring. This can significantly affect the efficiency and timeliness of fire spread monitoring. This article focuses on the mountain fires that occurred in Muli County, on 28 March 2020, and in Jingjiu Township on 30 March 2020, in Liangshan Prefecture, Sichuan Province, as its research objects. Multi-source satellite remote sensing image data from Planet, Sentinel-2, MODIS, GF-1, GF-4, and Landsat-8 were used for fire monitoring. The spread of the fire time series was effectively and quickly obtained using the remote sensing data at various times. Fireline information and fire severity were extracted based on the calculated differenced normalized burn ratio (dNBR). This study collected the meteorological, terrain, combustibles, and human factors related to the fire. The random forest algorithm analyzed the collected data and identified the main factors, with their order of importance, that affected the spread of the two selected forest fires in Sichuan Province. Finally, the vegetation coverage before and after the fire was calculated, and the relationship between the vegetation coverage and the fire severity was analyzed. The results showed that the multi-source satellite remote sensing images can be utilized and implemented for time-evolving forest fires, enabling forest managers and firefighting agencies to plan improved firefighting actions in a timely manner and increase the effectiveness of firefighting strategies. For the forest fires in Sichuan Province studied here, the meteorological factors had the most significant impact on their spread compared with other forest fire factors. Among all variables, relative humidity was the most crucial factor affecting the spread of forest fires. The linear regression results showed that the vegetation coverage and dNBR were significantly correlated before and after the fire. The vegetation coverage recovery effects were different in the fire burned areas depending on fire severity. High vegetation recovery was associated with low-intensity burned areas. By combining the remote sensing data obtained by multi-source remote sensing satellites, accurate and macro dynamic monitoring and quantitative analysis of wildfires can be carried out. The study’s results provide effective information on the fires in Sichuan Province and can be used as a technical reference for fire spread monitoring and analysis through remote sensing, enabling accelerated emergency responses
Using Artificial Intelligence to Estimate the Probability of Forest Fires in Heilongjiang, Northeast China
Although low-intensity forest fires are a necessary part of healthy echo system, high-intensity forest fires continue to affect the diversity of forest ecosystems and species. Therefore, it is necessary to study the driving factors of forest fires and explore their possible locations and probabilities in complex forest terrain. In this article, we determined the relative influences of different types of factors on the occurrence of forest fires in Heilongjiang forest areas and compared the performance of artificial neural networks and logistic regression for wildfire prediction. By analyzing Heilongjiang forest fire data from 2002 to 2015 and constructing a model, we found that climate factors, topographical factors, and vegetation type factors play a crucial role in Heilongjiang’s wildfires. During the fire prevention period, temperature and wind speed have a more significant influence than other factors. According to the variable screening that we conducted, the model built by the variables that we used can predict 84% of forest fires in Heilongjiang Province. For recent wildfires (2019–2020) in most areas, we can use artificial neural networks for relatively accurate verification (85.2%). Therefore, artificial neural networks are very suitable for the prediction of forest fires in Heilongjiang Province. Through the prediction results, we also created a probability distribution map of fire occurrence in the study area. On this basis, we also analyzed the changes in the probability of natural fires under the weather changing trend, which can effectively aid in fire prevention and extinguishment
Flavonoid Synthesis-Related Genes Determine the Color of Flower Petals in <i>Brassica napus</i> L.
The color of rapeseed (Brassica napus L.) petal is usually yellow but can be milky-white to orange or pink. Thus, the petal color is a popular target in rapeseed breeding programs. In his study, metabolites and RNA were extracted from the yellow (Y), yellow/purple (YP), light purple (LP), and purple (P) rapeseed petals. Ultra-performance liquid chromatography-tandem mass spectrometry (UPLC-MS/MS), RNA-Seq, and quantitative real-time (qRT-PCR) analyses were performed to analyze the expression correlation of differential metabolites and differential genes. A total of 223 metabolites were identified in the petals of the three purple and yellow rapeseed varieties by UPLC-MS/MS. A total of 20511 differentially expressed genes (DEGs) between P, LP, YP, versus Y plant petals were detected. This study focused on the co-regulation of 4898 differential genes in the three comparison groups. Kyoto Encyclopedia of Genes and Genomes (KEGG) functional annotation and quantitative RT-PCR analysis showed that the expression of BnaA10g23330D (BnF3'H) affects the synthesis of downstream peonidin and delphinidin and is a key gene regulating the purple color of petals in B. napus. L. The gene may play a key role in regulating rapeseed flower color; however, further studies are needed to verify this. These results deepen our understanding of the molecular mechanisms underlying petal color and provide the theoretical and practical basis for flower breeding targeting petal color
Analysis of Factors Related to Forest Fires in Different Forest Ecosystems in China
Forests are the largest terrestrial ecosystem with major benefits in three areas: economy, ecology, and society. However, the frequent occurrence of forest fires has seriously affected the structure and function of forests. To provide a strong scientific basis for forest fire prevention and control, Ripley’s K(d) function and the LightGBM algorithm were used to determine the spatial pattern of forest fires in four different provinces (Heilongjiang, Jilin, Liaoning, Hebei) in China from 2019 to 2021 and the impact of driving factors on different ecosystems. In addition, this study also identified fire hotspots in the four provinces based on kernel density estimation (KDE). An artificial neural network model (ANN) was created to predict the probability of occurrence of forest fires in the study area. The results showed that the forest fires were spatially clustered, but the variable importance of different factors varied widely among the different forest ecosystems. Forest fires in Heilongjiang and Liaoning Provinces were mainly caused by human-driven factors. For Jilin, meteorological factors were important in the occurrence of fires. Topographic and vegetation factors exhibited the greatest importance in Hebei Province. The selected driving factors were input to the ANN model to predict the probability of fire occurrence in the four provinces. The ANN model accurately captured 93.17%, 90.28%, 83.16%, and 89.18% of the historical forest fires in Heilongjiang, Jilin, Liaoning, and Hebei Provinces; Precision, Recall, and F-measure based on the full dataset are 0.87, 0.88, and 0.87, respectively. The results of this study indicated that there were differences in the driving factors of fire in different forest ecosystems. Different fire management policies must be formulated in response to this spatial heterogeneity
Fourier Ptychographic Neural Network Combined with Zernike Aberration Recovery and Wirtinger Flow Optimization
Fourier ptychographic microscopy, as a computational imaging method, can reconstruct high-resolution images but suffers optical aberration, which affects its imaging quality. For this reason, this paper proposes a network model for simulating the forward imaging process in the Tensorflow framework using samples and coherent transfer functions as the input. The proposed model improves the introduced Wirtinger flow algorithm, retains the central idea, simplifies the calculation process, and optimizes the update through back propagation. In addition, Zernike polynomials are used to accurately estimate aberration. The simulation and experimental results show that this method can effectively improve the accuracy of aberration correction, maintain good correction performance under complex scenes, and reduce the influence of optical aberration on imaging quality