69 research outputs found

    LangSplat: 3D Language Gaussian Splatting

    Full text link
    Humans live in a 3D world and commonly use natural language to interact with a 3D scene. Modeling a 3D language field to support open-ended language queries in 3D has gained increasing attention recently. This paper introduces LangSplat, which constructs a 3D language field that enables precise and efficient open-vocabulary querying within 3D spaces. Unlike existing methods that ground CLIP language embeddings in a NeRF model, LangSplat advances the field by utilizing a collection of 3D Gaussians, each encoding language features distilled from CLIP, to represent the language field. By employing a tile-based splatting technique for rendering language features, we circumvent the costly rendering process inherent in NeRF. Instead of directly learning CLIP embeddings, LangSplat first trains a scene-wise language autoencoder and then learns language features on the scene-specific latent space, thereby alleviating substantial memory demands imposed by explicit modeling. Existing methods struggle with imprecise and vague 3D language fields, which fail to discern clear boundaries between objects. We delve into this issue and propose to learn hierarchical semantics using SAM, thereby eliminating the need for extensively querying the language field across various scales and the regularization of DINO features. Extensive experimental results show that LangSplat significantly outperforms the previous state-of-the-art method LERF by a large margin. Notably, LangSplat is extremely efficient, achieving a 199 ×\times speedup compared to LERF at the resolution of 1440 ×\times 1080. We strongly recommend readers to check out our video results at https://langsplat.github.io/Comment: CVPR 2024. Project Page: https://langsplat.github.i

    Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatars

    Full text link
    Neural radiance fields are capable of reconstructing high-quality drivable human avatars but are expensive to train and render. To reduce consumption, we propose Animatable 3D Gaussian, which learns human avatars from input images and poses. We extend 3D Gaussians to dynamic human scenes by modeling a set of skinned 3D Gaussians and a corresponding skeleton in canonical space and deforming 3D Gaussians to posed space according to the input poses. We introduce hash-encoded shape and appearance to speed up training and propose time-dependent ambient occlusion to achieve high-quality reconstructions in scenes containing complex motions and dynamic shadows. On both novel view synthesis and novel pose synthesis tasks, our method outperforms existing methods in terms of training time, rendering speed, and reconstruction quality. Our method can be easily extended to multi-human scenes and achieve comparable novel view synthesis results on a scene with ten people in only 25 seconds of training

    High-Fidelity 3D Head Avatars Reconstruction through Spatially-Varying Expression Conditioned Neural Radiance Field

    Full text link
    One crucial aspect of 3D head avatar reconstruction lies in the details of facial expressions. Although recent NeRF-based photo-realistic 3D head avatar methods achieve high-quality avatar rendering, they still encounter challenges retaining intricate facial expression details because they overlook the potential of specific expression variations at different spatial positions when conditioning the radiance field. Motivated by this observation, we introduce a novel Spatially-Varying Expression (SVE) conditioning. The SVE can be obtained by a simple MLP-based generation network, encompassing both spatial positional features and global expression information. Benefiting from rich and diverse information of the SVE at different positions, the proposed SVE-conditioned neural radiance field can deal with intricate facial expressions and achieve realistic rendering and geometry details of high-fidelity 3D head avatars. Additionally, to further elevate the geometric and rendering quality, we introduce a new coarse-to-fine training strategy, including a geometry initialization strategy at the coarse stage and an adaptive importance sampling strategy at the fine stage. Extensive experiments indicate that our method outperforms other state-of-the-art (SOTA) methods in rendering and geometry quality on mobile phone-collected and public datasets.Comment: 9 pages, 5 figure

    Generate, Filter, and Fuse: Query Expansion via Multi-Step Keyword Generation for Zero-Shot Neural Rankers

    Full text link
    Query expansion has been proved to be effective in improving recall and precision of first-stage retrievers, and yet its influence on a complicated, state-of-the-art cross-encoder ranker remains under-explored. We first show that directly applying the expansion techniques in the current literature to state-of-the-art neural rankers can result in deteriorated zero-shot performance. To this end, we propose GFF, a pipeline that includes a large language model and a neural ranker, to Generate, Filter, and Fuse query expansions more effectively in order to improve the zero-shot ranking metrics such as nDCG@10. Specifically, GFF first calls an instruction-following language model to generate query-related keywords through a reasoning chain. Leveraging self-consistency and reciprocal rank weighting, GFF further filters and combines the ranking results of each expanded query dynamically. By utilizing this pipeline, we show that GFF can improve the zero-shot nDCG@10 on BEIR and TREC DL 2019/2020. We also analyze different modelling choices in the GFF pipeline and shed light on the future directions in query expansion for zero-shot neural rankers

    Experimental Investigation on OSB Webbed Laminated Bamboo Lumber Box Shaped Joists

    Get PDF
    A novel bamboo-wood box beam was introduced in this paper, which consisted of laminated bamboo lumber flanges and OSB webs. Four-point bending tests were conducted on composite beams to investigate the effects of shear span ratio and stiffeners on failure mode and strength. The results showed that the composite beams with shear span ratio less than two failed in web shear failure, but for the others, the beams failed in twist and delamination of OSB in flanges. The load carrying capacity of beams decreased with the increase of shear span ratio. However, the mechanical performance of beams can be improved moderately by the presence of stiffeners, and theultimate bearing capacity and initial stiffness was increased by 16.5% and 13.1% respectively

    Genome-wide DNA methylation profiling in blood reveals epigenetic signature of incident acute coronary syndrome

    Get PDF
    DNA methylation (DNAm) has been implicated in acute coronary syndrome (ACS), but the causality remains unclear in cross-sectional studies. Here, we conduct a prospective epigenome-wide association study of incident ACS in two Chinese cohorts (discovery: 751 nested case-control pairs; replication: 476 nested case-control pairs). We identified and validated 26 differentially methylated positions (DMPs, false discovery rate [FDR] <0.05), including three mapped to known cardiovascular disease genes (PRKCZ, PRDM16, EHBP1L1) and four with causal evidence from Mendelian randomization (PRKCZ, TRIM27, EMC2, EHBP1L1). Two hypomethylated DMPs were negatively correlated with the expression in blood of their mapped genes (PIGG and EHBP1L1), which were further found to overexpress in leukocytes and/or atheroma plaques. Finally, our DMPs could substantially improve the prediction of ACS over traditional risk factors and polygenic scores. These findings demonstrate the importance of DNAm in the pathogenesis of ACS and highlight DNAm as potential predictive biomarkers and treatment targets

    Study on Preparation and Properties of La

    No full text
    Solid Oxide Fuel Cells (SOFCs) can convert chemical energy into electrical energy, with high energy conversion rate, safe operation, no pollutant emissions, and is one of the most potential new energy power generation devices in the future. However, at low and medium temperature (below 800℃), the cathode impedance of SOFCs will increase sharply, resulting in adverse effects on cell performance. Finding cathode materials that can work at low and medium temperature is the key to realize large-scale commercial application of SOFCs. LSCF cathode material is one of the commonly used cathode materials for solid oxide fuel cells because of its excellent electronic and ionic conductivity. However, its cathode performance cannot meet the requirements of commercial applications. At high temperature, solid-state reactions are easy to occur between LSCF and commonly used electrolyte materials such as YSZ, SSZ and LSGM, resulting in the formation of an intermediate phase that is not conducive to Oxygen Reduction Reaction (ORR). In this paper, LSCF and Gd0.2Ce0.8O2 (GDC) were combined by ball milling to prepare composite cathode. XRD test found that the two powders mixed at high temperature did not produce new substances, with good chemical compatibility. The electrical conductivity test showed that the electrical conductivity of the composite LSCF decreased significantly from 227 Sꞏcm-2 at 650℃ to 115, 90 and 77 Sꞏcm-2 at 550℃, respectively. The composite cathode with a composite ratio of 6:4 has the lowest polarization impedance, only 0.10 Ωꞏcm2 at 800℃. The discharge test shows that the cathode with the mass ratio of 6:4 LSCF to GDC has the best performance, and the power density is 328 and 256 mW/cm2 at 800 and 750℃, respectively. The performance of the cathode has good stability after working for 50h

    Alteration of lipid profile and value of lipids in the prediction of the length of hospital stay in COVID-19 pneumonia patients

    No full text
    To observe lipid profiles and their alterations in hospitalized patients with COVID-19 pneumonia (NCP) and evaluate the value of lipids for the prediction of the length of hospital stay (LOS), a total of 248 patients aged 18 years or older were enrolled in this retrospective study. At admission, the median levels of triglyceride (TG), total cholesterol (TC), high-density lipoprotein cholesterol (HDL-C), and low-density lipoprotein cholesterol (LDL-C) in all patients were 1.11, 4.00, 0.89, and 2.11 mmol/L, respectively. Compared with common cases (n = 174), severe cases (n = 74) exhibited higher TG and HDL-C, and lower LDL-C. Levels of TC and LDL-C were negatively correlated with LOS. In 68 severe cases, serum lipids were followed up during hospitalization, and the median LOS was 29 days. The average levels of serum lipids were lowest at admission and gradually increased during hospitalization. Compared with the LOS ≤ 29 days group, serum levels of TC, HDL-C, and LDL-C were significantly lower in the LOS &gt; 29 days group at admission; this lower trend was found in the subsequent tests for TC and LDL-C but not for HDL-C or TG. Multiple-variant COX regression showed that levels of TC or LDL-C at admission were independent risk of LOS prolongation. Together, these findings suggest that in patients with NCP, levels of TC and LDL-C at admission were negatively correlated with LOS. In severe cases, the gradual increase in TC, LDL-C, and HDL-C during hospitalization might indicate gradual recovery. TC &lt; 3.75 mmol/L or LDL-C &lt; 1.7 mmol/L at admission may act as an independent predictor of prolonged LOS

    Experimental Investigation on OSB Webbed Laminated Bamboo Lumber Box Shaped Joists

    No full text
    A novel bamboo-wood box beam was introduced in this paper, which consisted of laminated bamboo lumber flanges and OSB webs. Four-point bending tests were conducted on composite beams to investigate the effects of shear span ratio and stiffeners on failure mode and strength. The results showed that the composite beams with shear span ratio less than two failed in web shear failure, but for the others, the beams failed in twist and delamination of OSB in flanges. The load carrying capacity of beams decreased with the increase of shear span ratio. However, the mechanical performance of beams can be improved moderately by the presence of stiffeners, and theultimate bearing capacity and initial stiffness was increased by 16.5% and 13.1% respectively

    Effects of legacy and emerging per- and polyfluoroalkyl substances on PPARα/β/γ regulation and osteogenic/adipogenic differentiation

    No full text
    As the primary molecular target, there is still a gap between the peroxisome proliferator-activated receptors (PPARs) regulation and the adverse health effects caused by per- and polyfluoroalkyl substances (PFASs). The effects of PFASs on cellular differentiation regulated by PPARs is likely significant given the association of PFASs exposure with obesity and decreased bone density. Human mesenchymal stem cells (hMSCs) were used as an in vitro model to assess the roles of PPAR subtypes in the multipotent differentiation of hMSCs affected by perfluorooctanesulfonate (PFOS), perfluorooctanoic acid (PFOA) and their replacement compounds. PFASs increased the expression of three PPAR subtypes in proliferating and differentiating hMSCs. Meanwhile, PFOS and PFOA decreased osteogenesis, enhanced adipogenesis, and increased bone turnover in hMSCs. Similarly, PFOA alternatives, hexafluoropropylene oxide dimer acid (HFPO-DA) and hexafluoropropylene oxide trimer acid (HFPO-TA), exhibited similar or even higher potency in affecting stem cell differentiation compared with PFOA. Perfluorohexanesulfonate (PFHxS) inhibited osteogenesis with comparable potency to PFOS. In contrast, 6:2 chlorinated poly-fluoroalkyl ether sulfonate (6:2Cl-PFESA) enhanced osteogenesis. PPARβ expression is significantly positively correlated with osteogenesis and osteoprotegerin (OPG) secretion in 6:2Cl-PFESA treated cells. shRNA knockdown of PPARβ remarkably reversed the osteogenic effects of 6:2Cl-PFESA and enhanced the adipogenic effects of the six chemicals. The results suggested that the adverse effects and relative potency of PFASs on the multipotent differentiation of hMSCs were dependent on the integrated action of the three PPAR subtypes, which facilitates a better understanding of the molecular initiating events of PFASs. The present study may well explain the mechanism of the decreased bone density and increased obesity incidence among those exposed to legacy PFASs, and indicates the necessity of further health risk assessment for the alternatives
    corecore