49 research outputs found

    MA-NeRF: Motion-Assisted Neural Radiance Fields for Face Synthesis from Sparse Images

    Full text link
    We address the problem of photorealistic 3D face avatar synthesis from sparse images. Existing Parametric models for face avatar reconstruction struggle to generate details that originate from inputs. Meanwhile, although current NeRF-based avatar methods provide promising results for novel view synthesis, they fail to generalize well for unseen expressions. We improve from NeRF and propose a novel framework that, by leveraging the parametric 3DMM models, can reconstruct a high-fidelity drivable face avatar and successfully handle the unseen expressions. At the core of our implementation are structured displacement feature and semantic-aware learning module. Our structured displacement feature will introduce the motion prior as an additional constraints and help perform better for unseen expressions, by constructing displacement volume. Besides, the semantic-aware learning incorporates multi-level prior, e.g., semantic embedding, learnable latent code, to lift the performance to a higher level. Thorough experiments have been doen both quantitatively and qualitatively to demonstrate the design of our framework, and our method achieves much better results than the current state-of-the-arts

    Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters

    Full text link
    Recently, Large Language Models (LLMs) have achieved amazing zero-shot learning performance over a variety of Natural Language Processing (NLP) tasks, especially for text generative tasks. Yet, the large size of LLMs often leads to the high computational cost of model training and online deployment. In our work, we present ALTER, a system that effectively builds the multi-tAsk Learners with mixTure-of-task-adaptERs upon small language models (with <1B parameters) to address multiple NLP tasks simultaneously, capturing the commonalities and differences between tasks, in order to support domain-specific applications. Specifically, in ALTER, we propose the Mixture-of-Task-Adapters (MTA) module as an extension to the transformer architecture for the underlying model to capture the intra-task and inter-task knowledge. A two-stage training method is further proposed to optimize the collaboration between adapters at a small computational cost. Experimental results over a mixture of NLP tasks show that our proposed MTA architecture and the two-stage training method achieve good performance. Based on ALTER, we have also produced MTA-equipped language models for various domains

    Facilitating Self-monitored Physical Rehabilitation with Virtual Reality and Haptic feedback

    Full text link
    Physical rehabilitation is essential to recovery from joint replacement operations. As a representation, total knee arthroplasty (TKA) requires patients to conduct intensive physical exercises to regain the knee's range of motion and muscle strength. However, current joint replacement physical rehabilitation methods rely highly on therapists for supervision, and existing computer-assisted systems lack consideration for enabling self-monitoring, making at-home physical rehabilitation difficult. In this paper, we investigated design recommendations that would enable self-monitored rehabilitation through clinical observations and focus group interviews with doctors and therapists. With this knowledge, we further explored Virtual Reality(VR)-based visual presentation and supplemental haptic motion guidance features in our implementation VReHab, a self-monitored and multimodal physical rehabilitation system with VR and vibrotactile and pneumatic feedback in a TKA rehabilitation context. We found that the third point of view real-time reconstructed motion on a virtual avatar overlaid with the target pose effectively provides motion awareness and guidance while haptic feedback helps enhance users' motion accuracy and stability. Finally, we implemented \systemname to facilitate self-monitored post-operative exercises and validated its effectiveness through a clinical study with 10 patients

    Progress of regulatory RNA in small extracellular vesicles in colorectal cancer

    Get PDF
    Colorectal cancer (CRC) is the second most common malignant tumor of the gastrointestinal tract with the second highest mortality rate and the third highest incidence rate. Early diagnosis and treatment are important measures to reduce CRC mortality. Small extracellular vesicles (sEVs) have emerged as key mediators that facilitate communication between tumor cells and various other cells, playing a significant role in the growth, invasion, and metastasis of cancer cells. Regulatory RNAs have been identified as potential biomarkers for early diagnosis and prognosis of CRC, serving as crucial factors in promoting CRC cell proliferation, invasion and metastasis, angiogenesis, drug resistance, and immune cell differentiation. This review provides a comprehensive summary of the vital role of sEVs as biomarkers in CRC diagnosis and their potential application in CRC treatment, highlighting their importance as a promising avenue for further research and clinical translation

    A secretory hexokinase plays an active role in the proliferation of Nosema bombycis

    Get PDF
    The microsporidian Nosema bombycis is an obligate intracellular parasite of Bombyx mori, that lost its intact tricarboxylic acid cycle and mitochondria during evolution but retained its intact glycolysis pathway. N. bombycis hexokinase (NbHK) is not only a rate-limiting enzyme of glycolysis but also a secretory protein. Indirect immunofluorescence assays and recombinant HK overexpressed in BmN cells showed that NbHK localized in the nucleus and cytoplasm of host cell during the meront stage. When N. bombycis matured, NbHK tended to concentrate at the nuclei of host cells. Furthermore, the transcriptional profile of NbHK implied it functioned during N. bombycis’ proliferation stages. A knock-down of NbHK effectively suppressed the proliferation of N. bombycis indicating that NbHK is an important protein for parasite to control its host

    Fractional-Order PD Attitude Control for a Type of Spacecraft with Flexible Appendages

    No full text
    As large-sized spacecraft have been developed, they have been equipped with flexible appendages, such as solar cell plates and mechanical flexible arms. The attitude control of spacecraft with flexible appendages has become more complex, with higher requirements. In this paper, a fractional-order PD attitude control method for a type of spacecraft with flexible appendages is presented. Firstly, a lumped parameter model of a spacecraft with flexible appendages is constructed, which provides the transfer function of the attitude angle and external moment. Then, a design method for the fractional-order PD controller for the attitude control of a spacecraft with flexible appendages is provided. Based on the designed steps, a numerical example is provided to compare the control performances between the fractional-order and integer-order PD controllers. Finally, the obtained numerical results are presented to verify the effectiveness of the proposed control method

    Automatic Generation of 3D Indoor Navigation Networks from Building Information Modeling Data Using Image Thinning

    No full text
    Navigation networks are a common form of indoor map that provide the basis for a wide range of indoor location-based services, intelligent tasks for indoor robots, and three-dimensional (3D) geographic information systems. The majority of current indoor navigation networks are manually modeled, resulting in a laborious and fallible process. Building Information Modeling (BIM) captures design information, allowing for the automated generation of indoor maps. Most existing BIM-based navigation systems for floor-level wayfinding rely on well-defined spatial semantics, and do not adapt well to buildings with irregular 3D shapes, which can make cross-floor path generation difficult. This research introduces an innovative approach to generating 3D indoor navigation networks automatically from BIM data using image thinning, which is referred to as GINIT. Firstly, GINIT extracts grid-based maps for floors from BIM data using only two types of semantics, i.e., slabs and doors. Secondly, GINIT captures cross-floor paths from building components by projecting 3D forms onto a 2D image, thinning the 2D image to capture the 2D projection path, and crossing over the 2D routes with 3D routes to restore the 3D path. Finally, to demonstrate the effectiveness of GINIT, experiments were conducted on three real-world multi-floor buildings, evaluating its performance across eight types of cross-layer architectural component. GINIT overcomes the dependency of space definitions in current BIM-based navigation network generation schemes by introducing image thinning. Due to the adaptability of navigation image thinning to any binary image, GINIT is capable of generating navigation networks from building components with diverse 3D shapes. Moreover, the current studies on indoor navigation network extraction mainly use geometry theory, while this study is the first to generate 3D indoor navigation networks automatically using image thinning theory. The results of this study will offer a unique perspective and foster the exploration of imaging theory applications of BIM
    corecore