Story-to-Motion: Synthesizing Infinite and Controllable Character Animation from Long Text

Generating natural human motion from a story has the potential to transform the landscape of animation, gaming, and film industries. A new and challenging task, Story-to-Motion, arises when characters are required to move to various locations and perform specific motions based on a long text description. This task demands a fusion of low-level control (trajectories) and high-level control (motion semantics). Previous works in character control and text-to-motion have addressed related aspects, yet a comprehensive solution remains elusive: character control methods do not handle text description, whereas text-to-motion methods lack position constraints and often produce unstable motions. In light of these limitations, we propose a novel system that generates controllable, infinitely long motions and trajectories aligned with the input text. (1) We leverage contemporary Large Language Models to act as a text-driven motion scheduler to extract a series of (text, position, duration) pairs from long text. (2) We develop a text-driven motion retrieval scheme that incorporates motion matching with motion semantic and trajectory constraints. (3) We design a progressive mask transformer that addresses common artifacts in the transition motion such as unnatural pose and foot sliding. Beyond its pioneering role as the first comprehensive solution for Story-to-Motion, our system undergoes evaluation across three distinct sub-tasks: trajectory following, temporal action composition, and motion blending, where it outperforms previous state-of-the-art motion synthesis methods across the board. Homepage: https://story2motion.github.io/.Comment: 8 pages, 6 figure

SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling

Synthetic data has emerged as a promising source for 3D human research as it offers low-cost access to large-scale human datasets. To advance the diversity and annotation quality of human models, we introduce a new synthetic dataset, SynBody, with three appealing features: 1) a clothed parametric human model that can generate a diverse range of subjects; 2) the layered human representation that naturally offers high-quality 3D annotations to support multiple tasks; 3) a scalable system for producing realistic data to facilitate real-world tasks. The dataset comprises 1.2M images with corresponding accurate 3D annotations, covering 10,000 human body models, 1,187 actions, and various viewpoints. The dataset includes two subsets for human pose and shape estimation as well as human neural rendering. Extensive experiments on SynBody indicate that it substantially enhances both SMPL and SMPL-X estimation. Furthermore, the incorporation of layered annotations offers a valuable training resource for investigating the Human Neural Radiance Fields (NeRF).Comment: Accepted by ICCV 2023. Project webpage: https://synbody.github.io

Digital Life Project: Autonomous 3D Characters with Social Intelligence

In this work, we present Digital Life Project, a framework utilizing language as the universal medium to build autonomous 3D characters, who are capable of engaging in social interactions and expressing with articulated body motions, thereby simulating life in a digital environment. Our framework comprises two primary components: 1) SocioMind: a meticulously crafted digital brain that models personalities with systematic few-shot exemplars, incorporates a reflection process based on psychology principles, and emulates autonomy by initiating dialogue topics; 2) MoMat-MoGen: a text-driven motion synthesis paradigm for controlling the character's digital body. It integrates motion matching, a proven industry technique to ensure motion quality, with cutting-edge advancements in motion generation for diversity. Extensive experiments demonstrate that each module achieves state-of-the-art performance in its respective domain. Collectively, they enable virtual characters to initiate and sustain dialogues autonomously, while evolving their socio-psychological states. Concurrently, these characters can perform contextually relevant bodily movements. Additionally, a motion captioning module further allows the virtual character to recognize and appropriately respond to human players' actions. Homepage: https://digital-life-project.com/Comment: Homepage: https://digital-life-project.com

The Changing Landscape for Stroke\ua0Prevention in AF: Findings From the GLORIA-AF Registry Phase 2

Background GLORIA-AF (Global Registry on Long-Term Oral Antithrombotic Treatment in Patients with Atrial Fibrillation) is a prospective, global registry program describing antithrombotic treatment patterns in patients with newly diagnosed nonvalvular atrial fibrillation at risk of stroke. Phase 2 began when dabigatran, the first non\u2013vitamin K antagonist oral anticoagulant (NOAC), became available. Objectives This study sought to describe phase 2 baseline data and compare these with the pre-NOAC era collected during phase 1. Methods During phase 2, 15,641 consenting patients were enrolled (November 2011 to December 2014); 15,092 were eligible. This pre-specified cross-sectional analysis describes eligible patients\u2019 baseline characteristics. Atrial fibrillation disease characteristics, medical outcomes, and concomitant diseases and medications were collected. Data were analyzed using descriptive statistics. Results Of the total patients, 45.5% were female; median age was 71 (interquartile range: 64, 78) years. Patients were from Europe (47.1%), North America (22.5%), Asia (20.3%), Latin America (6.0%), and the Middle East/Africa (4.0%). Most had high stroke risk (CHA2DS2-VASc [Congestive heart failure, Hypertension, Age  6575 years, Diabetes mellitus, previous Stroke, Vascular disease, Age 65 to 74 years, Sex category] score  652; 86.1%); 13.9% had moderate risk (CHA2DS2-VASc = 1). Overall, 79.9% received oral anticoagulants, of whom 47.6% received NOAC and 32.3% vitamin K antagonists (VKA); 12.1% received antiplatelet agents; 7.8% received no antithrombotic treatment. For comparison, the proportion of phase 1 patients (of N = 1,063 all eligible) prescribed VKA was 32.8%, acetylsalicylic acid 41.7%, and no therapy 20.2%. In Europe in phase 2, treatment with NOAC was more common than VKA (52.3% and 37.8%, respectively); 6.0% of patients received antiplatelet treatment; and 3.8% received no antithrombotic treatment. In North America, 52.1%, 26.2%, and 14.0% of patients received NOAC, VKA, and antiplatelet drugs, respectively; 7.5% received no antithrombotic treatment. NOAC use was less common in Asia (27.7%), where 27.5% of patients received VKA, 25.0% antiplatelet drugs, and 19.8% no antithrombotic treatment. Conclusions The baseline data from GLORIA-AF phase 2 demonstrate that in newly diagnosed nonvalvular atrial fibrillation patients, NOAC have been highly adopted into practice, becoming more frequently prescribed than VKA in Europe and North America. Worldwide, however, a large proportion of patients remain undertreated, particularly in Asia and North America. (Global Registry on Long-Term Oral Antithrombotic Treatment in Patients With Atrial Fibrillation [GLORIA-AF]; NCT01468701

Performance Analysis of ICA in Sensor Array

As the best-known scheme in the field of Blind Source Separation (BSS), Independent Component Analysis (ICA) has been intensively used in various domains, including biomedical and acoustics applications, cooperative or non-cooperative communication, etc. While sensor arrays are involved in most of the applications, the influence on the performance of ICA of practical factors therein has not been sufficiently investigated yet. In this manuscript, the issue is researched by taking the typical antenna array as an illustrative example. Factors taken into consideration include the environment noise level, the properties of the array and that of the radiators. We analyze the analytic relationship between the noise variance, the source variance, the condition number of the mixing matrix and the optimal signal to interference-plus-noise ratio, as well as the relationship between the singularity of the mixing matrix and practical factors concerned. The situations where the mixing process turns (nearly) singular have been paid special attention to, since such circumstances are critical in applications. Results and conclusions obtained should be instructive when applying ICA algorithms on mixtures from sensor arrays. Moreover, an effective countermeasure against the cases of singular mixtures has been proposed, on the basis of previous analysis. Experiments validating the theoretical conclusions as well as the effectiveness of the proposed scheme have been included

A high-sensitivity rotatable 3D displacement sensor

Abstract Aiming at the problems of low sensitivity and low accuracy caused by the displacement transfer mechanism of three displacement sensors used simultaneously in the 3D displacement monitoring of seismic isolation bearings, the paper has proposed a high-sensitivity rotatable 3D displacement sensor. The sensor adds through holes on the surface of the equal-strength cantilever beam to form a cross beam, which increases the bending strain on the beam surface to improve the sensitivity. By adding a gyroscope and a mechanical rotation structure, a single sensor can measure the 3D displacement at the same time, reducing the adverse effects displacement transmission mechanism on the accuracy of the measurement. ANSYS software was used to simulate and optimize the parameters of the size of through-hole of the sensor beam to determine the appropriate size and location of the through-hole. Finally, the sensor was developed and its static characteristics and displacement measurement performance in static and dynamic 3D space were tested based on the simulation results. The test results have shown that the sensor has a sensitivity of 16.29 mV/mm and an accuracy of 0.9% in the range of 0–160 mm. Its static and dynamic 3D spatial displacement measurement errors are less than 2 mm, which can meet the accuracy requirements of 3D displacement measurement and sensitivity for structural health monitoring of seismic isolation bearings

Towards a Constructive Interconnection and Damping Assignment Stabilization Methodology

International audienceInterconnection and damping assignment passivity-based control (IDA-PBC) relies on the solution of a partial differential equation (PDE) that identifies the assignable storage function [10] [12], thus the difficulties in solving the PDE are usually the main stumbling block that hampers the application of IDA-PBC. The main objective of this paper is to propose a new IDA-PBC to simplify the solution of the PDE, in particular, we extend this method in the following directions. Firstly, we allow the desired interconnection and damping matrices to depend on the control signal, giving the possibility to simplify the PDE to ensure its solvability. Secondly, the PDE directly generates the control signal that has, in general, a simpler expression. Thirdly, it is applicable for general nonlinear systems possibly not affine in the control. The methodology is validated with two illustrative examples

The efficacy and safety of dexmedetomidine in cardiac surgery patients: A systematic review and meta-analysis.

This study aimed to evaluate the efficacy and safety of dexmedetomidine versus any other treatment without dexmedetomidine in patients who have undergone cardiac surgery. Electronic databases including PubMed, Embase, and Cochrane Library were systematically searched without limitations of language and publication time. Randomized controlled trials (RCTs) aiming to evaluate the efficacy and safety of dexmedetomidine versus any other treatment without dexmedetomidine in patients that have undergone cardiac surgery were selected. Endpoints such as hemodynamic indexes and adverse events in eligible studies were extracted by two researchers, independently. The data was analyzed using RevMan 5.3 and Stata 11.0 software. A total of 18 RCTs met the inclusion criteria, involving 1730 patients. Compared to control (any treatment without dexmedetomidine), dexmedetomidine showed a pooled mean difference (MD) of -14.46 [95% confidence interval(CI): -24.69, -4.23; p0.05) for atrial fibrillation, and 0.99 (95%CI: 0.51, 1.90; p>0.05) for hypotension. In addition, dexmedetomidine could reduce time of surgery and stay in intensive care units, improve delirium with good safety. Our study shows clinical application of dexmedetomidine in cardiac surgery patients can reduce risks of abnormal hemodynamics with good safety

Event-triggered output feedback control for a class of uncertain nonlinear systems

In this paper, we investigate the problem of output feedback control for a class of uncertain nonlinear systems with event-triggered input. The considered system contains not only unknown system parameters, but also general nonlinear functions that are not required to be globally Lipschitz, in contrast to most of the existing results in the area. Besides providing two different event-triggered strategies without input-to-state stable assumption with respect to the measurement errors, we propose a new way to encode and decode the event-triggered control signals to further decrease the communication rate. With our newly proposed encoding-decoding mechanism, each time when the triggering event is violated, only 1-bit signal, either 1 or 0, is rendered to transmit through the communication channel between the controller and actuator. Clearly, this signal transmission mechanism is more effective and consumes less channel bandwidth. Through Lyapunov analyses, it is proved that the boundedness of all the signals is ensured and the output signal can be regulated to a compact set around zero, which is adjustable