72 research outputs found
Design of Virtual Anchor Based on 3Dmax
With the rapid development of virtual reality and live streaming technologies, virtual anchors have become increasingly popular in recent years. In this paper, we propose a design method of virtual anchors based on 3DMAX. Through the use of modeling, rigging, and animation techniques, virtual anchors with realistic appearances and human-like movements can be created. We also explore the application of machine learning technologies in improving the interaction between virtual anchors and users. In addition, we provide a case study on the design and implementation of a virtual anchor for a popular live streaming platform. Our results show that the use of 3DMAX in virtual anchor design can greatly enhance user engagement and improve the overall user experience.Virtual anchor design technology based on 3DMAX is a highly complex design work, which requires designers to have a variety of skills and creative capabilities, and needs to fully consider the needs of the audience and the development trend of the industry. Designers should also have certain cultural accumulation and creative ability, and be able to design an attractive and valuable virtual anchor image from the perspective of the audience.This paper analyzes the production and design of the current virtual anchors, in order to provide some reference significance for the production, operation and commercial realization of the virtual anchors in the future
Diffusion Models for Multi-target Adversarial Tracking
Target tracking plays a crucial role in real-world scenarios, particularly in
drug-trafficking interdiction, where the knowledge of an adversarial target's
location is often limited. Improving autonomous tracking systems will enable
unmanned aerial, surface, and underwater vehicles to better assist in
interdicting smugglers that use manned surface, semi-submersible, and aerial
vessels. As unmanned drones proliferate, accurate autonomous target estimation
is even more crucial for security and safety. This paper presents Constrained
Agent-based Diffusion for Enhanced Multi-Agent Tracking (CADENCE), an approach
aimed at generating comprehensive predictions of adversary locations by
leveraging past sparse state information. To assess the effectiveness of this
approach, we evaluate predictions on single-target and multi-target pursuit
environments, employing Monte-Carlo sampling of the diffusion model to estimate
the probability associated with each generated trajectory. We propose a novel
cross-attention based diffusion model that utilizes constraint-based sampling
to generate multimodal track hypotheses. Our single-target model surpasses the
performance of all baseline methods on Average Displacement Error (ADE) for
predictions across all time horizons
AnchorFace: An Anchor-based Facial Landmark Detector Across Large Poses
Facial landmark localization aims to detect the predefined points of human
faces, and the topic has been rapidly improved with the recent development of
neural network based methods. However, it remains a challenging task when
dealing with faces in unconstrained scenarios, especially with large pose
variations. In this paper, we target the problem of facial landmark
localization across large poses and address this task based on a
split-and-aggregate strategy. To split the search space, we propose a set of
anchor templates as references for regression, which well addresses the large
variations of face poses. Based on the prediction of each anchor template, we
propose to aggregate the results, which can reduce the landmark uncertainty due
to the large poses. Overall, our proposed approach, named AnchorFace, obtains
state-of-the-art results with extremely efficient inference speed on four
challenging benchmarks, i.e. AFLW, 300W, Menpo, and WFLW dataset. Code will be
available at https://github.com/nothingelse92/AnchorFace.Comment: To appear in AAAI 202
Pythagoras Superposition Principle for Localized Eigenstates of 2D Moir\'e Lattices
Moir\'e lattices are aperiodic systems formed by a superposition of two
periodic lattices with a relative rotational angle. In optics, the photonic
moir\'e lattice has many promising mysteries such as its ability to localize
light, thus attracting much attention to exploring features of such a
structure. One fundamental research area for photonic moir\'e lattices is the
properties of eigenstates, particularly the existence of localized eigenstates
and the localization-to-delocalization transition in the energy band structure.
Here we propose an accurate algorithm for the eigenproblems of aperiodic
systems by combining plane wave discretization and spectral indicator
validation under the higher-dimensional projection, allowing us to explore
energy bands of fully aperiodic systems. A localization-delocalization
transition regarding the intensity of the aperiodic potential is observed and a
novel Pythagoras superposition principle for localized eigenstates of 2D
moir\'e lattices is revealed by analyzing the relationship between the
aperiodic and its corresponding periodic eigenstates. This principle sheds
light on exploring the physics of localizations for moir\'e lattice.Comment: 7 pages, 3 figure
Importance-aware Co-teaching for Offline Model-based Optimization
Offline model-based optimization aims to find a design that maximizes a
property of interest using only an offline dataset, with applications in robot,
protein, and molecule design, among others. A prevalent approach is gradient
ascent, where a proxy model is trained on the offline dataset and then used to
optimize the design. This method suffers from an out-of-distribution issue,
where the proxy is not accurate for unseen designs. To mitigate this issue, we
explore using a pseudo-labeler to generate valuable data for fine-tuning the
proxy. Specifically, we propose \textit{\textbf{I}mportance-aware
\textbf{C}o-\textbf{T}eaching for Offline Model-based
Optimization}~(\textbf{ICT}). This method maintains three symmetric proxies
with their mean ensemble as the final proxy, and comprises two steps. The first
step is \textit{pseudo-label-driven co-teaching}. In this step, one proxy is
iteratively selected as the pseudo-labeler for designs near the current
optimization point, generating pseudo-labeled data. Subsequently, a co-teaching
process identifies small-loss samples as valuable data and exchanges them
between the other two proxies for fine-tuning, promoting knowledge transfer.
This procedure is repeated three times, with a different proxy chosen as the
pseudo-labeler each time, ultimately enhancing the ensemble performance. To
further improve accuracy of pseudo-labels, we perform a secondary step of
\textit{meta-learning-based sample reweighting}, which assigns importance
weights to samples in the pseudo-labeled dataset and updates them via
meta-learning. ICT achieves state-of-the-art results across multiple
design-bench tasks, achieving the best mean rank of and median rank of
, among methods. Our source code can be found here.Comment: Accepted by NeurIPS 202
Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control
With the recent advances in mobile energy storage technologies, electric
vehicles (EVs) have become a crucial part of smart grids. When EVs participate
in the demand response program, the charging cost can be significantly reduced
by taking full advantage of the real-time pricing signals. However, many
stochastic factors exist in the dynamic environment, bringing significant
challenges to design an optimal charging/discharging control strategy. This
paper develops an optimal EV charging/discharging control strategy for
different EV users under dynamic environments to maximize EV users' benefits.
We first formulate this problem as a Markov decision process (MDP). Then we
consider EV users with different behaviors as agents in different environments.
Furthermore, a horizontal federated reinforcement learning (HFRL)-based method
is proposed to fit various users' behaviors and dynamic environments. This
approach can learn an optimal charging/discharging control strategy without
sharing users' profiles. Simulation results illustrate that the proposed
real-time EV charging/discharging control strategy can perform well among
various stochastic factors
Infusing Definiteness into Randomness: Rethinking Composition Styles for Deep Image Matting
We study the composition style in deep image matting, a notion that
characterizes a data generation flow on how to exploit limited foregrounds and
random backgrounds to form a training dataset. Prior art executes this flow in
a completely random manner by simply going through the foreground pool or by
optionally combining two foregrounds before foreground-background composition.
In this work, we first show that naive foreground combination can be
problematic and therefore derive an alternative formulation to reasonably
combine foregrounds. Our second contribution is an observation that matting
performance can benefit from a certain occurrence frequency of combined
foregrounds and their associated source foregrounds during training. Inspired
by this, we introduce a novel composition style that binds the source and
combined foregrounds in a definite triplet. In addition, we also find that
different orders of foreground combination lead to different foreground
patterns, which further inspires a quadruplet-based composition style. Results
under controlled experiments on four matting baselines show that our
composition styles outperform existing ones and invite consistent performance
improvement on both composited and real-world datasets. Code is available at:
https://github.com/coconuthust/composition_stylesComment: Accepted to AAAI 2023; 11 pages, 9 figures; Code is available at
https://github.com/coconuthust/composition_style
Observation of Berry curvature in non-Hermitian system from far-field radiation
Berry curvature that describes local geometrical properties of energy bands
can elucidate many fascinating phenomena in solid-state, photonic, and phononic
systems, given its connection to global topological invariants such as the
Chern number. Despite its significance, the observation of Berry curvature
poses a substantial challenging since wavefunctions are deeply embedded within
the system. Here, we theoretically propose a correspondence between the
geometry of far-field radiation and the underneath band topology of
non-Hermitian systems, thus providing a general method to fully capture the
Berry curvature without strongly disturbing the eigenstates. We further
experimentally observe the Berry curvature in a honeycomb photonic crystal slab
from polarimetry measurements and quantitatively obtain the non-trivial valley
Chern number. Our work reveals the feasibility of retrieving the bulk band
topology from escaping photons and paves the way to exploring intriguing
topological landscapes in non-Hermitian systems
- …