72 research outputs found

    Design of Virtual Anchor Based on 3Dmax

    Get PDF
    With the rapid development of virtual reality and live streaming technologies, virtual anchors have become increasingly popular in recent years. In this paper, we propose a design method of virtual anchors based on 3DMAX. Through the use of modeling, rigging, and animation techniques, virtual anchors with realistic appearances and human-like movements can be created. We also explore the application of machine learning technologies in improving the interaction between virtual anchors and users. In addition, we provide a case study on the design and implementation of a virtual anchor for a popular live streaming platform. Our results show that the use of 3DMAX in virtual anchor design can greatly enhance user engagement and improve the overall user experience.Virtual anchor design technology based on 3DMAX is a highly complex design work, which requires designers to have a variety of skills and creative capabilities, and needs to fully consider the needs of the audience and the development trend of the industry. Designers should also have certain cultural accumulation and creative ability, and be able to design an attractive and valuable virtual anchor image from the perspective of the audience.This paper analyzes the production and design of the current virtual anchors, in order to provide some reference significance for the production, operation and commercial realization of the virtual anchors in the future

    Diffusion Models for Multi-target Adversarial Tracking

    Full text link
    Target tracking plays a crucial role in real-world scenarios, particularly in drug-trafficking interdiction, where the knowledge of an adversarial target's location is often limited. Improving autonomous tracking systems will enable unmanned aerial, surface, and underwater vehicles to better assist in interdicting smugglers that use manned surface, semi-submersible, and aerial vessels. As unmanned drones proliferate, accurate autonomous target estimation is even more crucial for security and safety. This paper presents Constrained Agent-based Diffusion for Enhanced Multi-Agent Tracking (CADENCE), an approach aimed at generating comprehensive predictions of adversary locations by leveraging past sparse state information. To assess the effectiveness of this approach, we evaluate predictions on single-target and multi-target pursuit environments, employing Monte-Carlo sampling of the diffusion model to estimate the probability associated with each generated trajectory. We propose a novel cross-attention based diffusion model that utilizes constraint-based sampling to generate multimodal track hypotheses. Our single-target model surpasses the performance of all baseline methods on Average Displacement Error (ADE) for predictions across all time horizons

    AnchorFace: An Anchor-based Facial Landmark Detector Across Large Poses

    Full text link
    Facial landmark localization aims to detect the predefined points of human faces, and the topic has been rapidly improved with the recent development of neural network based methods. However, it remains a challenging task when dealing with faces in unconstrained scenarios, especially with large pose variations. In this paper, we target the problem of facial landmark localization across large poses and address this task based on a split-and-aggregate strategy. To split the search space, we propose a set of anchor templates as references for regression, which well addresses the large variations of face poses. Based on the prediction of each anchor template, we propose to aggregate the results, which can reduce the landmark uncertainty due to the large poses. Overall, our proposed approach, named AnchorFace, obtains state-of-the-art results with extremely efficient inference speed on four challenging benchmarks, i.e. AFLW, 300W, Menpo, and WFLW dataset. Code will be available at https://github.com/nothingelse92/AnchorFace.Comment: To appear in AAAI 202

    Pythagoras Superposition Principle for Localized Eigenstates of 2D Moir\'e Lattices

    Full text link
    Moir\'e lattices are aperiodic systems formed by a superposition of two periodic lattices with a relative rotational angle. In optics, the photonic moir\'e lattice has many promising mysteries such as its ability to localize light, thus attracting much attention to exploring features of such a structure. One fundamental research area for photonic moir\'e lattices is the properties of eigenstates, particularly the existence of localized eigenstates and the localization-to-delocalization transition in the energy band structure. Here we propose an accurate algorithm for the eigenproblems of aperiodic systems by combining plane wave discretization and spectral indicator validation under the higher-dimensional projection, allowing us to explore energy bands of fully aperiodic systems. A localization-delocalization transition regarding the intensity of the aperiodic potential is observed and a novel Pythagoras superposition principle for localized eigenstates of 2D moir\'e lattices is revealed by analyzing the relationship between the aperiodic and its corresponding periodic eigenstates. This principle sheds light on exploring the physics of localizations for moir\'e lattice.Comment: 7 pages, 3 figure

    Importance-aware Co-teaching for Offline Model-based Optimization

    Full text link
    Offline model-based optimization aims to find a design that maximizes a property of interest using only an offline dataset, with applications in robot, protein, and molecule design, among others. A prevalent approach is gradient ascent, where a proxy model is trained on the offline dataset and then used to optimize the design. This method suffers from an out-of-distribution issue, where the proxy is not accurate for unseen designs. To mitigate this issue, we explore using a pseudo-labeler to generate valuable data for fine-tuning the proxy. Specifically, we propose \textit{\textbf{I}mportance-aware \textbf{C}o-\textbf{T}eaching for Offline Model-based Optimization}~(\textbf{ICT}). This method maintains three symmetric proxies with their mean ensemble as the final proxy, and comprises two steps. The first step is \textit{pseudo-label-driven co-teaching}. In this step, one proxy is iteratively selected as the pseudo-labeler for designs near the current optimization point, generating pseudo-labeled data. Subsequently, a co-teaching process identifies small-loss samples as valuable data and exchanges them between the other two proxies for fine-tuning, promoting knowledge transfer. This procedure is repeated three times, with a different proxy chosen as the pseudo-labeler each time, ultimately enhancing the ensemble performance. To further improve accuracy of pseudo-labels, we perform a secondary step of \textit{meta-learning-based sample reweighting}, which assigns importance weights to samples in the pseudo-labeled dataset and updates them via meta-learning. ICT achieves state-of-the-art results across multiple design-bench tasks, achieving the best mean rank of 3.13.1 and median rank of 22, among 1515 methods. Our source code can be found here.Comment: Accepted by NeurIPS 202

    Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control

    Full text link
    With the recent advances in mobile energy storage technologies, electric vehicles (EVs) have become a crucial part of smart grids. When EVs participate in the demand response program, the charging cost can be significantly reduced by taking full advantage of the real-time pricing signals. However, many stochastic factors exist in the dynamic environment, bringing significant challenges to design an optimal charging/discharging control strategy. This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments to maximize EV users' benefits. We first formulate this problem as a Markov decision process (MDP). Then we consider EV users with different behaviors as agents in different environments. Furthermore, a horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. This approach can learn an optimal charging/discharging control strategy without sharing users' profiles. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various stochastic factors

    Infusing Definiteness into Randomness: Rethinking Composition Styles for Deep Image Matting

    Full text link
    We study the composition style in deep image matting, a notion that characterizes a data generation flow on how to exploit limited foregrounds and random backgrounds to form a training dataset. Prior art executes this flow in a completely random manner by simply going through the foreground pool or by optionally combining two foregrounds before foreground-background composition. In this work, we first show that naive foreground combination can be problematic and therefore derive an alternative formulation to reasonably combine foregrounds. Our second contribution is an observation that matting performance can benefit from a certain occurrence frequency of combined foregrounds and their associated source foregrounds during training. Inspired by this, we introduce a novel composition style that binds the source and combined foregrounds in a definite triplet. In addition, we also find that different orders of foreground combination lead to different foreground patterns, which further inspires a quadruplet-based composition style. Results under controlled experiments on four matting baselines show that our composition styles outperform existing ones and invite consistent performance improvement on both composited and real-world datasets. Code is available at: https://github.com/coconuthust/composition_stylesComment: Accepted to AAAI 2023; 11 pages, 9 figures; Code is available at https://github.com/coconuthust/composition_style

    Observation of Berry curvature in non-Hermitian system from far-field radiation

    Full text link
    Berry curvature that describes local geometrical properties of energy bands can elucidate many fascinating phenomena in solid-state, photonic, and phononic systems, given its connection to global topological invariants such as the Chern number. Despite its significance, the observation of Berry curvature poses a substantial challenging since wavefunctions are deeply embedded within the system. Here, we theoretically propose a correspondence between the geometry of far-field radiation and the underneath band topology of non-Hermitian systems, thus providing a general method to fully capture the Berry curvature without strongly disturbing the eigenstates. We further experimentally observe the Berry curvature in a honeycomb photonic crystal slab from polarimetry measurements and quantitatively obtain the non-trivial valley Chern number. Our work reveals the feasibility of retrieving the bulk band topology from escaping photons and paves the way to exploring intriguing topological landscapes in non-Hermitian systems
    • …
    corecore