HDTR-Net: A Real-Time High-Definition Teeth Restoration Network for Arbitrary Talking Face Generation Methods

Talking Face Generation (TFG) aims to reconstruct facial movements to achieve high natural lip movements from audio and facial features that are under potential connections. Existing TFG methods have made significant advancements to produce natural and realistic images. However, most work rarely takes visual quality into consideration. It is challenging to ensure lip synchronization while avoiding visual quality degradation in cross-modal generation methods. To address this issue, we propose a universal High-Definition Teeth Restoration Network, dubbed HDTR-Net, for arbitrary TFG methods. HDTR-Net can enhance teeth regions at an extremely fast speed while maintaining synchronization, and temporal consistency. In particular, we propose a Fine-Grained Feature Fusion (FGFF) module to effectively capture fine texture feature information around teeth and surrounding regions, and use these features to fine-grain the feature map to enhance the clarity of teeth. Extensive experiments show that our method can be adapted to arbitrary TFG methods without suffering from lip synchronization and frame coherence. Another advantage of HDTR-Net is its real-time generation ability. Also under the condition of high-definition restoration of talking face video synthesis, its inference speed is $300\%$ faster than the current state-of-the-art face restoration based on super-resolution.Comment: 15pages, 6 figures, PRCV202

Information Fusion Based on Complementary Filter for SINS/CNS/GPS Integrated Navigation System of Aerospace Plane

In order to solve the problems of heavy computational load and poor real time of the information fusion method based on the federated Kalman filter (FKF), a novel information fusion method based on the complementary filter is proposed for strapdown inertial navigation (SINS)/celestial navigation system (CNS)/global positioning system (GPS) integrated navigation system of an aerospace plane. The complementary filters are designed to achieve the estimations of attitude, velocity, and position in the SINS/CNS/GPS integrated navigation system, respectively. The simulation results show that the proposed information fusion method can effectively realize SINS/CNS/GPS information fusion. Compared with FKF, the method based on complementary filter (CF) has the advantages of simplicity, small calculation, good real-time performance, good stability, no need for initial alignment, fast convergence, etc. Furthermore, the computational efficiency of CF is increased by 94.81%. Finally, the superiority of the proposed CF-based method is verified by both the semi-physical simulation and real-time system experiment

A feedback weighted fusion algorithm with dynamic sensor bias correction for gyroscope array

Low-cost Micro-Electromechanical System (MEMS) gyroscopes are known to have a smaller size, lower weight, and less power consumption than their more technologically advanced counterparts. However, current low-grade MEMS gyroscopes have poor performance and cannot compete with quality sensors in high accuracy navigational and guidance applications. The main focus of this paper is to investigate performance improvements by fusing multiple homogeneous MEMS gyroscopes. These gyros are transformed into a virtual gyro using a feedback weighted fusion algorithm with dynamic sensor bias correction. The gyroscope array combines eight homogeneous gyroscope units on each axis and divides them into two layers of differential configuration. The algorithm uses the gyroscope array estimation value to remove the gyroscope bias and then correct the gyroscope array measurement value. Then the gyroscope variance is recalculated in real time according to the revised measurement value and the weighted coefficients and state estimation of each gyroscope are deduced according to the least square principle. The simulations and experiments showed that the proposed algorithm could further reduce the drift and improve the overall accuracy beyond the performance limitations of individual gyroscopes. The maximum cumulative angle error was -2.09 degrees after 2000 seconds in the static test, and the standard deviation (STD) of the output fusion value of the proposed algorithm was 0.006 degrees/s in the dynamic test, which was only 1.7% of the STD value of an individual gyroscope

Motion Constraints and Vanishing Point Aided Land Vehicle Navigation

In the typical Inertial Navigation System (INS)/ Global Navigation Satellite System (GNSS) setup for ground vehicle navigation, measures should be taken to maintain the performance when there are GNSS signal outages. Usually, aiding sensors are utilized to reduce the INS drift. A full motion constraint model is developed allowing the online calibration of INS frame with respect to (w.r.t) the motion frame. To obtain better heading and lateral positioning performance, we propose to use of vanishing point (VP) observations of parallel lane markings from a single forward-looking camera to aid the INS. In the VP module, the relative attitude of the camera w.r.t the road frame is derived from the VP coordinates. The state-space model is developed with augmented vertical attitude error state. Finally, the VP module is added to a modified motion constrains module in the Extended Kalman filter (EKF) framework. Simulations and real-world experiments have shown the validity of VP-based method and improved heading and cross-track position accuracy compared with the solution without VP. The proposed method can work jointly with conventional visual odometry to aid INS for better accuracy and robustness

Theoretical Basis and Technical Method of Permeability Enhancement of Tectonic Coal Seam by High Intensity Acoustic Wave In Situ

Tectonic coal seams are characterized by soft, low permeability and high gas outburst. The traditional gas control method is the intensive drilling and extraction in this seam, which is not only large in engineering quantity, high in cost, difficult to form holes and low in extraction efficiency, but also easy to induce coal and gas outburst, which is a difficult problem for global coal mine gas control. To solve this difficult problem, the controllable shockwave equipment developed by the author’s team and successfully applied in the practice of permeability enhancement of coal seam, combined with the principles of shock vibration sound wave generation and shock wave attenuation and evolution in the rock stratum, a new idea of loading a controllable shock wave in the roof and floor of coal seam is proposed. The shock wave first attenuates and evolves into a high-strength sound wave in the roof and floor rock stratum, and then enters and loads into the coal seam to achieve the purpose of increasing permeability without damaging the physical properties of the tectonic coal seam and facilitating the opening of the original fractures. According to the new technical ideas, the implementation scheme and key parameters of the gas pre-extraction models in tectonic coal seam are designed, including the penetration drilling, roof and floor horizontal holes, shield tunneling and the high-strength acoustic wave of the working face, which provides a new technical approach to solve the problem of high efficiency and low cost gas extraction in the tectonic coal seam

Engineered nonlinear photonic quasicrystals for multi-frequency terahertz manipulation

10.1364/OE.17.011558Optics Express171411558-1156