HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactions

Reconstructing 3D hand mesh robustly from a single image is very challenging, due to the lack of diversity in existing real-world datasets. While data synthesis helps relieve the issue, the syn-to-real gap still hinders its usage. In this work, we present HandBooster, a new approach to uplift the data diversity and boost the 3D hand-mesh reconstruction performance by training a conditional generative space on hand-object interactions and purposely sampling the space to synthesize effective data samples. First, we construct versatile content-aware conditions to guide a diffusion model to produce realistic images with diverse hand appearances, poses, views, and backgrounds; favorably, accurate 3D annotations are obtained for free. Then, we design a novel condition creator based on our similarity-aware distribution sampling strategies to deliberately find novel and realistic interaction poses that are distinctive from the training set. Equipped with our method, several baselines can be significantly improved beyond the SOTA on the HO3D and DexYCB benchmarks. Our code will be released on https://github.com/hxwork/HandBooster_Pytorch

Short-Sampled Blind Source Separation of Rotating Machinery Signals Based on Spectrum Correction

Nowadays, the existing blind source separation (BSS) algorithms in rotating machinery fault diagnosis can hardly meet the demand of fast response, high stability, and low complexity simultaneously. Therefore, this paper proposes a spectrum correction based BSS algorithm. Through the incorporation of FFT, spectrum correction, a screen procedure (consisting of frequency merging, candidate pattern selection, and single-source-component recognition), modified k-means based source number estimation, and mixing matrix estimation, the proposed BSS algorithm can accurately achieve harmonics sensing on field rotating machinery faults in case of short-sampled observations. Both numerical simulation and practical experiment verify the proposed BSS algorithm’s superiority in the recovery quality, stability to insufficient samples, and efficiency over the existing ICA-based methods. Besides rotating machinery fault diagnosis, the proposed BSS algorithm also possesses a vast potential in other harmonics-related application fields

Short-Sampled Blind Source Separation of Rotating Machinery Signals Based on Spectrum Correction

Nowadays, the existing blind source separation (BSS) algorithms in rotating machinery fault diagnosis can hardly meet the demand of fast response, high stability, and low complexity simultaneously. Therefore, this paper proposes a spectrum correction based BSS algorithm. Through the incorporation of FFT, spectrum correction, a screen procedure (consisting of frequency merging, candidate pattern selection, and single-source-component recognition), modified -means based source number estimation, and mixing matrix estimation, the proposed BSS algorithm can accurately achieve harmonics sensing on field rotating machinery faults in case of short-sampled observations. Both numerical simulation and practical experiment verify the proposed BSS algorithm's superiority in the recovery quality, stability to insufficient samples, and efficiency over the existing ICA-based methods. Besides rotating machinery fault diagnosis, the proposed BSS algorithm also possesses a vast potential in other harmonics-related application fields

BiSwift: Bandwidth Orchestrator for Multi-Stream Video Analytics on Edge

High-definition (HD) cameras for surveillance and road traffic have experienced tremendous growth, demanding intensive computation resources for real-time analytics. Recently, offloading frames from the front-end device to the back-end edge server has shown great promise. In multi-stream competitive environments, efficient bandwidth management and proper scheduling are crucial to ensure both high inference accuracy and high throughput. To achieve this goal, we propose BiSwift, a bi-level framework that scales the concurrent real-time video analytics by a novel adaptive hybrid codec integrated with multi-level pipelines, and a global bandwidth controller for multiple video streams. The lower-level front-back-end collaborative mechanism (called adaptive hybrid codec) locally optimizes the accuracy and accelerates end-to-end video analytics for a single stream. The upper-level scheduler aims to accuracy fairness among multiple streams via the global bandwidth controller. The evaluation of BiSwift shows that BiSwift is able to real-time object detection on 9 streams with an edge device only equipped with an NVIDIA RTX3070 (8G) GPU. BiSwift improves 10%$\sim$21% accuracy and presents 1.2$\sim$9$\times$ throughput compared with the state-of-the-art video analytics pipelines.Comment: Accepted by 2024 IEEE INFOCO

Moderate mutation rate in the SARS coronavirus genome and its implications

BACKGROUND: The outbreak of severe acute respiratory syndrome (SARS) caused a severe global epidemic in 2003 which led to hundreds of deaths and many thousands of hospitalizations. The virus causing SARS was identified as a novel coronavirus (SARS-CoV) and multiple genomic sequences have been revealed since mid-April, 2003. After a quiet summer and fall in 2003, the newly emerged SARS cases in Asia, particularly the latest cases in China, are reinforcing a wide-spread belief that the SARS epidemic would strike back. With the understanding that SARS-CoV might be with humans for years to come, knowledge of the evolutionary mechanism of the SARS-CoV, including its mutation rate and emergence time, is fundamental to battle this deadly pathogen. To date, the speed at which the deadly virus evolved in nature and the elapsed time before it was transmitted to humans remains poorly understood. RESULTS: Sixteen complete genomic sequences with available clinical histories during the SARS outbreak were analyzed. After careful examination of multiple-sequence alignment, 114 single nucleotide variations were identified. To minimize the effects of sequencing errors and additional mutations during the cell culture, three strategies were applied to estimate the mutation rate by 1) using the closely related sequences as background controls; 2) adjusting the divergence time for cell culture; or 3) using the common variants only. The mutation rate in the SARS-CoV genome was estimated to be 0.80 – 2.38 × 10(-3 )nucleotide substitution per site per year which is in the same order of magnitude as other RNA viruses. The non-synonymous and synonymous substitution rates were estimated to be 1.16 – 3.30 × 10(-3 )and 1.67 – 4.67 × 10(-3 )per site per year, respectively. The most recent common ancestor of the 16 sequences was inferred to be present as early as the spring of 2002. CONCLUSIONS: The estimated mutation rates in the SARS-CoV using multiple strategies were not unusual among coronaviruses and moderate compared to those in other RNA viruses. All estimates of mutation rates led to the inference that the SARS-CoV could have been with humans in the spring of 2002 without causing a severe epidemic