Context-TAP: Tracking Any Point Demands Spatial Context Features

We tackle the problem of Tracking Any Point (TAP) in videos, which specifically aims at estimating persistent long-term trajectories of query points in videos. Previous methods attempted to estimate these trajectories independently to incorporate longer image sequences, therefore, ignoring the potential benefits of incorporating spatial context features. We argue that independent video point tracking also demands spatial context features. To this end, we propose a novel framework Context-TAP, which effectively improves point trajectory accuracy by aggregating spatial context features in videos. Context-TAP contains two main modules: 1) a SOurse Feature Enhancement (SOFE) module, and 2) a TArget Feature Aggregation (TAFA) module. Context-TAP significantly improves PIPs all-sided, reducing 11.4% Average Trajectory Error of Occluded Points (ATE-Occ) on CroHD and increasing 11.8% Average Percentage of Correct Keypoint (A-PCK) on TAP-Vid-Kinectics. Demos are available at this $\href{https://wkbian.github.io/Projects/Context-TAP/}{webpage}$.Comment: Project Page: this $\href{https://wkbian.github.io/Projects/Context-TAP/}{webpage}

NeuralMarker: A Framework for Learning General Marker Correspondence

We tackle the problem of estimating correspondences from a general marker, such as a movie poster, to an image that captures such a marker. Conventionally, this problem is addressed by fitting a homography model based on sparse feature matching. However, they are only able to handle plane-like markers and the sparse features do not sufficiently utilize appearance information. In this paper, we propose a novel framework NeuralMarker, training a neural network estimating dense marker correspondences under various challenging conditions, such as marker deformation, harsh lighting, etc. Besides, we also propose a novel marker correspondence evaluation method circumstancing annotations on real marker-image pairs and create a new benchmark. We show that NeuralMarker significantly outperforms previous methods and enables new interesting applications, including Augmented Reality (AR) and video editing.Comment: Accepted by ToG (SIGGRAPH Asia 2022). Project Page: https://drinkingcoder.github.io/publication/neuralmarker

VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation

We introduce VideoFlow, a novel optical flow estimation framework for videos. In contrast to previous methods that learn to estimate optical flow from two frames, VideoFlow concurrently estimates bi-directional optical flows for multiple frames that are available in videos by sufficiently exploiting temporal cues. We first propose a TRi-frame Optical Flow (TROF) module that estimates bi-directional optical flows for the center frame in a three-frame manner. The information of the frame triplet is iteratively fused onto the center frame. To extend TROF for handling more frames, we further propose a MOtion Propagation (MOP) module that bridges multiple TROFs and propagates motion features between adjacent TROFs. With the iterative flow estimation refinement, the information fused in individual TROFs can be propagated into the whole sequence via MOP. By effectively exploiting video information, VideoFlow presents extraordinary performance, ranking 1st on all public benchmarks. On the Sintel benchmark, VideoFlow achieves 1.649 and 0.991 average end-point-error (AEPE) on the final and clean passes, a 15.1% and 7.6% error reduction from the best-published results (1.943 and 1.073 from FlowFormer++). On the KITTI-2015 benchmark, VideoFlow achieves an F1-all error of 3.65%, a 19.2% error reduction from the best-published result (4.52% from FlowFormer++). Code is released at \url{https://github.com/XiaoyuShi97/VideoFlow}

Immunomodulatory effects of complex probiotics on the immuno-suppressed mice induced by cyclophosphamide

IntroductionPrevious studies have reported the beneficial effects of Bifidobacterium animalis subsp. lactis XLTG11, Lacticaseibacillus casei Zhang, and Lactiplantibacillus plantarum P8, respectively. However, studies on the immunomodulatory enhancing effects of three complex probiotics have not been conducted. The aim of our study is to investigate the immunomodulatory effects of complex probiotics effect on the immunosuppressed mice induced by cyclophosphamide (CTX).MethodsAn immunocompromised mouse model was established by intraperitoneal injection of cyclophosphamide, which was gavage of different doses of complex probiotics and levamisole hydrochloride. The splenic and thymic indices, intestinal barrier, leukocyte and lymphocyte counts, percentage of splenic lymphocyte subpopulations, cytokine levels, and gut microbiota were determined.ResultsResults showed that the complex probiotics significantly elevated the spleen and thymus indices, increased the villi and crypt depth and the goblet cells. The leukocyte and lymphocyte counts and the percentage of splenic lymphocyte subpopulations in the CTX-treated mice were significantly elevated by the complex probiotics. In addition, the cytokines (IL-6, IL-10, IL-1β, and IFN-γ) were significantly increased after complex probiotic treatment. The complex probiotics restored the gut microbiota structure to the pattern of the control group by reducing the ratio of Firmicutes/Bacteroidetes and enhancing the relative abundances of specific microbiota that produced short-chain fatty acids.DiscussionThis study provides theoretical support for the immunity-enhancing function of the complex probiotics as well as a pharmacological basis for its further development and utilization

A New Fuzzy Iterative Learning Control Algorithm for Single Joint Manipulator

This paper present a new fuzzy iterative learning control design to solve the trajectory tracking problem and performing repetitive tasks for rigid robot manipulators. Several times’ iterations are needed to make the system tracking error converge, especially in the first iteration without experience. In order to solve that problem, fuzzy control and iterative learning control are combined, where fuzzy control is used to tracking trajectory at the first learning period, and the output of fuzzy control is recorded as the initial control inputs of ILC. The new algorithm also adopts gain self-tuning by fuzzy control, in order to improve the convergence rate. Simulations illustrate the effectiveness and convergence of the new algorithm and advantages compared to traditional method

Switching Surface Design for Nonlinear Systems: the Ship Dynamic Positioning

In this paper a design of the switching-surface for the nonlinear system is studied. The aim was to prove that with the linear matrix inequality the coefficients of the sliding surface can be determined optimally for the control law structure. The advantages of the use of the linear matrix inequality reside in the accurate determination of the coefficients of the sliding surface. The sliding mode control for dynamic positioning of the ship with our proposed switching-surface is done. The objective of this control was to make sure that the ship follows a predetermined track. The good trackings are observed from the simulation results which confirm the robustness of the control law obtained by our proposed switching-surface. DOI : http://dx.doi.org/10.11591/telkomnika.v12i4.473

Evaluation of Selected Plant Volatiles as Attractants for the Stick Tea Thrip Dendrothrips minowai in the Laboratory and Tea Plantation

The stick tea thrip (Dendrothrips minowai Priesner) is the main pest thrip in tea (Camellia sinensis) plantations in China, and seriously affects the quality and yield of tea. Plant-derived semiochemicals provide an alternative to pheromones as lures and these compounds possess powerful attractiveness. In this study, we selected 20 non-pheromone semiochemicals, including compounds that have been reported to attract other thrips and some volatiles emitted from tea plants as the potential attractant components for D. minowai. In electroantennogram (EAG) assays, 10 synthetic compounds (p-anisaldehyde, 3-methyl butanal, (E)-β-ocimene, farnesene, nonanal, eugenol, (+)-α-pinene, limonene, (−)-α-pinene, and γ-terpinene) elicited significant antennal responses in female D. minowai. In addition, a two-choice H-tube olfactometer bioassay showed that D. minowai displayed significant positive responses to eight compound dilutions (p-anisaldehyde, eugenol, farnesene, methyl benzoate, 3-methyl butanal, (E)-β-ocimene, (−)-α-pinene, and (+)-α-pinene) when compared with the solvent control at both 1 and 2 h. Moreover, γ-terpinene exhibited a significantly deterrent effect on D. minowai. Finally, trap catches of four compounds (p-anisaldehyde, eugenol, farnesene, and 3-methyl butanal, respectively) significantly increase in tea plantations. Among these, the maximum number of D. minowai collected by blue sticky traps baited with p-anisaldehyde was 7.7 times higher than the control. In conclusion, p-anisaldehyde, eugenol, farnesene, and 3-methyl butanal could significantly attract D. minowai in the laboratory and under field conditions, suggesting considerable potential as commercial attractants to control D. minowai populations

Dipole-matter interactions governed by the asymmetry of Maxwell equations

Directionally molding the near-field and far-field radiation lies at the heart of nanophotonics and is crucial for applications such as on-chip information processing and chiral quantum networks. The most fundamental model for radiating structures is a dipolar source located inside a homogeneous matter. However, the influence of matter on the directionality of dipolar radiation is oftentimes overlooked, especially for the near-field radiation. We show that the dipole-matter interaction is intrinsically asymmetric and does not fulfill the duality principle, originating from the inherent asymmetry of Maxwell equations, i.e., electric charge and current are ubiquitous but their magnetic counterparts are non-existent to elusive. Moreover, we find that the asymmetric dipole-matter interaction could offer an enticing route to reshape the directionality of not only the near-field radiation but also the far-field radiation. As an example, both the near-field and far-field radiation directionality of Huygens dipole (located close to a dielectric-metal interface) would be reversed, if the dipolar position is changed from the dielectric region to the metal region