1,090 research outputs found
Absence of a transport signature of spin-orbit coupling in graphene with indium adatoms
Enhancement of the spin-orbit coupling in graphene may lead to various
topological phenomena and also find applications in spintronics. Adatom
absorption has been proposed as an effective way to achieve the goal. In
particular, great hope has been held for indium in strengthening the spin-orbit
coupling and realizing the quantum spin Hall effect. To search for evidence of
the spin-orbit coupling in graphene absorbed with indium adatoms, we carry out
extensive transport measurements, i.e., weak localization magnetoresistance,
quantum Hall effect and non-local spin Hall effect. No signature of the
spin-orbit coupling is found. Possible explanations are discussed.Comment: 5 pages, 4 figures, with supplementary material
Asymptotic Properties of Solutions to Third-Order Nonlinear Neutral Differential Equations
The aim of this work is to discuss asymptotic properties of a class of third-order nonlinear neutral functional differential equations. The results obtained extend and improve some related known results. Two examples are given to illustrate the main results
Adaptive Environment Modeling Based Reinforcement Learning for Collision Avoidance in Complex Scenes
The major challenges of collision avoidance for robot navigation in crowded
scenes lie in accurate environment modeling, fast perceptions, and trustworthy
motion planning policies. This paper presents a novel adaptive environment
model based collision avoidance reinforcement learning (i.e., AEMCARL)
framework for an unmanned robot to achieve collision-free motions in
challenging navigation scenarios. The novelty of this work is threefold: (1)
developing a hierarchical network of gated-recurrent-unit (GRU) for environment
modeling; (2) developing an adaptive perception mechanism with an attention
module; (3) developing an adaptive reward function for the reinforcement
learning (RL) framework to jointly train the environment model, perception
function and motion planning policy. The proposed method is tested with the
Gym-Gazebo simulator and a group of robots (Husky and Turtlebot) under various
crowded scenes. Both simulation and experimental results have demonstrated the
superior performance of the proposed method over baseline methods.Comment: accepted by IROS202
ResFormer: Scaling ViTs with Multi-Resolution Training
Vision Transformers (ViTs) have achieved overwhelming success, yet they
suffer from vulnerable resolution scalability, i.e., the performance drops
drastically when presented with input resolutions that are unseen during
training. We introduce, ResFormer, a framework that is built upon the seminal
idea of multi-resolution training for improved performance on a wide spectrum
of, mostly unseen, testing resolutions. In particular, ResFormer operates on
replicated images of different resolutions and enforces a scale consistency
loss to engage interactive information across different scales. More
importantly, to alternate among varying resolutions effectively, especially
novel ones in testing, we propose a global-local positional embedding strategy
that changes smoothly conditioned on input sizes. We conduct extensive
experiments for image classification on ImageNet. The results provide strong
quantitative evidence that ResFormer has promising scaling abilities towards a
wide range of resolutions. For instance, ResFormer-B-MR achieves a Top-1
accuracy of 75.86% and 81.72% when evaluated on relatively low and high
resolutions respectively (i.e., 96 and 640), which are 48% and 7.49% better
than DeiT-B. We also demonstrate, moreover, ResFormer is flexible and can be
easily extended to semantic segmentation, object detection and video action
recognition. Code is available at https://github.com/ruitian12/resformer.Comment: CVPR 202
The linear and nonlinear Jaynes-Cummings model for the multiphoton transition
With the Jaynes-Cummings model, we have studied the atom and light field
quantum entanglement of multiphoton transition, and researched the effect of
initial state superposition coefficient , the transition photon number
, the quantum discord and the nonlinear coefficient on the
quantum entanglement degrees. We have given the quantum entanglement degrees
curves with time evolution, and obtained some results, which should have been
used in quantum computing and quantum information.Comment: arXiv admin note: text overlap with arXiv:1404.0821, arXiv:1205.0979
by other author
Orthogonal Subspace Learning for Language Model Continual Learning
Benefiting from massive corpora and advanced hardware, large language models
(LLMs) exhibit remarkable capabilities in language understanding and
generation. However, their performance degrades in scenarios where multiple
tasks are encountered sequentially, also known as catastrophic forgetting. In
this paper, we propose orthogonal low-rank adaptation (O-LoRA), a simple and
efficient approach for continual learning in language models, effectively
mitigating catastrophic forgetting while learning new tasks. Specifically,
O-LoRA learns tasks in different (low-rank) vector subspaces that are kept
orthogonal to each other in order to minimize interference. Our method induces
only marginal additional parameter costs and requires no user data storage for
replay. Experimental results on continual learning benchmarks show that our
method outperforms state-of-the-art methods. Furthermore, compared to previous
approaches, our method excels in preserving the generalization ability of LLMs
on unseen tasks.Comment: EMNLP 2023 finding
- …