167,952 research outputs found
Restricted Value Iteration: Theory and Algorithms
Value iteration is a popular algorithm for finding near optimal policies for
POMDPs. It is inefficient due to the need to account for the entire belief
space, which necessitates the solution of large numbers of linear programs. In
this paper, we study value iteration restricted to belief subsets. We show
that, together with properly chosen belief subsets, restricted value iteration
yields near-optimal policies and we give a condition for determining whether a
given belief subset would bring about savings in space and time. We also apply
restricted value iteration to two interesting classes of POMDPs, namely
informative POMDPs and near-discernible POMDPs
A Model Approximation Scheme for Planning in Partially Observable Stochastic Domains
Partially observable Markov decision processes (POMDPs) are a natural model
for planning problems where effects of actions are nondeterministic and the
state of the world is not completely observable. It is difficult to solve
POMDPs exactly. This paper proposes a new approximation scheme. The basic idea
is to transform a POMDP into another one where additional information is
provided by an oracle. The oracle informs the planning agent that the current
state of the world is in a certain region. The transformed POMDP is
consequently said to be region observable. It is easier to solve than the
original POMDP. We propose to solve the transformed POMDP and use its optimal
policy to construct an approximate policy for the original POMDP. By
controlling the amount of additional information that the oracle provides, it
is possible to find a proper tradeoff between computational time and
approximation quality. In terms of algorithmic contributions, we study in
details how to exploit region observability in solving the transformed POMDP.
To facilitate the study, we also propose a new exact algorithm for general
POMDPs. The algorithm is conceptually simple and yet is significantly more
efficient than all previous exact algorithms.Comment: See http://www.jair.org/ for any accompanying file
Pointed Hopf Algebras with classical Weyl Groups
We prove that Nichols algebras of irreducible Yetter-Drinfeld modules over
classical Weyl groups supported by are
infinite dimensional, except in three cases. We give necessary and sufficient
conditions for Nichols algebras of Yetter-Drinfeld modules over classical Weyl
groups supported by to be finite dimensional.Comment: Combined with arXiv:0902.4748 plus substantial changes. To appear
International Journal of Mathematic
Recommended from our members
Energy and CO2 implications of decarbonization strategies for China beyond efficiency: Modeling 2050 maximum renewable resources and accelerated electrification impacts
Energy efficiency has played an important role in helping China achieve its domestic and international energy and climate change mitigation targets, but more significant near-term actions to decarbonize are needed to help China and the world meet the Paris Agreement goals. Accelerating electrification and maximizing supply-side and demand-side renewable adoption are two recent strategies being considered in China, but few bottom-up modeling studies have evaluated the potential near-term impacts of these strategies across multiple sectors. To fill this research gap, we use a bottom-up national end-use model that integrates energy supply and demand systems and conduct scenario analysis to evaluate even lower CO2 emissions strategies and subsequent pathways for China to go beyond cost-effective efficiency and fuel switching. We find that maximizing non-conventional electric and renewable technologies can help China peak its national CO2 emissions as early as 2025, with significant additional CO2 emission reductions on the order of 7 Gt CO2 annually by 2050. Beyond potential CO2 reductions from power sector decarbonization, significant potential lies in fossil fuel displaced by renewable heat in industry. These results suggest accelerating the utilization of non-conventional electric and renewable technologies present additional CO2 reduction opportunities for China, but new policies and strategies are needed to change technology choices in the demand sectors. Managing the pace of electrification in tandem with the pace of decarbonization of the power sector will also be crucial to achieving CO2 reductions from the power sector in a scenario of increased electrification
Kilohertz QPO Frequency and Flux Decrease in AQL X-1 and Effect of Soft X-ray Spectral Components
We report on an RXTE/PCA observation of Aql X-1 during its outburst in March
1997 in which, immediately following a Type-I burst, the broad-band 2-10 keV
flux decreased by about 10% and the kilohertz QPO frequency decreased from
813+-3 Hz to 776+-4 Hz. This change in kHz QPO frequency is much larger than
expected from a simple extrapolation of a frequency-flux correlation
established using data before the burst. Meanwhile a very low frequency noise
(VLFN) component in the broad-band FFT power spectra with a fractional
root-mean-square (rms) amplitude of 1.2% before the burst ceased to exist after
the burst. All these changes were accompanied by a change in the energy
spectral shape. If we characterize the energy spectra with a model composed of
two blackbody (BB) components and a power law component, almost all the
decrease in flux was in the two BB components. We attribute the two BB
components to the contributions from a region very near the neutron star or
even the neutron star itself and from the accretion disk, respectively.Comment: 12 pages with 4 figures, accepted for publication in ApJ Letters,
typos corrected and references update
Bose-Einstein Condensates in Spin-Orbit Coupled Optical Lattices: Flat Bands and Superfluidity
Recently spin-orbit (SO) coupled superfluids in free space or harmonic traps
have been extensively studied, motivated by the recent experimental realization
of SO coupling for Bose-Einstein condensates (BEC). However, the rich physics
of SO coupled BEC in optical lattices has been largely unexplored. In this
paper, we show that in suitable parameter region the lowest Bloch state forms
an isolated flat band in a one dimensional (1D) SO coupled optical lattice,
which thus provides an experimentally feasible platform for exploring the
recently celebrated topological flat band physics in lattice systems. We show
that the flat band is preserved even with the mean field interaction in BEC. We
investigate the superfluidity of the BEC in SO coupled lattices through
dynamical and Landau stability analysis, and show that the BEC is stable on the
whole flat band.Comment: 5 pages, 4 figures, to appear in Phys. Rev.
- …