Restricted Value Iteration: Theory and Algorithms

Value iteration is a popular algorithm for finding near optimal policies for POMDPs. It is inefficient due to the need to account for the entire belief space, which necessitates the solution of large numbers of linear programs. In this paper, we study value iteration restricted to belief subsets. We show that, together with properly chosen belief subsets, restricted value iteration yields near-optimal policies and we give a condition for determining whether a given belief subset would bring about savings in space and time. We also apply restricted value iteration to two interesting classes of POMDPs, namely informative POMDPs and near-discernible POMDPs

A Model Approximation Scheme for Planning in Partially Observable Stochastic Domains

Partially observable Markov decision processes (POMDPs) are a natural model for planning problems where effects of actions are nondeterministic and the state of the world is not completely observable. It is difficult to solve POMDPs exactly. This paper proposes a new approximation scheme. The basic idea is to transform a POMDP into another one where additional information is provided by an oracle. The oracle informs the planning agent that the current state of the world is in a certain region. The transformed POMDP is consequently said to be region observable. It is easier to solve than the original POMDP. We propose to solve the transformed POMDP and use its optimal policy to construct an approximate policy for the original POMDP. By controlling the amount of additional information that the oracle provides, it is possible to find a proper tradeoff between computational time and approximation quality. In terms of algorithmic contributions, we study in details how to exploit region observability in solving the transformed POMDP. To facilitate the study, we also propose a new exact algorithm for general POMDPs. The algorithm is conceptually simple and yet is significantly more efficient than all previous exact algorithms.Comment: See http://www.jair.org/ for any accompanying file

Pointed Hopf Algebras with classical Weyl Groups

We prove that Nichols algebras of irreducible Yetter-Drinfeld modules over classical Weyl groups $A \rtimes \mathbb S_n$ supported by $\mathbb S_n$ are infinite dimensional, except in three cases. We give necessary and sufficient conditions for Nichols algebras of Yetter-Drinfeld modules over classical Weyl groups $A \rtimes \mathbb S_n$ supported by $A$ to be finite dimensional.Comment: Combined with arXiv:0902.4748 plus substantial changes. To appear International Journal of Mathematic

Energy and CO2 implications of decarbonization strategies for China beyond efficiency: Modeling 2050 maximum renewable resources and accelerated electrification impacts

Energy efficiency has played an important role in helping China achieve its domestic and international energy and climate change mitigation targets, but more significant near-term actions to decarbonize are needed to help China and the world meet the Paris Agreement goals. Accelerating electrification and maximizing supply-side and demand-side renewable adoption are two recent strategies being considered in China, but few bottom-up modeling studies have evaluated the potential near-term impacts of these strategies across multiple sectors. To fill this research gap, we use a bottom-up national end-use model that integrates energy supply and demand systems and conduct scenario analysis to evaluate even lower CO2 emissions strategies and subsequent pathways for China to go beyond cost-effective efficiency and fuel switching. We find that maximizing non-conventional electric and renewable technologies can help China peak its national CO2 emissions as early as 2025, with significant additional CO2 emission reductions on the order of 7 Gt CO2 annually by 2050. Beyond potential CO2 reductions from power sector decarbonization, significant potential lies in fossil fuel displaced by renewable heat in industry. These results suggest accelerating the utilization of non-conventional electric and renewable technologies present additional CO2 reduction opportunities for China, but new policies and strategies are needed to change technology choices in the demand sectors. Managing the pace of electrification in tandem with the pace of decarbonization of the power sector will also be crucial to achieving CO2 reductions from the power sector in a scenario of increased electrification

Kilohertz QPO Frequency and Flux Decrease in AQL X-1 and Effect of Soft X-ray Spectral Components

We report on an RXTE/PCA observation of Aql X-1 during its outburst in March 1997 in which, immediately following a Type-I burst, the broad-band 2-10 keV flux decreased by about 10% and the kilohertz QPO frequency decreased from 813+-3 Hz to 776+-4 Hz. This change in kHz QPO frequency is much larger than expected from a simple extrapolation of a frequency-flux correlation established using data before the burst. Meanwhile a very low frequency noise (VLFN) component in the broad-band FFT power spectra with a fractional root-mean-square (rms) amplitude of 1.2% before the burst ceased to exist after the burst. All these changes were accompanied by a change in the energy spectral shape. If we characterize the energy spectra with a model composed of two blackbody (BB) components and a power law component, almost all the decrease in flux was in the two BB components. We attribute the two BB components to the contributions from a region very near the neutron star or even the neutron star itself and from the accretion disk, respectively.Comment: 12 pages with 4 figures, accepted for publication in ApJ Letters, typos corrected and references update

Bose-Einstein Condensates in Spin-Orbit Coupled Optical Lattices: Flat Bands and Superfluidity

Recently spin-orbit (SO) coupled superfluids in free space or harmonic traps have been extensively studied, motivated by the recent experimental realization of SO coupling for Bose-Einstein condensates (BEC). However, the rich physics of SO coupled BEC in optical lattices has been largely unexplored. In this paper, we show that in suitable parameter region the lowest Bloch state forms an isolated flat band in a one dimensional (1D) SO coupled optical lattice, which thus provides an experimentally feasible platform for exploring the recently celebrated topological flat band physics in lattice systems. We show that the flat band is preserved even with the mean field interaction in BEC. We investigate the superfluidity of the BEC in SO coupled lattices through dynamical and Landau stability analysis, and show that the BEC is stable on the whole flat band.Comment: 5 pages, 4 figures, to appear in Phys. Rev.