Improved High-Probability Regret for Adversarial Bandits with Time-Varying Feedback Graphs

We study high-probability regret bounds for adversarial $K$-armed bandits with time-varying feedback graphs over $T$ rounds. For general strongly observable graphs, we develop an algorithm that achieves the optimal regret $\widetilde{\mathcal{O}}((\sum_{t=1}^T\alpha_t)^{1/2}+\max_{t\in[T]}\alpha_t)$ with high probability, where $\alpha_t$ is the independence number of the feedback graph at round $t$. Compared to the best existing result [Neu, 2015] which only considers graphs with self-loops for all nodes, our result not only holds more generally, but importantly also removes any $\text{poly}(K)$ dependence that can be prohibitively large for applications such as contextual bandits. Furthermore, we also develop the first algorithm that achieves the optimal high-probability regret bound for weakly observable graphs, which even improves the best expected regret bound of [Alon et al., 2015] by removing the $\mathcal{O}(\sqrt{KT})$ term with a refined analysis. Our algorithms are based on the online mirror descent framework, but importantly with an innovative combination of several techniques. Notably, while earlier works use optimistic biased loss estimators for achieving high-probability bounds, we find it important to use a pessimistic one for nodes without self-loop in a strongly observable graph

No-Regret Learning in Two-Echelon Supply Chain with Unknown Demand Distribution

Supply chain management (SCM) has been recognized as an important discipline with applications to many industries, where the two-echelon stochastic inventory model, involving one downstream retailer and one upstream supplier, plays a fundamental role for developing firms' SCM strategies. In this work, we aim at designing online learning algorithms for this problem with an unknown demand distribution, which brings distinct features as compared to classic online optimization problems. Specifically, we consider the two-echelon supply chain model introduced in [Cachon and Zipkin, 1999] under two different settings: the centralized setting, where a planner decides both agents' strategy simultaneously, and the decentralized setting, where two agents decide their strategy independently and selfishly. We design algorithms that achieve favorable guarantees for both regret and convergence to the optimal inventory decision in both settings, and additionally for individual regret in the decentralized setting. Our algorithms are based on Online Gradient Descent and Online Newton Step, together with several new ingredients specifically designed for our problem. We also implement our algorithms and show their empirical effectiveness

pH-Induced conformational changes of human bocavirus capsids

Human bocavirus 1 (HBoV1) and HBoV2 to-4 infect children and immunocompromised individuals, resulting in respiratory and gastrointestinal infections, respectively. Using cryo-electron microscopy and image reconstruction, the HBoV2 capsid structure was determined to 2.7-angstrom resolution at pH 7.4 and compared to the previously determined HBoV1, HBoV3, and HBoV4 structures. Consistent with previous findings, surface variable region III (VR-III) of the capsid protein VP3, proposed as a host tissue tropism determinant, was structurally similar among the gastrointestinal strains HBoV2 to-4, but differed from that of HBoV1 with its tropism for the respiratory tract. Toward understanding the entry and trafficking properties of these viruses, HBoV1 and HBoV2 were further analyzed as species representatives of the two HBoV tropisms. Their cell surface glycan-binding characteristics were analyzed, and capsid structures determined to 2.5-to 2.7-angstrom resolution at pHs 5.5 and 2.6, conditions normally encountered during infection. The data showed that glycans with terminal sialic acid, galactose, GlcNAc, or heparan sulfate moieties do not facilitate HBoV1 or HBoV2 cellular attachment. With respect to trafficking, conformational changes common to both viruses were observed under low-pH conditions localized to the VP N terminus under the 5-fold channel, in the surface loops VR-I and VR-V and specific side chain residues such as cysteines and histidines. The 5-fold conformational movements provide insight into the potential mechanism of VP N-terminal dynamics during HBoV infection, and side chain modifications highlight pH-sensitive regions of the capsid. IMPORTANCE Human bocaviruses (HBoVs) are associated with disease in humans. However, the lack of an animal model and a versatile cell culture system to study their life cycle limits the ability to develop specific treatments or vaccines. This study presents the structure of HBoV2, at 2.7-A resolution, determined for comparison to the existing HBoV1, HBoV3, and HBoV4 structures, to enable the molecular characterization of strain and genus-specific capsid features contributing to tissue tropism and antigenicity. Furthermore, HBoV1 and HBoV2 structures determined under acidic conditions provide insight into capsid changes associated with endosomal and gastrointestinal acidification. Structural rearrangements of the capsid VP N terminus, at the base of the 5-fold channel, demonstrate a disordering of a "basket" motif as pH decreases. These observations begin to unravel the molecular mechanism of HBoV infection and provide information for control strategies.Peer reviewe

Atomic Resolution Structures of Human Bufaviruses Determined by Cryo-Electron Microscopy

Bufavirus strain 1 (BuV1), a member of the Protoparvovirus genus of the Parvoviridae, was first isolated from fecal samples of children with acute diarrhea in Burkina Faso. Since this initial discovery, BuVs have been isolated in several countries, including Finland, the Netherlands, and Bhutan, in pediatric patients exhibiting similar symptoms. Towards their characterization, the structures of virus-like particles of BuV1, BuV2, and BuV3, the current known genotypes, have been determined by cryo-electron microscopy and image reconstruction to 2.84, 3.79, and 3.25 angstrom, respectively. The BuVs, 65-73% identical in amino acid sequence, conserve the major viral protein, VP2, structure and general capsid surface features of parvoviruses. These include a core -barrel (B-I), -helix A, and large surface loops inserted between these elements in VP2. The capsid contains depressions at the icosahedral 2-fold and around the 5-fold axes, and has three separated protrusions surrounding the 3-fold axes. Structure comparison among the BuVs and to available parvovirus structures revealed capsid surface variations and capsid 3-fold protrusions that depart from the single pinwheel arrangement of the animal protoparvoviruses. These structures provide a platform to begin the molecular characterization of these potentially pathogenic viruses.Peer reviewe

Distinct subpopulations of DN1 thymocytes exhibit preferential γδ T lineage potential

The αβ and γδ T cell lineages both differentiate in the thymus from common uncommitted progenitors. The earliest stage of T cell development is known as CD4-CD8- double negative 1 (DN1), which has previously been shown to be a heterogenous mixture of cells. Of these, only the CD117+ fraction has been proposed to be true T cell progenitors that progress to the DN2 and DN3 thymocyte stages, at which point the development of the αβ and γδ T cell lineages diverge. However, recently, it has been shown that at least some γδ T cells may be derived from a subset of CD117- DN thymocytes. Along with other ambiguities, this suggests that T cell development may not be as straightforward as previously thought. To better understand early T cell development, particularly the heterogeneity of DN1 thymocytes, we performed a single cell RNA sequence (scRNAseq) of mouse DN and γδ thymocytes and show that the various DN stages indeed comprise a transcriptionally diverse subpopulations of cells. We also show that multiple subpopulations of DN1 thymocytes exhibit preferential development towards the γδ lineage. Furthermore, specific γδ-primed DN1 subpopulations preferentially develop into IL-17 or IFNγ-producing γδ T cells. We show that DN1 subpopulations that only give rise to IL-17-producing γδ T cells already express many of the transcription factors associated with type 17 immune cell responses, while the DN1 subpopulations that can give rise to IFNγ-producing γδ T cell already express transcription factors associated with type 1 immune cell responses