On the Re-Solving Heuristic for (Binary) Contextual Bandits with Knapsacks

In the problem of (binary) contextual bandits with knapsacks (CBwK), the agent receives an i.i.d. context in each of the $T$ rounds and chooses an action, resulting in a random reward and a random consumption of resources that are related to an i.i.d. external factor. The agent's goal is to maximize the accumulated reward under the initial resource constraints. In this work, we combine the re-solving heuristic, which proved successful in revenue management, with distribution estimation techniques to solve this problem. We consider two different information feedback models, with full and partial information, which vary in the difficulty of getting a sample of the external factor. Under both information feedback settings, we achieve two-way results: (1) For general problems, we show that our algorithm gets an $\widetilde O(T^{\alpha_u} + T^{\alpha_v} + T^{1/2})$ regret against the fluid benchmark. Here, $\alpha_u$ and $\alpha_v$ reflect the complexity of the context and external factor distributions, respectively. This result is comparable to existing results. (2) When the fluid problem is linear programming with a unique and non-degenerate optimal solution, our algorithm leads to an $\widetilde O(1)$ regret. To the best of our knowledge, this is the first $\widetilde O(1)$ regret result in the CBwK problem regardless of information feedback models. We further use numerical experiments to verify our results.Comment: 43 pages, 2 figures, 1 tabl

Hybrid Si-GaAs photonic crystal cavity for lasing and bistability

The heterogeneous integration of silicon with III-V materials provides a way to overcome silicon's limited optical properties toward a broad range of photonic applications. Hybrid modes are a promising way to make heterogeneous Si/III-V devices, but it is still unclear how to engineer these modes to make photonic crystal cavities. Herein, using 3D finite-difference time-domain simulation, a hybrid Si-GaAs photonic crystal cavity design enables cavity mode confinement in GaAs without directly patterning that operates at telecom wavelengths. The hybrid cavity consists of a patterned silicon waveguide nanobeam that is evanescently coupled to a GaAs slab with quantum dots. We show that by engineering the hybrid modes, we can control the degree of coupling to the active material, which leads to a tradeoff between cavity quality factor and optical gain and nonlinearity. With this design, we demonstrate a cavity mode in the Si-GaAs heterogeneous region, which enables strong interaction with the quantum dots in the GaAs slab for applications such as low-power-threshold lasing and optical bistability (156 nW and 18.1 ${\mu}$W, respectively). This heterogeneous integration of an active III-V material with silicon via a hybrid cavity design suggests a promising approach for achieving on-chip light generation and low-power nonlinear platforms

Cavity enhanced emission from a silicon T center

Silicon T centers present the promising possibility to generate optically active spin qubits in an all-silicon device. However, these color centers exhibit long excited state lifetimes and a low Debye-Waller factor, making them dim emitters with low efficiency into the zero-phonon line. Nanophotonic cavities can solve this problem by enhancing radiative emission into the zero-phonon line through the Purcell effect. In this work we demonstrate cavity-enhanced emission from a single T center in a nanophotonic cavity. We achieve a two-orders of magnitude increase in brightness of the zero-phonon line relative to waveguide-coupled emitters, a 23% collection efficiency from emitter to fiber, and an overall emission efficiency into the zero-phonon line of 63.4%. We also observe a lifetime enhancement of 5, corresponding to a Purcell factor exceeding 18 when correcting for the emission to the phonon sideband. These results pave the way towards efficient spin-photon interfaces in silicon photonics.Comment: References update

Live poultry trading drives China's H7N9 viral evolution and geographical network propagation

The on-going reassortment, human-adapted mutations, and spillover events of novel A(H7N9) avian influenza viruses pose a significant challenge to public health in China and globally. However, our understanding of the factors that disseminate the viruses and drive their geographic distributions is limited. We applied phylogenic analysis to examine the inter-subtype interactions between H7N9 viruses and the closest H9N2 lineages in China during 2010–2014. We reconstructed and compared the inter-provincial live poultry trading and viral propagation network via phylogeographic approach and network similarity technique. The substitution rates of the isolated viruses in live poultry markets and the characteristics of localized viral evolution were also evaluated. We discovered that viral propagation was geographically-structured and followed the live poultry trading network in China, with distinct north-to-east paths of spread and circular transmission between eastern and southern regions. The epicenter of H7N9 has moved from the Shanghai–Zhejiang region to Guangdong Province was also identified. Besides, higher substitution rate was observed among isolates sampled from live poultry markets, especially for those H7N9 viruses. Live poultry trading in China may have driven the network-structured expansion of the novel H7N9 viruses. From this perspective, long-distance geographic expansion of H7N9 were dominated by live poultry movements, while at local scales, diffusion was facilitated by live poultry markets with highly-evolved viruses

Dynamic Budget Throttling in Repeated Second-Price Auctions

Throttling is one of the most popular budget control methods in today's online advertising markets. When a budget-constrained advertiser employs throttling, she can choose whether or not to participate in an auction after the advertising platform recommends a bid. This paper focuses on the dynamic budget throttling process in repeated second-price auctions from a theoretical view. An essential feature of the underlying problem is that the advertiser does not know the distribution of the highest competing bid upon entering the market. To model the difficulty of eliminating such uncertainty, we consider two different information structures. The advertiser could obtain the highest competing bid in each round with full-information feedback. Meanwhile, with partial information feedback, the advertiser could only have access to the highest competing bid in the auctions she participates in. We propose the OGD-CB algorithm, which involves simultaneous distribution learning and revenue optimization. In both settings, we demonstrate that this algorithm guarantees an $O(\sqrt{T\log T})$ regret with probability $1 - O(1/T)$ relative to the fluid adaptive throttling benchmark. By proving a lower bound of $\Omega(\sqrt{T})$ on the minimal regret for even the hindsight optimum, we establish the near optimality of our algorithm. Finally, we compare the fluid optimum of throttling to that of pacing, another widely adopted budget control method. The numerical relationship of these benchmarks sheds new light on the understanding of different online algorithms for revenue maximization under budget constraints.Comment: 29 pages, 1 tabl

Endovascular treatment strategy and clinical outcome of tentorial dural arteriovenous fistula

IntroductionTo evaluate treatment strategies and clinical outcomes following endovascular embolization of tentorial dural arteriovenous fistulas.MethodsWe retrospectively analyzed 19 patients with tentorial dural arteriovenous fistulas admitted to the Department of Neurosurgery at Jiangsu Provincial People’s Hospital between October 2015 and May 2022, all treated with endovascular therapy. To collect and analyze patients’ clinical presentation, imaging data, postoperative complications, and prognosis and to analyze the safety and clinical outcomes of endovascular treatment of tentorial dural arteriovenous fistulas.ResultsImaging cure was achieved in 18 patients, with the arterial route chosen for embolization in 17 patients and the venous route in one patient; one patient received partial embolization. Staged embolization was performed in four patients. At postoperative follow-up of 9–83 months (37.8 ± 21.2), all 19 patients had recovered well (mRS score ≤ 2). Three patients experienced perioperative complications: intraoperative Onyx reflux into the middle cerebral artery in one patient; postoperative permanent limited left visual field loss and deafness in the left ear in one patient; and transient diplopia, vertigo, and decreased pain and temperature sensation of the left limb in one patient, with no abnormalities on post-procedure magnetic resonance examinations. A total of 17 patients completed a postoperative digital subtraction angiography review during follow-up, and one patient had a recurrence of an arteriovenous fistula.ConclusionEndovascular treatment of tentorial dural arteriovenous fistulas is safe and effective. Reduction of the Borden or Cognard classification via eliminating cortical venous reflux through multi-staged embolization or combined open surgery is a reasonable goal of treatment where complete obliteration of the fistula is not achievable

Endovascular treatment of multiple intracranial aneurysms in patients with subarachnoid hemorrhage: one or multiple sessions?

ObjectiveThis study aimed to compare the safety and efficacy of single- and multiple-stage endovascular treatment in aneurysmal subarachnoid hemorrhage (SAH) patients with multiple intracranial aneurysms.MethodsWe retrospectively analyzed the clinical and imaging data of 61 patients who harbored multiple aneurysms and presented to our institution with aneurysmal subarachnoid hemorrhage. Patients were grouped according to endovascular treatment strategy: one-stage or multiple-stage.ResultThe 61 study patients harbored 136 aneurysms. One aneurysm in each patient had ruptured. In the one-stage treatment group, all 66 aneurysms in 31 patients were treated in one session. The mean follow-up was 25.8 months (range, 12–47). At the last follow-up, the modified Rankin scale was ≤2 in 27 patients. In total, 10 complications occurred (cerebral vasospasm, six patients; cerebral hemorrhage, two patients; and thromboembolism, two patients). In the multiple-stage treatment group, only the ruptured aneurysm (30 in total) was treated at the time of presentation, and the remaining aneurysms (40 in total) were treated later. The mean follow-up was 26.3 months (range, 7–49). At the last follow-up, the modified Rankin scale score was ≤2 in 28 patients. In total, five complications occurred (cerebral vasospasm, four patients; and subarachnoid hemorrhage, one patient). During the follow-up period, there was one recurrence of aneurysm with subarachnoid hemorrhage in the single-stage treatment group and four recurrences in the multiple-stage treatment group.ConclusionBoth single- and multiple-stage endovascular treatment is safe and effective in aneurysmal subarachnoid hemorrhage patients who harbor multiple aneurysms. However, multiple-stage treatment is associated with a lower rate of hemorrhagic and ischemic complications

Exploration of potential novel drug targets and biomarkers for small cell lung cancer by plasma proteome screening

Background: Small cell lung cancer (SCLC) is characterized by extreme invasiveness and lethality. There have been very few developments in its diagnosis and treatment over the past decades. It is urgently needed to explore potential novel biomarkers and drug targets for SCLC.Methods: Two-sample Mendelian Randomization (MR) was performed to investigate causal associations between SCLC and plasma proteins using genome-wide association studies (GWAS) summary statistics of SCLC from Transdisciplinary Research Into Cancer of the Lung Consortium (nCase = 2,791 vs. nControl = 20,580), and was validated in another cohort (nCase = 2,664 vs. nControl = 21,444). 734 plasma proteins and their genetic instruments of cis-acting protein quantitative trait loci (pQTL) were used, whereas external plasma proteome data was retrieved from deCODE database. Bidirectional MR, Steiger filtering and phenotype scanning were applied to further verify the associations.Results: Seven significant (p < 6.81 × 10−5) plasma protein-SCLC pairs were identified by MR analysis, including ACP5 (OR = 0.76, 95% CI: 0.67–0.86), CPB2 (OR = 0.90, 95% CI: 0.86–0.95), GSTM3 (OR = 0.45, 95% CI: 0.33–0.63), SHMT1 (OR = 0.74, 95% CI: 0.64–0.86), CTSB (OR = 0.79, 95% CI: 0.71–0.88), NTNG1 (OR = 0.81, 95% CI: 0.74–0.90) and FAM171B (OR = 1.40, 95% CI: 1.21–1.62). The external validation confirmed that CPB2, GSTM3 and NTNG1 had protective effects against SCLC, while FAM171B increased SCLC risk. However, the reverse causality analysis revealed that SCLC caused significant changes in plasma levels of most of these proteins, including decreases of ACP5, CPB2, GSTM3 and NTNG1, and the increase of FAM171B.Conclusion: This integrative analysis firstly suggested the causal associations between SCLC and plasma proteins, and the identified several proteins may be promising novel drug targets or biomarkers for SCLC

Regulatory controls of duplicated gene expression during fiber development in allotetraploid cotton.

Polyploidy complicates transcriptional regulation and increases phenotypic diversity in organisms. The dynamics of genetic regulation of gene expression between coresident subgenomes in polyploids remains to be understood. Here we document the genetic regulation of fiber development in allotetraploid cotton Gossypium hirsutum by sequencing 376 genomes and 2,215 time-series transcriptomes. We characterize 1,258 genes comprising 36 genetic modules that control staged fiber development and uncover genetic components governing their partitioned expression relative to subgenomic duplicated genes (homoeologs). Only about 30% of fiber quality-related homoeologs show phenotypically favorable allele aggregation in cultivars, highlighting the potential for subgenome additivity in fiber improvement. We envision a genome-enabled breeding strategy, with particular attention to 48 favorable alleles related to fiber phenotypes that have been subjected to purifying selection during domestication. Our work delineates the dynamics of gene regulation during fiber development and highlights the potential of subgenomic coordination underpinning phenotypes in polyploid plants. [Abstract copyright: © 2023. The Author(s).