Principal-Agent Reward Shaping in MDPs

Principal-agent problems arise when one party acts on behalf of another, leading to conflicts of interest. The economic literature has extensively studied principal-agent problems, and recent work has extended this to more complex scenarios such as Markov Decision Processes (MDPs). In this paper, we further explore this line of research by investigating how reward shaping under budget constraints can improve the principal's utility. We study a two-player Stackelberg game where the principal and the agent have different reward functions, and the agent chooses an MDP policy for both players. The principal offers an additional reward to the agent, and the agent picks their policy selfishly to maximize their reward, which is the sum of the original and the offered reward. Our results establish the NP-hardness of the problem and offer polynomial approximation algorithms for two classes of instances: Stochastic trees and deterministic decision processes with a finite horizon.Comment: Full version of a paper accepted to AAAI'2

Overexpression of the CBF2 transcriptional activator in Arabidopsis delays leaf senescence and extends plant longevity

Leaf senescence is a programmed developmental process governed by various endogenous and exogenous factors, such as the plant developmental stage, leaf age, phytohormone levels, darkness, and exposure to stresses. It was found that, in addition to its well-documented role in the enhancement of plant frost tolerance, overexpression of the C-repeat/dehydration responsive element binding factor 2 (CBF2) gene in Arabidopsis delayed the onset of leaf senescence and extended the life span of the plants by approximately 2 weeks. This phenomenon was exhibited both during developmental leaf senescence and during senescence of detached leaves artificially induced by either darkness or phytohormones. Transcriptome analysis using the Affymetrix ATH1 genome array revealed that overexpression of CBF2 significantly influenced the expression of 286 genes in mature leaf tissue. In addition to 30 stress-related genes, overexpression of CBF2 also affected the expression of 24 transcription factor (TF) genes, and 20 genes involved in protein metabolism, degradation, and post-translational modification. These results indicate that overexpression of CBF2 not only increases frost tolerance, but also affects other developmental processes, most likely through interactions with additional TFs and protein modification genes. The present findings shed new light on the crucial relationship between plant stress tolerance and longevity, as reported for other eukaryotic organisms

Alternating Electric Fields (Tumor-Treating Fields Therapy) Can Improve Chemotherapy Treatment Efficacy in Non-Small Cell Lung Cancer Both In Vitro and In Vivo

Non-small cell lung cancer (NSCLC) is one of the leading causes of cancer-related deaths worldwide. Common treatment modalities for NSCLC include surgery, radiotherapy, chemotherapy, and, in recent years, the clinical management paradigm has evolved with the advent of targeted therapies. Despite such advances, the impact of systemic therapies for advanced disease remains modest, and as such, the prognosis for patients with NSCLC remains poor. Standard modalities are not without their respective toxicities and there is a clear need to improve both efficacy and safety for current management approaches. Tumor-treating fields (TTFields) are low-intensity, intermediate-frequency alternating electric fields that disrupt proper spindle microtubule arrangement, thereby leading to mitotic arrest and ultimately to cell death. We evaluated the effects of combining TTFields with standard chemotherapeutic agents on several NSCLC cell lines, both in vitro and in vivo. Frequency titration curves demonstrated that the inhibitory effects of TTFields were maximal at 150 kHz for all NSCLC cell lines tested, and that the addition of TTFields to chemotherapy resulted in enhanced treatment efficacy across all cell lines. We investigated the response of Lewis lung carcinoma and KLN205 squamous cell carcinoma in mice treated with TTFields in combination with pemetrexed, cisplatin, or paclitaxel and compared these to the efficacy observed in mice exposed only to the single agents. Combining TTFields with these therapeutic agents enhanced treatment efficacy in comparison with the respective single agents and control groups in all animal models. Together, these findings suggest that combining TTFields therapy with chemotherapy may provide an additive efficacy benefit in the management of NSCLC

Tumor Treating Fields (TTFields) demonstrate antiviral functions in vitro, and safety for application to COVID-19 patients in a pilot clinical study

Coronaviruses are the causative agents of several recent outbreaks, including the COVID-19 pandemic. One therapeutic approach is blocking viral binding to the host receptor. As binding largely depends on electrostatic interactions, we hypothesized possible inhibition of viral infection through application of electric fields, and tested the effectiveness of Tumor Treating Fields (TTFields), a clinically approved cancer treatment based on delivery of electric fields. In preclinical models, TTFields were found to inhibit coronavirus infection and replication, leading to lower viral secretion and higher cell survival, and to formation of progeny virions with lower infectivity, overall demonstrating antiviral activity. In a pilot clinical study (NCT04953234), TTFields therapy was safe for patients with severe COVID-19, also demonstrating preliminary effectiveness data, that correlated with higher device usage

Complete Phenotypic Recovery of an Alzheimer's Disease Model by a Quinone-Tryptophan Hybrid Aggregation Inhibitor

The rational design of amyloid oligomer inhibitors is yet an unmet drug development need. Previous studies have identified the role of tryptophan in amyloid recognition, association and inhibition. Furthermore, tryptophan was ranked as the residue with highest amyloidogenic propensity. Other studies have demonstrated that quinones, specifically anthraquinones, can serve as aggregation inhibitors probably due to the dipole interaction of the quinonic ring with aromatic recognition sites within the amyloidogenic proteins. Here, using in vitro, in vivo and in silico tools we describe the synthesis and functional characterization of a rationally designed inhibitor of the Alzheimer's disease-associated β-amyloid. This compound, 1,4-naphthoquinon-2-yl-L-tryptophan (NQTrp), combines the recognition capacities of both quinone and tryptophan moieties and completely inhibited Aβ oligomerization and fibrillization, as well as the cytotoxic effect of Aβ oligomers towards cultured neuronal cell line. Furthermore, when fed to transgenic Alzheimer's disease Drosophila model it prolonged their life span and completely abolished their defective locomotion. Analysis of the brains of these flies showed a significant reduction in oligomeric species of Aβ while immuno-staining of the 3rd instar larval brains showed a significant reduction in Aβ accumulation. Computational studies, as well as NMR and CD spectroscopy provide mechanistic insight into the activity of the compound which is most likely mediated by clamping of the aromatic recognition interface in the central segment of Aβ. Our results demonstrate that interfering with the aromatic core of amyloidogenic peptides is a promising approach for inhibiting various pathogenic species associated with amyloidogenic diseases. The compound NQTrp can serve as a lead for developing a new class of disease modifying drugs for Alzheimer's disease

Decision Support Tools and Layouts for MOMU (Multiple Operator Multiple UAV) Environments

The objective of this research is to design and develop tools, layouts, techniques and procedures to aid operators in handling Multiple Operator Multiple UAV (unmanned aerial vehicle) environments. In this paper we describe a study conducted on proficient operators, examining a new tool - \u27Maintain Video Quality\u27. This tool aims to facilitate handoffs and UAV switching among operators. Experimental methodology and preliminary findings are discussed