Adversarial Soft Advantage Fitting: Imitation Learning without Policy Optimization

Adversarial Imitation Learning alternates between learning a discriminator -- which tells apart expert's demonstrations from generated ones -- and a generator's policy to produce trajectories that can fool this discriminator. This alternated optimization is known to be delicate in practice since it compounds unstable adversarial training with brittle and sample-inefficient reinforcement learning. We propose to remove the burden of the policy optimization steps by leveraging a novel discriminator formulation. Specifically, our discriminator is explicitly conditioned on two policies: the one from the previous generator's iteration and a learnable policy. When optimized, this discriminator directly learns the optimal generator's policy. Consequently, our discriminator's update solves the generator's optimization problem for free: learning a policy that imitates the expert does not require an additional optimization loop. This formulation effectively cuts by half the implementation and computational burden of Adversarial Imitation Learning algorithms by removing the Reinforcement Learning phase altogether. We show on a variety of tasks that our simpler approach is competitive to prevalent Imitation Learning methods

Revue d'histoire du Bas-Saint-Laurent, vol. 14 (2)

Éditorial -- Enseignement -- Archéologie -- Mont Commis ou Mont Camille? -- Joachim Vautour, pêcheur résidant à Rimouski au XVIIIe siècle -- Les guerres du bois -- L'incorporation de Trois-Pistoles a donné lieu à une série de conflits (1916-1924) -- Chroniques rimouskoises -- Histoire orale -- Patrimoine -- Archives -- Des livres à lire! -- Photos ancienne

Personal non-commercial use only

ABSTRACT. Objective. We describe the pattern of incidence of thrombovascular events after diagnosis of systemic lupus erythematosus (SLE) in a cohort of lupus patients. Methods. Descriptive study of prospectively collected data using incidence rates of thrombovascular events and 95% confidence intervals (CI) calculated for predetermined periods of observation. KaplanMeier survival curves were plotted to estimate thrombovascular event-free survival. Results. Among 426 individuals, person-years contributed were as follows: 399 persons and 4356.0 person-years for all events; 417 persons and 4691.9 person-years for arterial events; and 408 persons and 4846.6 person-years for venous events. The incidence of thrombovascular events was highest during the first year after SLE diagnosis (4.00, 95% CI 2.24-6.59) and after 20 years (ranging from 3.32, 95% CI 1.52-6.30, to 4.99, 95% CI 0.60-18.01), and was lowest between 1 and 5 years after SLE diagnosis (1.00, 95% CI 0.53-1.72). A similar pattern was observed for arterial events, while venous events showed a higher incidence rate only in the first 30 days after SLE diagnosis (12.06, 95% CI 3.29-30.87) and remained low afterwards. The probabilities of remaining event-free at 5, 10, and 15 years were as follows: 0.92, 0.85, and 0.78, respectively, for all thrombovascular events; 0.95, 0.88, and 0.82, respectively, for arterial events; and 0.98, 0.95, and 0.94, respectively, for venous events. Conclusion. Thrombovascular events occur throughout the course of lupus, with the highest risk of arterial or venous events in the first year after diagnosis, and the pattern of occurrence varying there

Reduced proportions of natural killer T cells are present in the relatives of lupus patients and are associated with autoimmunity

Abstract Introduction Systemic lupus erythematosus is a genetically complex disease. Currently, the precise allelic polymorphisms associated with this condition remain largely unidentified. In part this reflects the fact that multiple genes, each having a relatively minor effect, act in concert to produce disease. Given this complexity, analysis of subclinical phenotypes may aid in the identification of susceptibility alleles. Here, we used flow cytometry to investigate whether some of the immune abnormalities that are seen in the peripheral blood lymphocyte population of lupus patients are seen in their first-degree relatives. Methods Peripheral blood mononuclear cells were isolated from the subjects, stained with fluorochrome-conjugated monoclonal antibodies to identify various cellular subsets, and analyzed by flow cytometry. Results We found reduced proportions of natural killer (NK)T cells among 367 first-degree relatives of lupus patients as compared with 102 control individuals. There were also slightly increased proportions of memory B and T cells, suggesting increased chronic low-grade activation of the immune system in first-degree relatives. However, only the deficiency of NKT cells was associated with a positive anti-nuclear antibody test and clinical autoimmune disease in family members. There was a significant association between mean parental, sibling, and proband values for the proportion of NKT cells, suggesting that this is a heritable trait. Conclusions The findings suggest that analysis of cellular phenotypes may enhance the ability to detect subclinical lupus and that genetically determined altered immunoregulation by NKT cells predisposes first-degree relatives of lupus patients to the development of autoimmunity

Personal non-commercial use only

ABSTRACT. Objective. Associations between the use of micronutrient supplements (MS) and disease activity, quality of life (QOL), and healthcare resource utilization were studied in a Canadian population of patients with systemic lupus erythematosus (SL

CT colonography: optimisation, diagnostic performance and patient acceptability of reduced-laxative regimens using barium-based faecal tagging

To establish the optimum barium-based reduced-laxative tagging regimen prior to CT colonography (CTC). Ninety-five subjects underwent reduced-laxative (13 g senna/18 g magnesium citrate) CTC prior to same-day colonoscopy and were randomised to one of four tagging regimens using 20 ml 40%w/v barium sulphate: regimen A: four doses, B: three doses, C: three doses plus 220 ml 2.1% barium sulphate, or D: three doses plus 15 ml diatriazoate megluamine. Patient experience was assessed immediately after CTC and 1 week later. Two radiologists graded residual stool (1: none/scattered to 4: >50% circumference) and tagging efficacy for stool (1: untagged to 5: 100% tagged) and fluid (1: untagged, 2: layered, 3: tagged), noting the HU of tagged fluid. Preparation was good (76–94% segments graded 1), although best for regimen D (P = 0.02). Across all regimens, stool tagging quality was high (mean 3.7–4.5) and not significantly different among regimens. The HU of layered tagged fluid was higher for regimens C/D than A/B (P = 0.002). Detection of cancer (n = 2), polyps ≥6 mm (n = 21), and ≤5 mm (n = 72) was 100, 81 and 32% respectively, with only four false positives ≥6 mm. Reduced preparation was tolerated better than full endoscopic preparation by 61%. Reduced-laxative CTC with three doses of 20 ml 40% barium sulphate is as effective as more complex regimens, retaining adequate diagnostic accuracy