Don't Forget Your ABC's: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems

Despite tremendous advancements in dialogue systems, stable evaluation still requires human judgments producing notoriously high-variance metrics due to their inherent subjectivity. Moreover, methods and labels in dialogue evaluation are not fully standardized, especially for open-domain chats, with a lack of work to compare and assess the validity of those approaches. The use of inconsistent evaluation can misinform the performance of a dialogue system, which becomes a major hurdle to enhance it. Thus, a dimensional evaluation of chat-oriented open-domain dialogue systems that reliably measures several aspects of dialogue capabilities is desired. This paper presents a novel human evaluation method to estimate the rates of many dialogue system behaviors. Our method is used to evaluate four state-of-the-art open-domain dialogue systems and compared with existing approaches. The analysis demonstrates that our behavior method is more suitable than alternative Likert-style or comparative approaches for dimensional evaluation of these systems.Comment: Accepted to ACL 2023; first two authors contributed equall

Utility of routine screening for alpha-1 antitrypsin deficiency in patients with bronchiectasis

Alpha-1 antitrypsin deficiency (AATD) is a cause of bronchiectasis. Guidelines for bronchiectasis from the British Thoracic Society do not recommend to routinely test patients for AATD. In contrast, guidelines for AATD recommend routine screening. This contradiction, in part, results from the lack of data from large studies performing comprehensive screening. We screened 1600 patients with bronchiectasis at two centres in the UK from 2012 to 2016. In total, only eight individuals with AATD were identified representing 0.5% of the overall population. We conclude that routine screening for AATD in bronchiectasis in the UK has a low rate of detection. Further studies are required in different geographical regions, which may have a higher prevalence of AATD.info:eu-repo/semantics/publishedVersio

A comprehensive analysis of the impact of <i>Pseudomonas aeruginosa</i> colonization on prognosis in adult bronchiectasis

Rationale: Eradication and suppression of Pseudomonas aeruginosa is a key priority in national guidelines for bronchiectasis and is a major focus of drug development and clinical trials. An accurate estimation of the clinical impact of P. aeruginosa in bronchiectasis is therefore essential. Methods: Data derived from 21 observational cohort studies comparing patients with P. aeruginosa colonization with those without it were pooled by random effects meta-analysis. Data were collected for key longitudinal clinical outcomes of mortality, hospital admissions, exacerbations, and lung function decline, along with cross-sectional outcomes such as quality of life. MeasurementsandMainResults: In the aggregate, the included studies comprised 3,683 patients. P. aeruginosa was associated with a highly significant and consistent increase in all markers of disease severity, including mortality (odds ratio [OR], 2.95; 95% confidence interval [CI], 1.98-4.40; P <0.0001), hospital admissions (OR, 6.57; 95% CI, 3.19-13.51; P <0.0001), and exacerbations (mean difference, 0.97/yr; 95% CI, 0.64-1.30; P <0.0001). The patients with P. aeruginosa also had worse quality of life on the basis of their St. George's Respiratory Questionnaire results (mean difference, 18.2 points; 95% CI, 14.7-21.8; P <0.0001). Large differences in lung function and radiological severity were also observed. The definitions of colonization were inconsistent among the studies, but the findings were robust regardless of the definition used. Conclusion: P. aeruginosa is associated with an approximately threefold increased risk of death and an increase in hospital admissions and exacerbations in adult bronchiectasis

Principal forms X^2 + nY^2 representing many integers

In 1966, Shanks and Schmid investigated the asymptotic behavior of the number of positive integers less than or equal to x which are represented by the quadratic form X^2+nY^2. Based on some numerical computations, they observed that the constant occurring in the main term appears to be the largest for n=2. In this paper, we prove that in fact this constant is unbounded as n runs through positive integers with a fixed number of prime divisors.Comment: 10 pages, title has been changed, Sections 2 and 3 are new, to appear in Abh. Math. Sem. Univ. Hambur

Bronchiectasis:a case-based approach to investigation and management

Bronchiectasis is a chronic respiratory disease characterised by a syndrome of productive cough and recurrent respiratory infections due to permanent dilatation of the bronchi. Bronchiectasis represents the final common pathway of different disorders, some of which may require specific treatment. Therefore, promptly identifying the aetiology of bronchiectasis is recommended by the European Respiratory Society guidelines. The clinical history and high-resolution computed tomography (HRCT) features can be useful to detect the underlying causes. Despite a strong focus on this aspect of treatment a high proportion of patients remain classified as “idiopathic”. Important underlying conditions that are treatable are frequently not identified for prolonged periods of time. The European Respiratory Society guidelines for bronchiectasis recommend a minimal bundle of tests for diagnosing the cause of bronchiectasis, consisting of immunoglobulins, testing for allergic bronchopulmonary aspergillosis and full blood count. Other testing is recommended to be conducted based on the clinical history, radiological features and severity of disease. Therefore it is essential to teach clinicians how to recognise the “clinical phenotypes” of bronchiectasis that require specific testing. This article will present the initial investigation and management of bronchiectasis focussing particularly on the HRCT features and clinical features that allow recognition of specific causes