Expert-quality Dataset Labeling via Gamified Crowdsourcing on Point-of-Care Lung Ultrasound Data

data interpretation. Building such tools requires labeled training datasets. We tested whether a gamified crowdsourcing approach can produce clinical expert-quality lung ultrasound clip labels. 2,384 lung ultrasound clips were retrospectively collected. Six lung ultrasound experts classified 393 of these clips as having no B-lines, one or more discrete B-lines, or confluent B-lines to create two sets of reference standard labels: a training and test set. Sets trained users on a gamified crowdsourcing platform, and compared concordance of the resulting crowd labels to the concordance of individual experts to reference standards, respectively. 99,238 crowdsourced opinions were collected from 426 unique users over 8 days. Mean labeling concordance of individual experts relative to the reference standard was 85.0% ± 2.0 (SEM), compared to 87.9% crowdsourced label concordance (p=0.15). Scalable, high-quality labeling approaches such as crowdsourcing may streamline training dataset creation for machine learning model development

Deep Learning for Detection and Localization of B-Lines in Lung Ultrasound

Lung ultrasound (LUS) is an important imaging modality used by emergency physicians to assess pulmonary congestion at the patient bedside. B-line artifacts in LUS videos are key findings associated with pulmonary congestion. Not only can the interpretation of LUS be challenging for novice operators, but visual quantification of B-lines remains subject to observer variability. In this work, we investigate the strengths and weaknesses of multiple deep learning approaches for automated B-line detection and localization in LUS videos. We curate and publish, BEDLUS, a new ultrasound dataset comprising 1,419 videos from 113 patients with a total of 15,755 expert-annotated B-lines. Based on this dataset, we present a benchmark of established deep learning methods applied to the task of B-line detection. To pave the way for interpretable quantification of B-lines, we propose a novel "single-point" approach to B-line localization using only the point of origin. Our results show that (a) the area under the receiver operating characteristic curve ranges from 0.864 to 0.955 for the benchmarked detection methods, (b) within this range, the best performance is achieved by models that leverage multiple successive frames as input, and (c) the proposed single-point approach for B-line localization reaches an F1-score of 0.65, performing on par with the inter-observer agreement. The dataset and developed methods can facilitate further biomedical research on automated interpretation of lung ultrasound with the potential to expand the clinical utility.Comment: 10 pages, 4 figure

Same-day testing with initiation of antiretroviral therapy or tuberculosis treatment versus standard care for persons presenting with tuberculosis symptoms at HIV diagnosis: A randomized open-label trial from Haiti.

BackgroundSame-day HIV testing and antiretroviral therapy (ART) initiation is being widely implemented. However, the optimal timing of ART among patients with tuberculosis (TB) symptoms is unknown. We hypothesized that same-day treatment (TB treatment for those diagnosed with TB; ART for those not diagnosed with TB) would be superior to standard care in this population.Methods and findingsWe conducted an open-label trial among adults with TB symptoms at initial HIV diagnosis at GHESKIO in Haiti; participants were recruited and randomized on the same day. Participants were randomized in a 1:1 ratio to same-day treatment (same-day TB testing with same-day TB treatment if TB diagnosed; same-day ART if TB not diagnosed) versus standard care (initiating TB treatment within 7 days and delaying ART to day 7 if TB not diagnosed). In both groups, ART was initiated 2 weeks after TB treatment. The primary outcome was retention in care with 48-week HIV-1 RNA <200 copies/mL, with intention to treat (ITT) analysis. From November 6, 2017 to January 16, 2020, 500 participants were randomized (250/group); the final study visit occurred on March 1, 2021. Baseline TB was diagnosed in 40 (16.0%) in the standard and 48 (19.2%) in the same-day group; all initiated TB treatment. In the standard group, 245 (98.0%) initiated ART at median of 9 days; 6 (2.4%) died, 15 (6.0%) missed the 48-week visit, and 229 (91.6%) attended the 48-week visit. Among all who were randomized, 220 (88.0%) received 48-week HIV-1 RNA testing; 168 had <200 copies/mL (among randomized: 67.2%; among tested: 76.4%). In the same-day group, 249 (99.6%) initiated ART at median of 0 days; 9 (3.6%) died, 23 (9.2%) missed the 48-week visit, and 218 (87.2%) attended the 48-week visit. Among all who were randomized, 211 (84.4%) received 48-week HIV-1 RNA; 152 had <200 copies/mL (among randomized: 60.8%; among tested: 72.0%). There was no difference between groups in the primary outcome (60.8% versus 67.2%; risk difference: -0.06; 95% CI [-0.15, 0.02]; p = 0.14). Two new grade 3 or 4 events were reported per group; none were judged to be related to the intervention. The main limitation of this study is that it was conducted at a single urban clinic, and the generalizability to other settings is uncertain.ConclusionsIn patients with TB symptoms at HIV diagnosis, we found that same-day treatment was not associated with superior retention and viral suppression. In this study, a short delay in ART initiation did not appear to compromise outcomes.Trial registrationThis study is registered with ClinicalTrials.gov NCT03154320

Same-day testing with initiation of antiretroviral therapy or tuberculosis treatment versus standard care for persons presenting with tuberculosis symptoms at HIV diagnosis: A randomized open-label trial from Haiti.

BackgroundSame-day HIV testing and antiretroviral therapy (ART) initiation is being widely implemented. However, the optimal timing of ART among patients with tuberculosis (TB) symptoms is unknown. We hypothesized that same-day treatment (TB treatment for those diagnosed with TB; ART for those not diagnosed with TB) would be superior to standard care in this population.Methods and findingsWe conducted an open-label trial among adults with TB symptoms at initial HIV diagnosis at GHESKIO in Haiti; participants were recruited and randomized on the same day. Participants were randomized in a 1:1 ratio to same-day treatment (same-day TB testing with same-day TB treatment if TB diagnosed; same-day ART if TB not diagnosed) versus standard care (initiating TB treatment within 7 days and delaying ART to day 7 if TB not diagnosed). In both groups, ART was initiated 2 weeks after TB treatment. The primary outcome was retention in care with 48-week HIV-1 RNA ConclusionsIn patients with TB symptoms at HIV diagnosis, we found that same-day treatment was not associated with superior retention and viral suppression. In this study, a short delay in ART initiation did not appear to compromise outcomes.Trial registrationThis study is registered with ClinicalTrials.gov NCT03154320