Test-retest reliability of the Shape/Texture Identification testTM in people with chronic stroke

To evaluate the test-retest reliability of the Shape/Texture Identification test (STI-test(TM)) in persons with chronic stroke

Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: Methods of a decision-maker-researcher partnership systematic review

<p>Abstract</p> <p>Background</p> <p>Computerized clinical decision support systems are information technology-based systems designed to improve clinical decision-making. As with any healthcare intervention with claims to improve process of care or patient outcomes, decision support systems should be rigorously evaluated before widespread dissemination into clinical practice. Engaging healthcare providers and managers in the review process may facilitate knowledge translation and uptake. The objective of this research was to form a partnership of healthcare providers, managers, and researchers to review randomized controlled trials assessing the effects of computerized decision support for six clinical application areas: primary preventive care, therapeutic drug monitoring and dosing, drug prescribing, chronic disease management, diagnostic test ordering and interpretation, and acute care management; and to identify study characteristics that predict benefit.</p> <p>Methods</p> <p>The review was undertaken by the Health Information Research Unit, McMaster University, in partnership with Hamilton Health Sciences, the Hamilton, Niagara, Haldimand, and Brant Local Health Integration Network, and pertinent healthcare service teams. Following agreement on information needs and interests with decision-makers, our earlier systematic review was updated by searching Medline, EMBASE, EBM Review databases, and Inspec, and reviewing reference lists through 6 January 2010. Data extraction items were expanded according to input from decision-makers. Authors of primary studies were contacted to confirm data and to provide additional information. Eligible trials were organized according to clinical area of application. We included randomized controlled trials that evaluated the effect on practitioner performance or patient outcomes of patient care provided with a computerized clinical decision support system compared with patient care without such a system.</p> <p>Results</p> <p>Data will be summarized using descriptive summary measures, including proportions for categorical variables and means for continuous variables. Univariable and multivariable logistic regression models will be used to investigate associations between outcomes of interest and study specific covariates. When reporting results from individual studies, we will cite the measures of association and p-values reported in the studies. If appropriate for groups of studies with similar features, we will conduct meta-analyses.</p> <p>Conclusion</p> <p>A decision-maker-researcher partnership provides a model for systematic reviews that may foster knowledge translation and uptake.</p

Everyday concept detection in visual lifelogs: validation, relationships and trends

The Microsoft SenseCam is a small lightweight wearable camera used to passively capture photos and other sensor readings from a user's day-to-day activities. It can capture up to 3,000 images per day, equating to almost 1 million images per year. It is used to aid memory by creating a personal multimedia lifelog, or visual recording of the wearer's life. However the sheer volume of image data captured within a visual lifelog creates a number of challenges, particularly for locating relevant content. Within this work, we explore the applicability of semantic concept detection, a method often used within video retrieval, on the novel domain of visual lifelogs. A concept detector models the correspondence between low-level visual features and high-level semantic concepts (such as indoors, outdoors, people, buildings, etc.) using supervised machine learning. By doing so it determines the probability of a concept's presence. We apply detection of 27 everyday semantic concepts on a lifelog collection composed of 257,518 SenseCam images from 5 users. The results were then evaluated on a subset of 95,907 images, to determine the precision for detection of each semantic concept. We conduct further analysis on the temporal consistency, co-occurance and trends within the detected concepts to more extensively investigate the robustness of the detectors within this novel domain. We additionally present future applications of concept detection within the domain of lifelogging

Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa

YesFunding provided by the Open Access Authors Fund

Examining intra-rater and inter-rater response agreement: A medical chart abstraction study of a community-based asthma care program

<p>Abstract</p> <p>Background</p> <p>To assess the intra- and inter-rater agreement of chart abstractors from multiple sites involved in the evaluation of an Asthma Care Program (ACP).</p> <p>Methods</p> <p>For intra-rater agreement, 110 charts randomly selected from 1,433 patients enrolled in the ACP across eight Ontario communities were re-abstracted by 10 abstractors. For inter-rater agreement, data abstractors reviewed a set of eight fictitious charts. Data abstraction involved information pertaining to six categories: physical assessment, asthma control, spirometry, asthma education, referral visits, and medication side effects. Percentage agreement and the kappa statistic (κ) were used to measure agreement. Sensitivity and specificity estimates were calculated comparing results from all raters against the gold standard.</p> <p>Results</p> <p>Intra-rater re-abstraction yielded an overall kappa of 0.81. Kappa values for the chart abstraction categories were: physical assessment (κ 0.84), asthma control (κ 0.83), spirometry (κ 0.84), asthma education (κ 0.72), referral visits (κ 0.59) and medication side effects (κ 0.51). Inter-rater abstraction of the fictitious charts produced an overall kappa of 0.75, sensitivity of 0.91 and specificity of 0.89. Abstractors demonstrated agreement for physical assessment (κ 0.88, sensitivity and specificity 0.95), asthma control (κ 0.68, sensitivity 0.89, specificity 0.85), referral visits (κ 0.77, sensitivity 0.88, specificity 0.95), and asthma education (κ 0.49, sensitivity 0.87, specificity 0.77).</p> <p>Conclusion</p> <p>Though collected by multiple abstractors, the results show high sensitivity and specificity and substantial to excellent inter- and intra-rater agreement, assuring confidence in the use of chart abstraction for evaluating the ACP.</p

Single- versus two- layer intestinal anastomosis: a meta-analysis of randomized controlled trials

BACKGROUND: To compare single- with two- layer intestinal anastomosis after intestinal resection: a meta-analysis of randomized controlled trials. METHODS: Randomized controlled trials comparing single- with two-layer intestinal anastomosis were identified using a systematic search of Medline, Embase and the Cochrane Library Databases covering articles published from 1966 to 2004. Outcome of primary interest was postoperative leak. A risk ratio for trial outcomes and weighted pooled estimates for data were calculated. A fixed-effect model weighted using Mantel-Haenszel methods and a random-effect model using DerSimonian-Laird methods were employed. RESULTS: Six trials were analyzed, comprising 670 participants (single-layer group, n = 299; two-layer group, n = 371). Data on leaks were available from all included studies. Combined risk ratio using DerSimonian-Laird methods was 0.91 (95% CI = 0.49 to 1.69), and indicated no significant difference. Inter-study heterogeneity was significant (χ(2 )= 10.5, d.f. = 5, p = 0.06). CONCLUSION: No evidence was found that two-layer intestinal anastomosis leads to fewer post-operative leaks than single layer. Considering duration of the anastomosis procedure and medical expenses, single-layer intestinal anastomosis appears to represent the optimal choice for most surgical situations

Further investigation of confirmed urinary tract infection (UTI) in children under five years: a systematic review.

Background: Further investigation of confirmed UTI in children aims to prevent renal scarring and future complications. Methods: We conducted a systematic review to determine the most effective approach to the further investigation of confirmed urinary tract infection (UTI) in children under five years of age. Results: 73 studies were included. Many studies had methodological limitations or were poorly reported. Effectiveness of further investigations: One study found that routine imaging did not lead to a reduction in recurrent UTIs or renal scarring. Diagnostic accuracy: The studies do not support the use of less invasive tests such as ultrasound as an alternative to renal scintigraphy, either to rule out infection of the upper urinary tract (LR- = 0.57, 95%CI: 0.47, 0.68) and thus to exclude patients from further investigation or to detect renal scarring (LR+ = 3.5, 95% CI: 2.5, 4.8). None of the tests investigated can accurately predict the development of renal scarring. The available evidence supports the consideration of contrast-enhanced ultrasound techniques for detecting vesico-ureteric reflux (VUR), as an alternative to micturating cystourethrography (MCUG) (LR+ = 14.1, 95% CI: 9.5, 20.8; LR- = 0.20, 95%CI: 0.13, 0.29); these techniques have the advantage of not requiring exposure to ionising radiation. Conclusion: There is no evidence to support the clinical effectiveness of routine investigation of children with confirmed UTI. Primary research on the effectiveness, in terms of improved patient outcome, of testing at all stages in the investigation of confirmed urinary tract infection is urgently required

Design effect in multicenter studies: gain or loss of power?

<p>Abstract</p> <p>Background</p> <p>In a multicenter trial, responses for subjects belonging to a common center are correlated. Such a clustering is usually assessed through the design effect, defined as a ratio of two variances. The aim of this work was to describe and understand situations where the design effect involves a gain or a loss of power.</p> <p>Methods</p> <p>We developed a design effect formula for a multicenter study aimed at testing the effect of a binary factor (which thus defines two groups) on a continuous outcome, and explored this design effect for several designs (from individually stratified randomized trials to cluster randomized trials, and for other designs such as matched pair designs or observational multicenter studies).</p> <p>Results</p> <p>The design effect depends on the intraclass correlation coefficient (ICC) (which assesses the correlation between data for two subjects from the same center) but also on a statistic <it>S</it>, which quantifies the heterogeneity of the group distributions among centers (thus the level of association between the binary factor and the center) and on the degree of global imbalance (the number of subjects are then different) between the two groups. This design effect may induce either a loss or a gain in power, depending on whether the <it>S </it>statistic is respectively higher or lower than 1.</p> <p>Conclusion</p> <p>We provided a global design effect formula applying for any multicenter study and allowing identifying factors – the ICC and the distribution of the group proportions among centers – that are associated with a gain or a loss of power in such studies.</p

Relevance similarity: an alternative means to monitor information retrieval systems

BACKGROUND: Relevance assessment is a major problem in the evaluation of information retrieval systems. The work presented here introduces a new parameter, "Relevance Similarity", for the measurement of the variation of relevance assessment. In a situation where individual assessment can be compared with a gold standard, this parameter is used to study the effect of such variation on the performance of a medical information retrieval system. In such a setting, Relevance Similarity is the ratio of assessors who rank a given document same as the gold standard over the total number of assessors in the group. METHODS: The study was carried out on a collection of Critically Appraised Topics (CATs). Twelve volunteers were divided into two groups of people according to their domain knowledge. They assessed the relevance of retrieved topics obtained by querying a meta-search engine with ten keywords related to medical science. Their assessments were compared to the gold standard assessment, and Relevance Similarities were calculated as the ratio of positive concordance with the gold standard for each topic. RESULTS: The similarity comparison among groups showed that a higher degree of agreements exists among evaluators with more subject knowledge. The performance of the retrieval system was not significantly different as a result of the variations in relevance assessment in this particular query set. CONCLUSION: In assessment situations where evaluators can be compared to a gold standard, Relevance Similarity provides an alternative evaluation technique to the commonly used kappa scores, which may give paradoxically low scores in highly biased situations such as document repositories containing large quantities of relevant data

Evaluating compliance to a low glycaemic index (GI) diet in women with polycystic ovary syndrome (PCOS)

<p>Abstract</p> <p>Background</p> <p>A low Glycaemic Index (GI) diet may decrease some long-term health risks in Polycystic Ovary Syndrome (PCOS) such as endometrial cancer. This study was performed to assess compliance to a low GI diet in women with PCOS. Food diaries prospectively collected over 6 months from women on a low GI diet or healthy eating diet were analysed retrospectively. The women were recruited for a pilot randomised control trial investigating whether a low GI diet decreased the risk of Endometrial Cancer. Nine women with PCOS completed 33 food diaries (17 from women on a low GI diet and 16 from women on a healthy eating diet) recording 3023 food items (low GI group:n = 1457; healthy eating group:n = 1566). Data was analysed using Foster-Powell international values inserted into an SPSS database as no scientifically valid established nutrition software was found. The main outcome measures were mean item GI and Glyacemic Load (GL), mean meal GL, percentage high GI foods and mean weight loss.</p> <p>Findings</p> <p>Women allocated the low GI diet had a statistically significant lower GI of food items (33.67 vs 36.91, p < 0.05), lower percentage of high GI foods (4.3% vs 12.1%, p < 0.05) and lower GL of food items and meals.</p> <p>Conclusion</p> <p>Women with PCOS on a low GI diet consumed food items with a significantly lower mean GI and GL compared to the healthy eating diet group. Longer term compliance needs evaluation in subsequent studies to ascertain that this translates to reduced long term health risks.</p> <p>Trial Registration</p> <p>ISRCTN: <a href="http://www.controlled-trials.com/ISRCTN86420258">ISRCTN86420258</a></p