Dyna-style planning with linear function approximation and prioritized sweeping

We consider the problem of efficiently learning optimal control policies and value functions over large state spaces in an online setting in which estimates must be available after each interaction with the world. This paper develops an explicitly model-based approach extending the Dyna architecture to linear function approximation. Dyna-style planning proceeds by generating imaginary experience from the world model and then applying model-free reinforcement learning algorithms to the imagined state transitions. Our main results are to prove that linear Dyna-style planning converges to a unique solution independent of the generating distribution, under natural conditions. In the policy evaluation setting, we prove that the limit point is the least-squares (LSTD) solution. An implication of our results is that prioritized-sweeping can be soundly extended to the linear approximation case, backing up to preceding features rather than to preceding states. We introduce two versions of prioritized sweeping with linear Dyna and briefly illustrate their performance empirically on the Mountain Car and Boyan Chain problems

Development and Utility of Quality Metrics for Ambulatory Pediatric Cardiology in Kawasaki Disease.

The Adult Congenital and Pediatric Cardiology (ACPC) Section of the American College of Cardiology sought to develop quality indicators/metrics for ambulatory pediatric cardiology practice. The objective of this study was to report the creation of metrics for patients with Kawasaki disease. Over a period of 5 months, 12 pediatric cardiologists developed 24 quality metrics based on the most relevant statements, guidelines, and research studies pertaining to Kawasaki disease. Of the 24 metrics, the 8 metrics deemed the most important, feasible, and valid were sent on to the ACPC for consideration. Seven of the 8 metrics were approved using the RAND method by an expert panel. All 7 metrics approved by the ACPC council were accepted by ACPC membership after an "open comments" process. They have been disseminated to the pediatric cardiology community for implementation by the ACPC Quality Network

Power Law Scaling for a System of Interacting Units with Complex Internal Structure

We study the dynamics of a system composed of interacting units each with a complex internal structure comprising many subunits. We consider the case in which each subunit grows in a multiplicative manner. We propose a model for such systems in which the interaction among the units is treated in a mean field approximation and the interaction among subunits is nonlinear. To test the model, we identify a large data base spanning 20 years, and find that the model correctly predicts a variety of empirical results.Comment: 4 pages with 4 postscript figures (uses Revtex 3.1, Latex2e, multicol.sty, epsf.sty and rotate.sty). Submitted to PR

Modulation of synaptic function by VAC14, a protein that regulates the phosphoinositides PI(3,5)P 2 and PI(5)P

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/102191/1/embj2012200.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/102191/2/embj2012200-sup-0001.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/102191/3/embj2012200-reviewer_comments.pd

Evidence for Recipient-Derived Cells in Peribiliary Glands and Biliary Epithelium of the Large Donor Bile Ducts After Liver Transplantation

Introduction Chimerism after orthotopic liver transplantation (OLT) has largely been investigated in intrahepatic cellular constituents. However, little is known about chimerism in the extrahepatic and large intrahepatic bile ducts. Our aim was to evaluate the presence and extent of chimerism after OLT in the peribiliary glands (PBG) and the luminal epithelium of the large donor bile ducts. Methods For this study, we examined six extrahepatic and large intrahepatic bile ducts from livers that were re-transplanted. In all cases there was a sex-mismatch between donor and recipient (female donor organ and male recipient), which allowed to discriminate between donor- and recipient-derived cells. Specimens from female to female transplants were used as negative controls and male to male transplants as positive controls. Fluorescencein situhybridization (FISH) for Y and X chromosomes was performed and the percentage of XY positive cells was determined among biliary epithelial cells. Immunohistochemistry was used to correlate chimerism with histological features. Results Cholangiocellular chimerism in all studied specimens ranged from 14 to 52%. The degree of chimerism was not associated with biliary damage. Marked chimerism was present at 5 days post-OLT. Ki-67-positivity was detected in 1-8% of the epithelial cells at the time of liver re-transplantation, and this correlated inversely with the degree of chimerism. Conclusion Recipient-derived cholangiocytes are present in the large bile ducts of the donor liver after OLT. The presence of chimerism in the large bile ducts suggests that recipient-derived cells may play a role in biliary regeneration following ischemia-induced injury during OLT

Health-state utilities in a prisoner population : a cross-sectional survey

Background: Health-state utilities for prisoners have not been described. Methods: We used data from a 1996 cross-sectional survey of Australian prisoners (n = 734). Respondent-level SF-36 data was transformed into utility scores by both the SF-6D and Nichol's method. Socio-demographic and clinical predictors of SF-6D utility were assessed in univariate analyses and a multivariate general linear model. Results: The overall mean SF-6D utility was 0.725 (SD 0.119). When subdivided by various medical conditions, prisoner SF-6D utilities ranged from 0.620 for angina to 0.764 for those with none/mild depressive symptoms. Utilities derived by the Nichol's method were higher than SF-6D scores, often by more than 0.1. In multivariate analysis, significant independent predictors of worse utility included female gender, increasing age, increasing number of comorbidities and more severe depressive symptoms. Conclusion: The utilities presented may prove useful for future economic and decision models evaluating prison-based health programs

A questionnaire to identify patellofemoral pain in the community: an exploration of measurement properties

Background Community-based studies of patellofemoral pain (PFP) need a questionnaire tool that discriminates between those with and those without the condition. To overcome these issues, we have designed a self-report questionnaire which aims to identify people with PFP in the community. Methods Study designs: comparative study and cross-sectional study. Study population: comparative study: PFP patients, soft-tissue injury patients and adults without knee problems. Cross-sectional study: adults attending a science festival. Intervention: comparative study participants completed the questionnaire at baseline and two weeks later. Cross-sectional study participants completed the questionnaire once. The optimal scoring system and threshold was explored using receiver operating characteristic curves, test-retest reliability using Cohen’s kappa and measurement error using Bland-Altman plots and standard error of measurement. Known-group validity was explored by comparing PFP prevalence between genders and age groups. Results Eighty-four participants were recruited to the comparative study. The receiver operating characteristic curves suggested limiting the questionnaire to the clinical features and knee pain map sections (AUC 0.97 95 % CI 0.94 to 1.00). This combination had high sensitivity and specificity (over 90 %). Measurement error was less than the mean difference between the groups. Test–retest reliability estimates suggest good agreement (N = 51, k = 0.74, 95 % CI 0.52–0.91). The cross-sectional study (N = 110) showed expected differences between genders and age groups but these were not statistically significant. Conclusion A shortened version of the questionnaire, based on clinical features and a knee pain map, has good measurement properties. Further work is needed to validate the questionnaire in community samples

Isolation of a potently neutralizing and protective human monoclonal antibody targeting yellow fever virus

Yellow fever virus (YFV) causes sporadic outbreaks of infection in South America and sub-Saharan Africa. While live-attenuated yellow fever virus vaccines based on three substrains of 17D are considered some of the most effective vaccines in use, problems with production and distribution have created large populations of unvaccinated, vulnerable individuals in areas of endemicity. To date, specific antiviral therapeutics have not been licensed for human use against YFV or any other related flavivirus. Recent advances in monoclonal antibody (mAb) technology have allowed the identification of numerous candidate therapeutics targeting highly pathogenic viruses, including many flaviviruses. Here, we sought to identify a highly neutralizing antibody targeting the YFV envelope (E) protein as a therapeutic candidate. We used human B cell hybridoma technology to isolate mAbs from circulating memory B cells from human YFV vaccine recipients. These antibodies bound to recombinant YFV E protein and recognized at least five major antigenic sites on E. Two mAbs (designated YFV-136 and YFV-121) recognized a shared antigenic site and neutralized the YFV-17D vaccine strai