Building collaboration in multi-agent systems using reinforcement learning

© Springer Nature Switzerland AG 2018. This paper presents a proof-of concept study for demonstrating the viability of building collaboration among multiple agents through standard Q learning algorithm embedded in particle swarm optimisation. Collaboration is formulated to be achieved among the agents via competition, where the agents are expected to balance their action in such a way that none of them drifts away of the team and none intervene any fellow neighbours territory, either. Particles are devised with Q learning for self training to learn how to act as members of a swarm and how to produce collaborative/collective behaviours. The produced experimental results are supportive to the proposed idea suggesting that a substantive collaboration can be build via proposed learning algorithm

Cognitive and environmental predictors of early literacy skills

Not all young children benefit from book exposure in preschool age. It is claimed that the ability to hold information in mind (short-term memory), to ignore distraction (inhibition), and to focus attention and stay focused (sustained attention) may have a moderating effect on children’s reactions to the home literacy environment. In a group of 228 junior kindergarten children with a native Dutch background, with a mean age of 54.29 months (SD = 2.12 months), we explored therefore the relationship between book exposure, cognitive control and early literacy skills. Parents filled in a HLE questionnaire (book sharing frequency and an author recognition checklist as indicator of parental leisure reading habits), and children completed several tests in individual sessions with the researcher (a book-cover recognition test, PPVT, letter knowledge test, the subtests categories and patterns of the SON, and cognitive control measures namely digit span of the KABC, a peg tapping task and sustained attention of the ANT). Main findings were: (1) Children’s storybook knowledge mediated the relationship between home literacy environment and literacy skills. (2) Both vocabulary and letter knowledge were predicted by book exposure. (3) Short-term memory predicted vocabulary over and above book exposure. (4) None of the cognitive control mechanisms moderated the beneficial effects of book exposure

Genome-Wide Gene Expression Analysis Suggests an Important Role of Suppressed Immunity in Pathogenesis of Kashin-Beck Disease

OBJECTIVE: To investigate the differences between the gene expression profiles in peripheral blood mononuclear cells (PBMC) from normal controls and patients with Kashin-Beck disease (KBD). METHODS: Twenty KBD patients and 12 normal subjects were selected from a KBD-endemic area and divided into four pairs of KBD vs. control (KBD, n = 5 per pair; control, n = 3 per pair). RNAs were respectively isolated from KBD PBMCs and normal PBMCs. Gene expression profiles were analyzed by oligonucleotide microarray. The gene expression profiles in PBMCs from KBD patients and normal controls were compared and the differentially expressed genes were identified. The obtained microarray data was further confirmed by using quantitative real-time reverse transcription polymerase chain reaction (qRT-PCR). RESULTS: Approximately 501 genes, corresponding to 2.4% of the total probe transcripts, showed a 2-fold change in differential expression. 19.4% (97 out of 501)of the differentially expressed genes were commonly detected in all the four pairs. Among the 97 differentially expressed genes, 83 genes were up-regulated and 14 genes were down-regulated, compared with those in the normal controls. Some differentially expressed genes were found to be related to functions such as immunity, metabolism, apoptosis, cystoskeleton and cell movement, and extracellular matrix. The validity of our microarray data were supported by the results of qRT-PCR assay. CONCLUSION: Differences in the PBMC gene expression profile between the KBD patients and the normal controls exhibited a similar pattern among all the four pairs of microarrays examined, indicating that the suppressed immunity may play an important role in the pathogenesis of KBD

Human Blood Vessel–Derived Endothelial Progenitors for Endothelialization of Small Diameter Vascular Prosthesis

BACKGROUND:Coronary bypass graft failure as a result of acute thrombosis and intimal hyperplasia has been the major challenge in surgical procedures involving small-diameter vascular prosthesis. Coating synthetic grafts with patients' own endothelial cells has been suggested to improve the patency rate and overall success of bypass surgeries. METHODOLOGY/PRINCIPAL FINDINGS:We isolated endothelial progenitor cells (EPCs) from leftover pieces of human saphenous vein/mammary artery. We demonstrate that EPCs can be expanded to generate millions of cells under low-density culture conditions. Exposure to high-density conditions induces differentiation to endothelial cell phenotype. EPC-derived endothelial cells show expression of CD144high, CD31, and vWF. We then assessed the ability of differentiated endothelial cells to adhere and grow on small diameter expanded polytetrafluoroethylene (ePTFE) tubings. Since ePTFE tubings are highly hydrophobic, we optimized protocols to introduce hydrophilic groups on luminal surface of ePTFE tubings. We demonstrate here a stepwise protocol that involves introduction of hydrophilic moieties and coating with defined ECM components that support adhesion of endothelial cells, but not of blood platelets. CONCLUSION/SIGNIFICANCE:Our data confirms that endothelial progenitors obtained from adult human blood vessels can be expanded in vitro under xenoprotein-free conditions, for potential use in endothelialization of small diameter ePTFE grafts. These endothelialized grafts may represent a promising treatment strategy for improving the clinical outcome of small-caliber vascular grafts in cardiac bypass surgeries

Cytotoxic and apoptotic evaluations of marine bacteria isolated from brine-seawater interface of the Red Sea.

BACKGROUND: High salinity and temperature combined with presence of heavy metals and low oxygen renders deep-sea anoxic brines of the Red Sea as one of the most extreme environments on Earth. The ability to adapt and survive in these extreme environments makes inhabiting bacteria interesting candidates for the search of novel bioactive molecules. METHODS: Total 20 i.e. lipophilic (chloroform) and hydrophilic (70% ethanol) extracts of marine bacteria isolated from brine-seawater interface of the Red Sea were tested for cytotoxic and apoptotic activity against three human cancer cell lines, i.e. HeLa (cervical carcinoma), MCF-7 (Breast Adenocarcinoma) and DU145 (Prostate carcinoma). RESULTS: Among these, twelve extracts were found to be very active after 24 hours of treatment, which were further evaluated for their cytotoxic and apoptotic effects at 48 hr. The extracts from the isolates P1-37B and P3-37A (Halomonas) and P1-17B (Sulfitobacter) have been found to be the most potent against tested cancer cell lines. CONCLUSION: Overall, bacterial isolates from the Red Sea displayed promising results and can be explored further to find novel drug-like molecules. The cell line specific activity of the extracts may be attributed to the presence of different polarity compounds or the cancer type i.e. biological differences in cell lines and different mechanisms of action of programmed cell death prevalent in different cancer cell lines

A defined mechanistic correlate of protection against Plasmodium falciparum malaria in non-human primates.

Malaria vaccine design and prioritization has been hindered by the lack of a mechanistic correlate of protection. We previously demonstrated a strong association between protection and merozoite-neutralizing antibody responses following vaccination of non-human primates against Plasmodium falciparum reticulocyte binding protein homolog 5 (PfRH5). Here, we test the mechanism of protection. Using mutant human IgG1 Fc regions engineered not to engage complement or FcR-dependent effector mechanisms, we produce merozoite-neutralizing and non-neutralizing anti-PfRH5 chimeric monoclonal antibodies (mAbs) and perform a passive transfer-P. falciparum challenge study in Aotus nancymaae monkeys. At the highest dose tested, 6/6 animals given the neutralizing PfRH5-binding mAb c2AC7 survive the challenge without treatment, compared to 0/6 animals given non-neutralizing PfRH5-binding mAb c4BA7 and 0/6 animals given an isotype control mAb. Our results address the controversy regarding whether merozoite-neutralizing antibody can cause protection against P. falciparum blood-stage infections, and highlight the quantitative challenge of achieving such protection

Immunisation with Recombinant PfEMP1 Domains Elicits Functional Rosette-Inhibiting and Phagocytosis-Inducing Antibodies to Plasmodium falciparum

BACKGROUND: Rosetting is a Plasmodium falciparum virulence factor implicated in the pathogenesis of life-threatening malaria. Rosetting occurs when parasite-derived P. falciparum Erythrocyte Membrane Protein One (PfEMP1) on the surface of infected erythrocytes binds to human receptors on uninfected erythrocytes. PfEMP1 is a possible target for a vaccine to induce antibodies to inhibit rosetting and prevent severe malaria. METHODOLOGY/FINDINGS: We examined the vaccine potential of the six extracellular domains of a rosette-mediating PfEMP1 variant (ITvar9/R29var1 from the R29 parasite strain) by immunizing rabbits with recombinant proteins expressed in E. coli. Antibodies raised to each domain were tested for surface fluorescence with live infected erythrocytes, rosette inhibition and phagocytosis-induction. Antibodies to all PfEMP1 domains recognized the surface of live infected erythrocytes down to low concentrations (0.02-1.56 µg/ml of total IgG). Antibodies to all PfEMP1 domains except for the second Duffy-Binding-Like region inhibited rosetting (50% inhibitory concentration 0.04-4 µg/ml) and were able to opsonize and induce phagocytosis of infected erythrocytes at low concentrations (1.56-6.25 µg/ml). Antibodies to the N-terminal region (NTS-DBL1α) were the most effective in all assays. All antibodies were specific for the R29 parasite strain, and showed no functional activity against five other rosetting strains. CONCLUSIONS/SIGNIFICANCE: These results are encouraging for vaccine development as they show that potent antibodies can be generated to recombinant PfEMP1 domains that will inhibit rosetting and induce phagocytosis of infected erythrocytes. However, further work is needed on rosetting mechanisms and cross-reactivity in field isolates to define a set of PfEMP1 variants that could induce functional antibodies against a broad range of P. falciparum rosetting parasites

Correlates of physical activity and sitting time in adults with type 2 diabetes attending primary health care in Oman

Abstract Background Despite evidence of the benefits of physical activity in the management of type 2 diabetes, it is poorly addressed in diabetes care. This study aimed to identify the prevalence and correlates of meeting ≥600MET-min/wk. (150 min/wk) of physical activity and sitting time in adults with type 2 diabetes in Oman. Approaches to encourage physical activity in diabetes care were explored. Methods A cross-sectional study using the Global Physical Activity Questionnaire was conducted in 17 randomly selected primary health centres in Muscat. Clinical data including co-morbidities were extracted from the health information system. Questions on physical activity preferences and approaches were included. Patients were approached if they were ≥18 years, and had been registered in the diabetes clinic for >2 years. Results The questionnaire was completed by 305 people (females 57% and males 43%). Mean age (SD) was 57 (10.8) years and mean BMI (SD) was 31.0 (6.0) kg/m2. Duration of diabetes ranged from 2 to 25 (mean 7.6) years. Hypertension (71%) and dyslipidaemia (62%) were common comorbidities. Most (58.4%) had an HbA1c ≥7% indicating poor glycaemic control (55% in males vs 61% in females). Physical activity recommendations were met by 21.6% of the participants, mainly through leisure activities. Odds of meeting the recommendations were significantly higher in males (OR 4.8, 95% CI 2.5–9.1), individuals ≤57 years (OR 3.0, 95% CI 1.6–5.9), those at active self-reported stages of change for physical activity (OR 2.2, 95% CI 1.2–4.1) and those reporting no barriers to performing physical activity (OR 2.7, 95% CI 1.4–4.9). Median (25th, 75th percentiles) sitting time was 705 (600, 780) min/d. Older age (>57 years) was associated with longer sitting time (>705 min/d) (OR 2.8, 95% CI 1.7–4.6). Preferred methods to support physical activity in routine diabetes care were consultations (38%), structured physical activity sessions (13.4%) and referrals to physical activity facilities (5.6%) delivered by a variety of health care providers. Conclusions The results suggest that intervention strategies should take account of gender, age, opportunities within daily life to promote active behaviour and readiness to change. Offering physical activity consultations is of interest to this study population, thus development and evaluation of interventions are warranted

The use of antenatal and postnatal care: perspectives and experiences of women and health care providers in rural southern Tanzania

BACKGROUND\ud \ud Although antenatal care coverage in Tanzania is high, worrying gaps exist in terms of its quality and ability to prevent, diagnose or treat complications. Moreover, much less is known about the utilisation of postnatal care, by which we mean the care of mother and baby that begins one hour after the delivery until six weeks after childbirth. We describe the perspectives and experiences of women and health care providers on the use of antenatal and postnatal services.\ud \ud METHODS\ud \ud From March 2007 to January 2008, we conducted in-depth interviews with health care providers and village based informants in 8 villages of Lindi Rural and Tandahimba districts in southern Tanzania. Eight focus group discussions were also conducted with women who had babies younger than one year and pregnant women. The discussion guide included information about timing of antenatal and postnatal services, perceptions of the rationale and importance of antenatal and postnatal care, barriers to utilisation and suggestions for improvement.\ud \ud RESULTS\ud \ud Women were generally positive about both antenatal and postnatal care. Among common reasons mentioned for late initiation of antenatal care was to avoid having to make several visits to the clinic. Other concerns included fear of encountering wild animals on the way to the clinic as well as lack of money. Fear of caesarean section was reported as a factor hindering intrapartum care-seeking from hospitals. Despite the perceived benefits of postnatal care for children, there was a total lack of postnatal care for the mothers. Shortages of staff, equipment and supplies were common complaints in the community.\ud \ud CONCLUSION\ud \ud Efforts to improve antenatal and postnatal care should focus on addressing geographical and economic access while striving to make services more culturally sensitive. Antenatal and postnatal care can offer important opportunities for linking the health system and the community by encouraging women to deliver with a skilled attendant. Addressing staff shortages through expanding training opportunities and incentives to health care providers and developing postnatal care guidelines are key steps to improve maternal and newborn health