Diverse auto-curriculum is critical for successful real-world multiagent learning systems

Multiagent reinforcement learning (MARL) has achieved a remarkable amount of success in solving various types of video games. A cornerstone of this success is the auto-curriculum framework, which shapes the learning process by continually creating new challenging tasks for agents to adapt to, thereby facilitating the acquisition of new skills. In order to extend MARL methods to real-world domains outside of video games, we envision in this blue sky paper that maintaining a diversity-aware auto-curriculum is critical for successful MARL applications. Specifically, we argue that behavioural diversity is a pivotal, yet under-explored, component for real-world multiagent learning systems, and that significant work remains in understanding how to design a diversity-aware auto-curriculum. We list four open challenges for auto-curriculum techniques, which we believe deserve more attention from this community. Towards validating our vision, we recommend modelling realistic interactive behaviours in autonomous driving as an important test bed, and recommend the SMARTS/ULTRA benchmark

Hypertensive patients' use of blood pressure monitors stationed in pharmacies and other locations: a cross-sectional mail survey

<p>Abstract</p> <p>Background</p> <p>Blood pressure (BP) monitors are commonly stationed in public places such as pharmacies, but it is uncertain how many people with hypertension currently use them. We sought to estimate the proportion of hypertensive patients who use these types of monitors and examine whether use varies by demographic or health characteristics.</p> <p>Methods</p> <p>We conducted a cross-sectional mail survey of hypertensive adults enrolled in a practice based research network of 24 primary care practices throughout the state of North Carolina. We analyzed results using descriptive statistics and examined bivariate associations using chi-square and independent associations using logistic regression.</p> <p>Results</p> <p>We received 530 questionnaires (76% response rate). Of 333 respondents (63%) who reported checking their BP in locations other than their doctor's office or home, 66% reported using a monitor stationed in a pharmacy. Younger patients more commonly reported using pharmacy monitors (48% among those < 45 years vs 35% of those over 65, p = 0.04). Blacks reported using them more commonly than whites (48% vs 39%, p = 0.03); and high school graduates more often than those with at least some college (50% vs 37%, p = 0.02). In multivariate analysis, younger age (aOR 1.49; 95% CI 1.00–2.21 for those age 45 to 65 years vs those > 65 years old) and high school education (aOR 1.74; 95% CI 1.13–2.58) were associated with use of pharmacy-stationed monitors, but Black race was not. Patients with diabetes, heart disease, or stroke were not more likely to use pharmacy-stationed monitors.</p> <p>Conclusion</p> <p>Hypertensive patients' use of BP monitors located in pharmacies is common. Younger patients, Blacks, and those with high school education were slightly more likely to report using them. Because use of these monitors is so common, efforts to ensure their accuracy are important.</p

Strict evolutionary conservation followed rapid gene loss on human and rhesus Y chromosomes

The human X and Y chromosomes evolved from an ordinary pair of autosomes during the past 200–300 million years[superscript 1, 2, 3]. The human MSY (male-specific region of Y chromosome) retains only three percent of the ancestral autosomes’ genes owing to genetic decay[superscript 4, 5]. This evolutionary decay was driven by a series of five ‘stratification’ events. Each event suppressed X–Y crossing over within a chromosome segment or ‘stratum’, incorporated that segment into the MSY and subjected its genes to the erosive forces that attend the absence of crossing over[superscript 2, 6]. The last of these events occurred 30 million years ago, 5 million years before the human and Old World monkey lineages diverged. Although speculation abounds regarding ongoing decay and looming extinction of the human Y chromosome[superscript 7, 8, 9, 10], remarkably little is known about how many MSY genes were lost in the human lineage in the 25 million years that have followed its separation from the Old World monkey lineage. To investigate this question, we sequenced the MSY of the rhesus macaque, an Old World monkey, and compared it to the human MSY. We discovered that during the last 25 million years MSY gene loss in the human lineage was limited to the youngest stratum (stratum 5), which comprises three percent of the human MSY. In the older strata, which collectively comprise the bulk of the human MSY, gene loss evidently ceased more than 25 million years ago. Likewise, the rhesus MSY has not lost any older genes (from strata 1–4) during the past 25 million years, despite its major structural differences to the human MSY. The rhesus MSY is simpler, with few amplified gene families or palindromes that might enable intrachromosomal recombination and repair. We present an empirical reconstruction of human MSY evolution in which each stratum transitioned from rapid, exponential loss of ancestral genes to strict conservation through purifying selection

Comparative mitochondrial proteomics: perspective in human diseases

Mitochondria are the most complex and the most important organelles of eukaryotic cells, which are involved in many cellular processes, including energy metabolism, apoptosis, and aging. And mitochondria have been identified as the "hot spot" by researchers for exploring relevant associated dysfunctions in many fields. The emergence of comparative proteomics enables us to have a close look at the mitochondrial proteome in a comprehensive and effective manner under various conditions and cellular circumstances. Two-dimensional electrophoresis combined with mass spectrometry is still the most popular techniques to study comparative mitochondrial proteomics. Furthermore, many new techniques, such as ICAT, MudPIT, and SILAC, equip researchers with more flexibilities inselecting proper methods. This article also reviews the recent development of comparative mitochondrial proteomics on diverse human diseases. And the results of mitochondrial proteomics enhance a better understanding of the pathogenesis associated with mitochondria and provide promising therapeutic targets

Selective inhibition of the human tie-1 promoter with triplex-forming oligonucleotides targeted to ets binding sites

The Tie receptors (Tie-1 and Tie-2/Tek) are essential for angiogenesis and vascular remodeling/integrity. Tie receptors are up-regulated in tumor-associated endothelium, and their inhibition disrupts angiogenesis and can prevent tumor growth as a consequence. To investigate the potential of anti-gene approaches to inhibit tie gene expression for anti-angiogenic therapy, we have examined triple-helical (triplex) DNA formation at 2 tandem Ets transcription factor binding motifs (designated E-1 and E-2) in the human tie-1 promoter. Various tie-1 promoter deletion/mutation luciferase reporter constructs were generated and transfected into endothelial cells to examine the relative activities of E-1 and E-2. The binding of antiparallel and parallel (control) purine motif oligonucleotides (21-22 bp) targeted to E-1 and E-2 was assessed by plasmid DNA fragment binding and electrophoretic mobility shift assays. Triplex-forming oligonucleotides were incubated with tie-1 reporter constructs and transfected into endothelial cells to determine their activity. The Ets binding motifs in the E-1 sequence were essential for human tie-1 promoter activity in endothelial cells, whereas the deletion of E-2 had no effect. Antiparallel purine motif oligonucleotides targeted at E-1 or E-2 selectively formed strong triplex DNA (K(d) approximately 10(-7) M) at 37 degrees C. Transfection of tie-1 reporter constructs with triplex DNA at E-1, but not E-2, specifically inhibited tie-1 promoter activity by up to 75% compared with control oligonucleotides in endothelial cells. As similar multiple Ets binding sites are important for the regulation of several endothelial-restricted genes, this approach may have broad therapeutic potential for cancer and other pathologies involving endothelial proliferation/dysfunction

Alterations in osteoclast function and phenotype induced by different inhibitors of bone resorption - implications for osteoclast quality

<p>Abstract</p> <p>Background</p> <p>Normal osteoclasts resorb bone by secretion of acid and proteases. Recent studies of patients with loss of function mutations affecting either of these processes have indicated a divergence in osteoclastic phenotypes. These difference in osteoclast phenotypes may directly or indirectly have secondary effects on bone remodeling, a process which is of importance for the pathogenesis of both osteoporosis and osteoarthritis. We treated human osteoclasts with different inhibitors and characterized their resulting function.</p> <p>Methods</p> <p>Human CD14 + monocytes were differentiated into mature osteoclasts using RANKL and M-CSF. The osteoclasts were cultured on bone in the presence or absence of various inhibitors: Inhibitors of acidification (bafilomycin A1, diphyllin, ethoxyzolamide), inhibitors of proteolysis (E64, GM6001), or a bisphosphonate (ibandronate). Osteoclast numbers and bone resorption were monitored by measurements of TRACP activity, the release of calcium, CTX-I and ICTP, as well as by counting resorption pits.</p> <p>Results</p> <p>All inhibitors of acidification were equally potent with respect to inhibition of both organic and inorganic resorption. In contrast, inhibition of proteolysis by E64 potently reduced organic resorption, but only modestly suppressed inorganic resorption. GM6001 alone did not greatly affect bone resorption. However, when GM6001 and E64 were combined, a complete abrogation of organic bone resorption was observed, without a great effect on inorganic resorption. Ibandronate abrogated both organic and inorganic resorption at all concentrations tested [0.3-100 μM], however, this treatment dramatically reduced TRACP activity.</p> <p>Conclusions</p> <p>We present evidence highlighting important differences with respect to osteoclast function, when comparing the different types of osteoclast inhibitors. Each class of osteoclast inhibitors will lead to different alterations in osteoclast quality, which secondarily may lead to different bone qualities.</p