30 research outputs found

    Implicit Two-Tower Policies

    Full text link
    We present a new class of structured reinforcement learning policy-architectures, Implicit Two-Tower (ITT) policies, where the actions are chosen based on the attention scores of their learnable latent representations with those of the input states. By explicitly disentangling action from state processing in the policy stack, we achieve two main goals: substantial computational gains and better performance. Our architectures are compatible with both: discrete and continuous action spaces. By conducting tests on 15 environments from OpenAI Gym and DeepMind Control Suite, we show that ITT-architectures are particularly suited for blackbox/evolutionary optimization and the corresponding policy training algorithms outperform their vanilla unstructured implicit counterparts as well as commonly used explicit policies. We complement our analysis by showing how techniques such as hashing and lazy tower updates, critically relying on the two-tower structure of ITTs, can be applied to obtain additional computational improvements

    Role of glucose in the repair of cell membrane damage during squeeze distortion of erythrocytes in microfluidic capillaries

    Get PDF
    The rapid development of portable precision detection methods and the crisis of insufficient blood supply worldwide has led scientists to study mechanical visualization features beyond the biochemical properties of erythrocytes. Combined evaluation of currently known biochemical biomarkers and mechanical morphological biomarkers will become the mainstream of single-cell detection in the future. To explore the mechanical morphology of erythrocytes, a microfluidic capillary system was constructedin vitro, with flow velocity and glucose concentration as the main variables, and the morphology and ability of erythrocytes to recover from deformation as the main objects of analysis. We showed the mechanical distortion of erythrocytes under various experimental conditions. Our results showed that glucose plays important roles in improving the ability of erythrocytes to recover from deformation and in repairing the damage caused to the cell membrane during the repeated squeeze process. These protective effects were also confirmed inin vivoexperiments. Our results provide visual detection markers for single-cell chips and may be useful for future studies in cell aging

    Worldwide tests of generic attractants, a promising tool for early detection of non-native cerambycid species

    Get PDF
    A large proportion of the insects which have invaded new regions and countries are emerging species, being found for the first time outside their native range. Being able to detect such species upon arrival at ports of entry before they establish in non-native countries is an urgent challenge. The deployment of traps baited with broad-spectrum semiochemical lures at ports-of-entry and other high-risk sites could be one such early detection tool. Rapid progress in the identification of semiochemicals for cerambycid beetles during the last 15 years has revealed that aggregation-sex pheromones and sex pheromones are often conserved at global levels for genera, tribes or subfamilies of the Cerambycidae. This possibly allows the development of generic attractants which attract multiple species simultaneously, especially when such pheromones are combined into blends. Here, we present the results of a worldwide field trial programme conducted during 2018-2021, using traps baited with a standardised 8-pheromone blend, usually com-plemented with plant volatiles. A total of 1308 traps were deployed at 302 sites covering simultaneously or sequentially 13 European countries, 10 Chinese provinces and some regions of the USA, Canada, Australia, Russia (Siberia) and the Caribbean (Martinique). We intended to test the following hypotheses: 1) if a species is regularly trapped in significant numbers by the blend on a continent, it increases the prob-ability that it can be detected when it arrives in other countries/continents and 2) if the blend exerts an effective, generic attraction to multiple species, it is likely that previously unknown and unexpected spe-cies can be captured due to the high degree of conservation of pheromone structures within related taxa. A total of 78,321 longhorned beetles were trapped, representing 376 species from eight subfamilies, with 84 species captured in numbers greater than 50 individuals. Captures comprised 60 tribes, with 10 tribes including more than nine species trapped on different continents. Some invasive species were captured in both the native and invaded continents. This demonstrates the potential of multipheromone lures as ef-fective tools for the detection of 'unexpected' cerambycid invaders, accidentally translocated outside their native ranges. Adding new pheromones with analogous well-conserved motifs is discussed, as well as the limitations of using such blends, especially for some cerambycid taxa which may be more attracted by the trap colour or other characteristics rather than to the chemical blend

    The Effect of Flow Field on the Initial Formation of Thrombus in Ventricular Assist Devices

    No full text
    Abstract Thrombosis is the main reason for the failure of ventricular assist devices (VADs). It has been acknowledged that the platelet activation induced by the nonphysiological blood flow leads to the increased thrombotic risk. However, due to the complicated influence of the VADs’ flow field and the difficulty in real‐time in situ observation, the mechanisms and process of thrombus formation in VADs remain unclear. In this work, the process of thrombus formation in VADs in vitro experiments is observed. The thrombus is found to form on the middle of the inlet guide vanes first and it is mainly caused by the immediate activation of platelets induced by the high shear rate of the flow field around the vanes and also affected by the rotation of the impeller. Then, subsequent thrombus is found in the tail of guide vanes and around the axle journal, where the blood flow is stagnated and the platelets are activated by the accumulated bioagonists. These findings clarify that the thrombus formed on the inlet guide vanes and the axle journal are dominated by two different mechanisms. This work provides unique insights into the initial formation of the thrombus on VADs and helps to reduce the thrombotic risk

    Adipose Extracellular Matrix/Stromal Vascular Fraction Gel Secretes Angiogenic Factors and Enhances Skin Wound Healing in a Murine Model

    No full text
    Mesenchymal stem cells are an attractive cell type for cytotherapy in wound healing. The authors recently developed a novel, adipose-tissue-derived, injectable extracellular matrix/stromal vascular fraction gel (ECM/SVF-gel) for stem cell therapy. This study was designed to assess the therapeutic effects of ECM/SVF-gel on wound healing and potential mechanisms. ECM/SVF-gel was prepared for use in nude mouse excisional wound healing model. An SVF cell suspension and phosphate-buffered saline injection served as the control. The expression levels of vascular endothelial growth factor (VEGF), basic fibroblast growth factor (bFGF), and monocyte chemotactic protein-1 (MCP-1) in ECM/SVF-gel were analyzed at different time points. Angiogenesis (tube formation) assays of ECM/SVF-gel extracts were evaluated, and vessels density in skin was determined. The ECM/SVF-gel extract promoted tube formation in vitro and increased the expression of the angiogenic factors VEGF and bFGF compared with those in the control. The expression of the inflammatory chemoattractant MCP-1 was high in ECM/SVF-gel at the early stage and decreased sharply during the late stage of wound healing. The potent angiogenic effects exerted by ECM/SVF-gel may contribute to the improvement of wound healing, and these effects could be related to the enhanced inflammatory response in ECM/SVF-gel during the early stage of wound healing

    Pontibacter diazotrophicus sp. nov., a novel nitrogen-fixing bacterium of the family Cytophagaceae.

    No full text
    Few diazotrophs have been found to belong to the family Cytophagaceae so far. In the present study, a Gram-negative, rod-shaped bacterium that forms red colonies, was isolated from sands of the Takalamakan desert. It was designated H4XT. Phylogenetic and biochemical analysis indicated that the isolate is a new species of the genus Pontibacter. The 16S rRNA gene of H4XT displays 94.2-96.8% sequence similarities to those of other strains in Pontibacter. The major respiratory quinone is menaquinone-7 (MK-7). The DNA G+C content is 46.6 mol%. The major cellular fatty acids are iso-C15∶0, C16∶1ω5c, summed feature 3 (containing C16∶1ω6c and/or C16∶1ω7c) and summed feature 4 (comprising anteiso-C17∶1B and/or iso-C17∶1I). The major polar lipids are phosphatidylethanolamine (PE), one aminophospholipid (APL) and some unknown phospholipids (PLs). It is interesting to see that this bacterium can grow very well in a nitrogen-free medium. PCR amplification suggested that the bacterium possesses at least one type of nitrogenase gene. Acetylene reduction assay showed that H4XT actually possesses nitrogen-fixing activity. Therefore, it can be concluded that H4XT is a new diazotroph. We thus referred it to as Pontibacter diazotrophicus sp. nov. The type strain is H4XT ( = CCTCC AB 2013049T = NRRL B-59974T)

    Maximum-likelihood tree based on multiple sequence alignment of the <i>nifH</i> genes from <i>Pontibacter diazotrophicus</i> sp. nov. H4X<sup>T</sup> and other closely related bacterial strains.

    No full text
    <p>Bootstrap values (expressed as percentages of 1000 replicates) that are >75% are shown at branch points. Asterisks indicate that the corresponding nodes were also recovered in the Bayesian tree. Bar, 0.1 substitutions per nucleotide position.</p
    corecore