255 research outputs found

    On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART

    Full text link
    Word ordering is a constrained language generation task taking unordered words as input. Existing work uses linear models and neural networks for the task, yet pre-trained language models have not been studied in word ordering, let alone why they help. We use BART as an instance and show its effectiveness in the task. To explain why BART helps word ordering, we extend analysis with probing and empirically identify that syntactic dependency knowledge in BART is a reliable explanation. We also report performance gains with BART in the related partial tree linearization task, which readily extends our analysis.Comment: COLING 202

    Experiments and Models of Thermo-Induced Shape Memory Polymers

    Get PDF
    Recent advances in experiments and models of thermo-induced shape memory polymers (TSMPs) were reviewed. Some important visco-elastic and visco-plastic features, such as rate-dependent and temperature-dependent stress-strain curves and nonuniform temperature distribution were experimentally investigated, and the interaction between the mechanical deformation and the internal heat generation was discussed. The influences of loading rate and peak strain on the shape memory effect (SME) and shape memory degeneration of TSMPs were revealed under monotonic and cyclic thermo-mechanical loadings, respectively. Based on experimental observations, the capability of recent developed visco-elastic and visco-plastic models for predicting the SME was evaluated, and the thermo-mechanically coupled models were used to reasonably predict the thermo-mechanical responses of TSMPs

    PiML Toolbox for Interpretable Machine Learning Model Development and Diagnostics

    Full text link
    PiML (read π\pi-ML, /`pai`em`el/) is an integrated and open-access Python toolbox for interpretable machine learning model development and model diagnostics. It is designed with machine learning workflows in both low-code and high-code modes, including data pipeline, model training and tuning, model interpretation and explanation, and model diagnostics and comparison. The toolbox supports a growing list of interpretable models (e.g. GAM, GAMI-Net, XGB1/XGB2) with inherent local and/or global interpretability. It also supports model-agnostic explainability tools (e.g. PFI, PDP, LIME, SHAP) and a powerful suite of model-agnostic diagnostics (e.g. weakness, reliability, robustness, resilience, fairness). Integration of PiML models and tests to existing MLOps platforms for quality assurance are enabled by flexible high-code APIs. Furthermore, PiML toolbox comes with a comprehensive user guide and hands-on examples, including the applications for model development and validation in banking. The project is available at https://github.com/SelfExplainML/PiML-Toolbox

    How broad is the selfing syndrome? Insights from convergent evolution of gene expression across species and tissues in the Capsella genus

    Get PDF
    The shift from outcrossing to selfing is one of the main evolutionary transitions in plants. It is accompanied by profound effects on reproductive traits, the so-called selfing syndrome. Because the transition to selfing also implies deep genomic and ecological changes, one also expects to observe a genomic selfing syndrome. We took advantage of the three independent transitions from outcrossing to selfing in the Capsella genus to characterize the overall impact of mating system change on RNA expression, in flowers but also in leaves and roots. We quantified the extent of both selfing and genomic syndromes, and tested whether changes in expression corresponded to adaptation to selfing or to relaxed selection on traits that were constrained in outcrossers. Mating system change affected gene expression in all three tissues but more so in flowers than in roots and leaves. Gene expression in selfing species tended to converge in flowers but diverged in the two other tissues. Hence, convergent adaptation to selfing dominates in flowers, whereas genetic drift plays a more important role in leaves and roots. The effect of mating system transition is not limited to reproductive tissues and corresponds to both adaptation to selfing and relaxed selection on previously constrained traits
    • …
    corecore