255 research outputs found
On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART
Word ordering is a constrained language generation task taking unordered
words as input. Existing work uses linear models and neural networks for the
task, yet pre-trained language models have not been studied in word ordering,
let alone why they help. We use BART as an instance and show its effectiveness
in the task. To explain why BART helps word ordering, we extend analysis with
probing and empirically identify that syntactic dependency knowledge in BART is
a reliable explanation. We also report performance gains with BART in the
related partial tree linearization task, which readily extends our analysis.Comment: COLING 202
Experiments and Models of Thermo-Induced Shape Memory Polymers
Recent advances in experiments and models of thermo-induced shape memory polymers (TSMPs) were reviewed. Some important visco-elastic and visco-plastic features, such as rate-dependent and temperature-dependent stress-strain curves and nonuniform temperature distribution were experimentally investigated, and the interaction between the mechanical deformation and the internal heat generation was discussed. The influences of loading rate and peak strain on the shape memory effect (SME) and shape memory degeneration of TSMPs were revealed under monotonic and cyclic thermo-mechanical loadings, respectively. Based on experimental observations, the capability of recent developed visco-elastic and visco-plastic models for predicting the SME was evaluated, and the thermo-mechanically coupled models were used to reasonably predict the thermo-mechanical responses of TSMPs
PiML Toolbox for Interpretable Machine Learning Model Development and Diagnostics
PiML (read -ML, /`pai`em`el/) is an integrated and open-access Python
toolbox for interpretable machine learning model development and model
diagnostics. It is designed with machine learning workflows in both low-code
and high-code modes, including data pipeline, model training and tuning, model
interpretation and explanation, and model diagnostics and comparison. The
toolbox supports a growing list of interpretable models (e.g. GAM, GAMI-Net,
XGB1/XGB2) with inherent local and/or global interpretability. It also supports
model-agnostic explainability tools (e.g. PFI, PDP, LIME, SHAP) and a powerful
suite of model-agnostic diagnostics (e.g. weakness, reliability, robustness,
resilience, fairness). Integration of PiML models and tests to existing MLOps
platforms for quality assurance are enabled by flexible high-code APIs.
Furthermore, PiML toolbox comes with a comprehensive user guide and hands-on
examples, including the applications for model development and validation in
banking. The project is available at
https://github.com/SelfExplainML/PiML-Toolbox
How broad is the selfing syndrome? Insights from convergent evolution of gene expression across species and tissues in the Capsella genus
The shift from outcrossing to selfing is one of the main evolutionary transitions in plants. It is accompanied by profound effects on reproductive traits, the so-called selfing syndrome. Because the transition to selfing also implies deep genomic and ecological changes, one also expects to observe a genomic selfing syndrome. We took advantage of the three independent transitions from outcrossing to selfing in the Capsella genus to characterize the overall impact of mating system change on RNA expression, in flowers but also in leaves and roots. We quantified the extent of both selfing and genomic syndromes, and tested whether changes in expression corresponded to adaptation to selfing or to relaxed selection on traits that were constrained in outcrossers. Mating system change affected gene expression in all three tissues but more so in flowers than in roots and leaves. Gene expression in selfing species tended to converge in flowers but diverged in the two other tissues. Hence, convergent adaptation to selfing dominates in flowers, whereas genetic drift plays a more important role in leaves and roots. The effect of mating system transition is not limited to reproductive tissues and corresponds to both adaptation to selfing and relaxed selection on previously constrained traits
- …