The University of Edinburgh's Bengali-Hindi Submissions to the WMT21 News Translation Task

We describe the University of Edinburgh's Bengali$Hindi constrained systems submitted to the WMT21 News Translation task. We submitted ensembles of Transformer models built with large-scale back-translation and fine-tuned on subsets of training data retrieved based on similarity to the target domain

Western North Pacific tropical cyclone model tracks in present and future climates

Western North Pacific tropical cyclone (TC) model tracks are analyzed in two large multimodel ensembles, spanning a large variety of models and multiple future climate scenarios. Two methodologies are used to synthesize the properties of TC tracks in this large data set: cluster analysis and mass moment ellipses. First, the models' TC tracks are compared to observed TC tracks' characteristics, and a subset of the models is chosen for analysis, based on the tracks' similarity to observations and sample size. Potential changes in track types in a warming climate are identified by comparing the kernel smoothed probability distributions of various track variables in historical and future scenarios using a Kolmogorov-Smirnov significance test. Two track changes are identified. The first is a statistically significant increase in the north-south expansion, which can also be viewed as a poleward shift, as TC tracks are prevented from expanding equatorward due to the weak Coriolis force near the equator. The second change is an eastward shift in the storm tracks that occur near the central Pacific in one of the multimodel ensembles, indicating a possible increase in the occurrence of storms near Hawaii in a warming climate. The dependence of the results on which model and future scenario are considered emphasizes the necessity of including multiple models and scenarios when considering future changes in TC characteristics

On the Integration of Similarity Measures with Machine Learning Models to Enhance Text Classification Performance

Several techniques have long been proposed to enhance text classification performance, such as: classifier ensembles, feature selection, the integration of similarity measures with classifiers, and meta-heuristic algorithms. The integration of similarity measures with machine learning models (ML), however, has not yet received thorough analysis for text classification. As a result, in an effort to thoroughly investigate the impact of similarity measures integration with ML models, this work makes three major contributions: (1) proposing newly-integrated models and presenting benchmarking studies for integration methodology over balanced/imbalanced datasets; (2) offering detailed analysis for dozens of integrated models that are established, and experimentally proven, to significantly outperform state-of-the-art performance. The models\u27 construction used fourteen similarity measures, three knowledge representations (BoW, TFIDF, and Word embedding), and five models (Support Vector Machine, N-Centroid-based Classifier, Multinomial Naïve Bayesian, Convolutional Neural Network, and Artificial Neural Network); and (3) introducing significantly-effective and highly-efficient variations of these five models. The evaluation study has been conducted internally for integrated models against their baselines, and externally against the state-of-the-art models. While the internal evaluation constantly showed a total enhancement rate of 49.3% and 59% over the balanced and imbalanced datasets, respectively, the external evaluation attested to the superiority of the integrated models

Electrostatic effects on funneled landscapes and structural diversity in denatured protein ensembles

The denatured state of proteins is heterogeneous and susceptible to general hydrophobic and electrostatic forces, but to what extent does the funneled nature of protein energy landscapes play a role in the unfolded ensemble? We simulate the denatured ensemble of cytochrome c using a series of models. The models pinpoint the efficacy of incorporating energetic funnels toward the native state in contrast with models having no native structure-seeking tendency. These models also contain varying strengths of electrostatic effects and hydrophobic collapse. The simulations based on these models are compared with experimental distributions for the distances between a fluorescent donor and the heme acceptor that were extracted from time-resolved fluorescence energy transfer experiments on cytochrome c. Comparing simulations to detailed experimental data on several labeling sites allows us to quantify the dominant forces in denatured protein ensembles

Coupled clustering ensemble by exploring data interdependence

© 2018 ACM. Clustering ensembles combine multiple partitions of data into a single clustering solution. It is an effective technique for improving the quality of clustering results. Current clustering ensemble algorithms are usually built on the pairwise agreements between clusterings that focus on the similarity via consensus functions, between data objects that induce similarity measures from partitions and re-cluster objects, and between clusters that collapse groups of clusters into meta-clusters. In most of those models, there is a strong assumption on IIDness (i.e., independent and identical distribution), which states that base clusterings perform independently of one another and all objects are also independent. In the real world, however, objects are generally likely related to each other through features that are either explicit or even implicit. There is also latent but definite relationship among intermediate base clusterings because they are derived from the same set of data. All these demand a further investigation of clustering ensembles that explores the interdependence characteristics of data. To solve this problem, a new coupled clustering ensemble (CCE) framework that works on the interdependence nature of objects and intermediate base clusterings is proposed in this article. The main idea is to model the coupling relationship between objects by aggregating the similarity of base clusterings, and the interactive relationship among objects by addressing their neighborhood domains. Once these interdependence relationships are discovered, they will act as critical supplements to clustering ensembles. We verified our proposed framework by using three types of consensus function: clustering-based, object-based, and cluster-based. Substantial experiments on multiple synthetic and real-life benchmark datasets indicate that CCE can effectively capture the implicit interdependence relationships among base clusterings and among objects with higher clustering accuracy, stability, and robustness compared to 14 state-of-the-art techniques, supported by statistical analysis. In addition, we show that the final clustering quality is dependent on the data characteristics (e.g., quality and consistency) of base clusterings in terms of sensitivity analysis. Finally, the applications in document clustering, as well as on the datasets with much larger size and dimensionality, further demonstrate the effectiveness, efficiency, and scalability of our proposed models