Indicators for usage and participation in scientific journals 2.0: the case of PLoS One

The new publishing and scientific communication environments have led to the emergence of new Web indicators. Along with usage metrics such as downloads there are many measures that are generated from Science 2.0. Journals published by the Public Library of Science systematically collect many of these new metrics. The objective of this paper is to present some of these new indicators and analyze them quantitatively through the case study of 8945 papers published in the journal PLoS One. The selected indicators were; comments, ratings, number of bookmarks, links from scientific weblogs, downloads views and citations. Basic descriptive statistics indicators and correlations have been calculated for all of them. The results show the low participation of scientists in Web 2.0 and how most of these indicators, except for downloads and visits, are poorly consolidated metrics

JexoSim 2.0: End-to-end JWST simulator for exoplanet spectroscopy – implementation and case studies

The recently developed JWST Exoplanet Observation Simulator (JexoSim) simulates transit spectroscopic observations of exoplanets by JWST with each of its four instruments using a time-domain approach. Previously we reported the validation of JexoSim against Pandexo and instrument team simulators. In the present study, we report a substantially enhanced version, JexoSim 2.0, which improves on the original version through incorporation of new noise sources, enhanced treatment of stellar and planetary signals and instrumental effects, as well as improved user-operability and optimisations for increased speed and efficiency. A near complete set of instrument modes for exoplanet time-series observations is now included. In this paper we report the implementation of JexoSim 2.0 and assess performance metrics for JWST in end-member scenarios using the hot Jupiter HD 209458 b and the mini-Neptune K2-18 b. We show how JexoSim can be used to compare performance across the different JWST instruments, selecting an optimal combination of instrument and subarray modes, producing synthetic transmission spectra for each planet. These studies indicate that the 1.4 {\mu}m water feature detected in the atmosphere of K2-18 b using the Hubble WFC3 might be observable in just one transit observation with JWST with either NIRISS or NIRSpec. JexoSim 2.0 can be used to investigate the impact of complex noise and systematic effects on the final spectrum, plan observations and test the feasibility of novel science cases for JWST. It can also be customised for other astrophysical applications beyond exoplanet spectroscopy. JexoSim 2.0 is now available for use by the scientific community

The distorted mirror of Wikipedia: a quantitative analysis of Wikipedia coverage of academics

Activity of modern scholarship creates online footprints galore. Along with traditional metrics of research quality, such as citation counts, online images of researchers and institutions increasingly matter in evaluating academic impact, decisions about grant allocation, and promotion. We examined 400 biographical Wikipedia articles on academics from four scientific fields to test if being featured in the world's largest online encyclopedia is correlated with higher academic notability (assessed through citation counts). We found no statistically significant correlation between Wikipedia articles metrics (length, number of edits, number of incoming links from other articles, etc.) and academic notability of the mentioned researchers. We also did not find any evidence that the scientists with better WP representation are necessarily more prominent in their fields. In addition, we inspected the Wikipedia coverage of notable scientists sampled from Thomson Reuters list of "highly cited researchers". In each of the examined fields, Wikipedia failed in covering notable scholars properly. Both findings imply that Wikipedia might be producing an inaccurate image of academics on the front end of science. By shedding light on how public perception of academic progress is formed, this study alerts that a subjective element might have been introduced into the hitherto structured system of academic evaluation.Comment: To appear in EPJ Data Science. To have the Additional Files and Datasets e-mail the corresponding autho

Technical Report: A Trace-Based Performance Study of Autoscaling Workloads of Workflows in Datacenters

To improve customer experience, datacenter operators offer support for simplifying application and resource management. For example, running workloads of workflows on behalf of customers is desirable, but requires increasingly more sophisticated autoscaling policies, that is, policies that dynamically provision resources for the customer. Although selecting and tuning autoscaling policies is a challenging task for datacenter operators, so far relatively few studies investigate the performance of autoscaling for workloads of workflows. Complementing previous knowledge, in this work we propose the first comprehensive performance study in the field. Using trace-based simulation, we compare state-of-the-art autoscaling policies across multiple application domains, workload arrival patterns (e.g., burstiness), and system utilization levels. We further investigate the interplay between autoscaling and regular allocation policies, and the complexity cost of autoscaling. Our quantitative study focuses not only on traditional performance metrics and on state-of-the-art elasticity metrics, but also on time- and memory-related autoscaling-complexity metrics. Our main results give strong and quantitative evidence about previously unreported operational behavior, for example, that autoscaling policies perform differently across application domains and by how much they differ.Comment: Technical Report for the CCGrid 2018 submission "A Trace-Based Performance Study of Autoscaling Workloads of Workflows in Datacenters

Genesis of Altmetrics or Article-level Metrics for Measuring Efficacy of Scholarly Communications: Current Perspectives

The article-level metrics (ALMs) or altmetrics becomes a new trendsetter in recent times for measuring the impact of scientific publications and their social outreach to intended audiences. The popular social networks such as Facebook, Twitter, and Linkedin and social bookmarks such as Mendeley and CiteULike are nowadays widely used for communicating research to larger transnational audiences. In 2012, the San Francisco Declaration on Research Assessment got signed by the scientific and researchers communities across the world. This declaration has given preference to the ALM or altmetrics over traditional but faulty journal impact factor (JIF)-based assessment of career scientists. JIF does not consider impact or influence beyond citations count as this count reflected only through Thomson Reuters' Web of Science database. Furthermore, JIF provides indicator related to the journal, but not related to a published paper. Thus, altmetrics now becomes an alternative metrics for performance assessment of individual scientists and their contributed scholarly publications. This paper provides a glimpse of genesis of altmetrics in measuring efficacy of scholarly communications and highlights available altmetric tools and social platforms linking altmetric tools, which are widely used in deriving altmetric scores of scholarly publications. The paper thus argues for institutions and policy makers to pay more attention to altmetrics based indicators for evaluation purpose but cautions that proper safeguards and validations are needed before their adoption