Relating Regularization and Generalization through the Intrinsic Dimension of Activations

Given a pair of models with similar training set performance, it is natural to assume that the model that possesses simpler internal representations would exhibit better generalization. In this work, we provide empirical evidence for this intuition through an analysis of the intrinsic dimension (ID) of model activations, which can be thought of as the minimal number of factors of variation in the model's representation of the data. First, we show that common regularization techniques uniformly decrease the last-layer ID (LLID) of validation set activations for image classification models and show how this strongly affects generalization performance. We also investigate how excessive regularization decreases a model's ability to extract features from data in earlier layers, leading to a negative effect on validation accuracy even while LLID continues to decrease and training accuracy remains near-perfect. Finally, we examine the LLID over the course of training of models that exhibit grokking. We observe that well after training accuracy saturates, when models ``grok'' and validation accuracy suddenly improves from random to perfect, there is a co-occurent sudden drop in LLID, thus providing more insight into the dynamics of sudden generalization.Comment: NeurIPS 2022 OPT and HITY workshop

Crowdsourcing Linked Data on listening experiences through reuse and enhancement of library data

Research has approached the practice of musical reception in a multitude of ways, such as the analysis of professional critique, sales figures and psychological processes activated by the act of listening. Studies in the Humanities, on the other hand, have been hindered by the lack of structured evidence of actual experiences of listening as reported by the listeners themselves, a concern that was voiced since the early Web era. It was however assumed that such evidence existed, albeit in pure textual form, but could not be leveraged until it was digitised and aggregated. The Listening Experience Database (LED) responds to this research need by providing a centralised hub for evidence of listening in the literature. Not only does LED support search and reuse across nearly 10,000 records, but it also provides machine-readable structured data of the knowledge around the contexts of listening. To take advantage of the mass of formal knowledge that already exists on the Web concerning these contexts, the entire framework adopts Linked Data principles and technologies. This also allows LED to directly reuse open data from the British Library for the source documentation that is already published. Reused data are re-published as open data with enhancements obtained by expanding over the model of the original data, such as the partitioning of published books and collections into individual stand-alone documents. The database was populated through crowdsourcing and seamlessly incorporates data reuse from the very early data entry phases. As the sources of the evidence often contain vague, fragmentary of uncertain information, facilities were put in place to generate structured data out of such fuzziness. Alongside elaborating on these functionalities, this article provides insights into the most recent features of the latest instalment of the dataset and portal, such as the interlinking with the MusicBrainz database, the relaxation of geographical input constraints through text mining, and the plotting of key locations in an interactive geographical browser

The Black Hole Mass of NGC 4151. II. Stellar Dynamical Measurement from Near-Infrared Integral Field Spectroscopy

We present a revised measurement of the mass of the central black hole (Mbh) in the Seyfert 1 galaxy NGC 4151. The new stellar dynamical mass measurement is derived by applying an axisymmetric orbit-superposition code to near-infrared integral field data obtained using adaptive optics with the Gemini NIFS spectrograph. When our models attempt to fit both the NIFS kinematics and additional low spatial resolution kinematics, our results depend sensitively on how chi-squared is computed--probably a consequence of complex bar kinematics that manifest immediately outside the nuclear region. The most robust results are obtained when only the high spatial resolution kinematic constraints in the nuclear region are included in the fit. Our best estimates for the BH mass and H-band mass-to-light ratio are Mbh~(3.76+/-1.15)E7 Msun (1-sigma error) and M/L(H-band)~0.34+/-0.03 Msun/Lsun (3-sigma error), respectively (the quoted errors reflect the model uncertainties). Our BH mass measurement is consistent with estimates from both reverberation mapping (3.57[+0.45/-0.37]E7 Msun) and gas kinematics (3.0[+0.75/-2.2]E7 Msun; 1-sigma errors), and our best-fit mass-to-light ratio is consistent with the photometric estimate of M/L(H-band)=0.4+/-0.2 Msun/Lsun. The NIFS kinematics give a central bulge velocity dispersion sigma_c=116+/-3 km/s, bringing this object slightly closer to the M-sigma relation for quiescent galaxies. Although NGC 4151 is one of only a few Seyfert 1 galaxies in which it is possible to obtain a direct dynamical BH mass measurement--and thus, an independent calibration of the reverberation mapping mass scale--the complex bar kinematics makes it less than ideally suited for this purpose.Comment: 21 pages, 15 figures. Accepted for publication in Ap

Seminal plasma and prostaglandin E2 up-regulate fibroblast growth factor 2 expression in endometrial adenocarcinoma cells via E-series prostanoid-2 receptor-mediated transactivation of the epidermal growth factor receptor and extracellular signal-regulated kinase pathway

We report a multiwavelength (X-ray, ultraviolet/optical/infrared, radio) analysis of the relativistic tidal disruption event candidate Sw J2058+05 from 3 months to 3 yr post-discovery in order to study its properties and compare its behavior with that of Sw J1644+57. Our main results are as follows. (1) The long-term X-ray light curve of Sw J2058+05 shows a remarkably similar trend to that of Sw J1644+57. After a prolonged power-law decay, the X-ray flux drops off rapidly by a factor of $\gtrsim 160$ within a span of $\Delta$$t$/$t$ $\le$ 0.95. Associating this sudden decline with the transition from super-Eddington to sub-Eddington accretion, we estimate the black hole mass to be in the range of $10^{4-6}$ M$_{\odot}$. (2) We detect rapid ($\lesssim 500$ s) X-ray variability before the dropoff, suggesting that, even at late times, the X-rays originate from close to the black hole (ruling out a forward-shock origin). (3) We confirm using HST and VLBA astrometry that the location of the source coincides with the galaxy's center to within $\lesssim 400$ pc (in projection). (4) We modeled Sw J2058+05's ultraviolet/optical/infrared spectral energy distribution with a single-temperature blackbody and find that while the radius remains more or less constant at a value of $63.4 \pm 4.5$ AU ($\sim 10^{15}$ cm) at all times during the outburst, the blackbody temperature drops significantly from $\sim$ 30,000 K at early times to a value of $\sim$ 15,000 K at late times (before the X-ray dropoff). Our results strengthen Sw J2058+05's interpretation as a tidal disruption event similar to Sw J1644+57.Comment: Replaced with the published version of the manuscrip

Siah2 control of T-regulatory cells limits anti-tumor immunity.

Understanding the mechanisms underlying anti-tumor immunity is pivotal for improving immune-based cancer therapies. Here, we report that growth of BRAF-mutant melanoma cells is inhibited, up to complete rejection, in Siah2-/- mice. Growth-inhibited tumors exhibit increased numbers of intra-tumoral activated T cells and decreased expression of Ccl17, Ccl22, and Foxp3. Marked reduction in Treg proliferation and tumor infiltration coincide with G1 arrest in tumor infiltrated Siah2-/- Tregs in vivo or following T cell stimulation in culture, attributed to elevated expression of the cyclin-dependent kinase inhibitor p27, a Siah2 substrate. Growth of anti-PD-1 therapy resistant melanoma is effectively inhibited in Siah2-/- mice subjected to PD-1 blockade, indicating synergy between PD-1 blockade and Siah2 loss. Low SIAH2 and FOXP3 expression is identified in immune responsive human melanoma tumors. Overall, Siah2 regulation of Treg recruitment and cell cycle progression effectively controls melanoma development and Siah2 loss in the host sensitizes melanoma to anti-PD-1 therapy

Electroluminescence-detected magnetic-resonance study of polyparaphenylenevinylene (PPV)-based light-emitting diodes

The strong electroluminescence (EL)-detected magnetic resonance of PPV-based light emitting diodes is compared to the conductivity (sigma)- and photoluminescence (PL)-detected resonances. It provides direct evidence that polaron-to-singlet exciton conversion is responsible for the EL. In contrast to the narrow PL-enhancing resonance assigned to polaron recombination, strong EL- and sigma-quenching resonances are attributed to the spin-dependent polaron-to-bipolaron decay. The half-field EL- and sigma-detected resonances of two distinct triplet excitons is believed to result from triplet-triplet fusion to singlets

Resilience to Stress and Disturbance, and Resistance to Bromus tectorum L. Invasion in Cold Desert Shrublands of Western North America

Alien grass invasions in arid and semi-arid ecosystems are resulting in grass–fire cycles and ecosystem-level transformations that severely diminish ecosystem services. Our capacity to address the rapid and complex changes occurring in these ecosystems can be enhanced by developing an understanding of the environmental factors and ecosystem attributes that determine resilience of native ecosystems to stress and disturbance, and resistance to invasion. Cold desert shrublands occur over strong environmental gradients and exhibit significant differences in resilience and resistance. They provide an excellent opportunity to increase our understanding of these concepts. Herein, we examine a series of linked questions about (a) ecosystem attributes that determine resilience and resistance along environmental gradients, (b) effects of disturbances like livestock grazing and altered fire regimes and of stressors like rapid climate change, rising CO2, and N deposition on resilience and resistance, and (c) interacting effects of resilience and resistance on ecosystems with different environmental conditions. We conclude by providing strategies for the use of resilience and resistance concepts in a management context. At ecological site scales, state and transition models are used to illustrate how differences in resilience and resistance influence potential alternative vegetation states, transitions among states, and thresholds. At landscape scales management strategies based on resilience and resistance—protection, prevention, restoration, and monitoring and adaptive management—are used to determine priority management areas and appropriate actions

Late Quaternary evolution of a lowland anastomosing river system: Geological-topographic inheritance, non-uniformity and implications for biodiversity and management

Lowland multiple-channel rivers are characterised by floodplain-corridor heterogeneity, high ecological and heritage value, and can be in quasi-stable states. This holistic study of a surviving temperate zone example (Culm, UK) uses geomorphological mapping, 14C, direct sediment dating (OSL, fallout radionuclides), and palaeoecology. This reveals the evolution of a channel-floodplain system from an initial braided state in the Late Pleistocene to its late Holocene anastomosing state. After the Pleistocene Holocene transition the reduced channel system incised into its braid-plain, only able to rework gravels locally due to reduced competence in relation to inherited bounding sediment calibre. This resulted in the creation of terrace islands, palaeochannels, and a stable anastomosing pattern dominated by channel junctions, bifurcations and palaeochannel intersections. Survey, coring and excavation reveal a persistence of mid-channel bars and riffles at channel junctions, and where channels crossed palaeochannel fills. In common with most other European lowland rivers this system evolves in the later Holocene due to both climate and catchment changes with a major hydrological critical transition in the mid-Holocene (c. 5300 BP). However, in the case of the Culm, the increase in fine sediment supply often seen in lowland catchments in the Middle-Late Holocene, occurred later, and was insufficient to convert the system to a single medium-low sinuosity channel-floodplain. This allowed the persistence of high heterogeneity and biodiversity (including the persistence of riffle beetles) as part of multiple-scales of non-uniformity. Indeed the pool-riffle persistence is an example of this system’s non-uniformity, being due, at least in part, to the effects of previous channel history. This paper reveals why this river survived in a multichannel state, and by implication, why others did not. These results are being used in the bespoke eco-heritage management of the Culm, but could also inform the restoration of other former multi-channel lowland temperate river systems worldwide