Representation Engineering: A Top-Down Approach to AI Transparency

In this paper, we identify and characterize the emerging area of representation engineering (RepE), an approach to enhancing the transparency of AI systems that draws on insights from cognitive neuroscience. RepE places population-level representations, rather than neurons or circuits, at the center of analysis, equipping us with novel methods for monitoring and manipulating high-level cognitive phenomena in deep neural networks (DNNs). We provide baselines and an initial analysis of RepE techniques, showing that they offer simple yet effective solutions for improving our understanding and control of large language models. We showcase how these methods can provide traction on a wide range of safety-relevant problems, including honesty, harmlessness, power-seeking, and more, demonstrating the promise of top-down transparency research. We hope that this work catalyzes further exploration of RepE and fosters advancements in the transparency and safety of AI systems.Comment: Code is available at https://github.com/andyzoujm/representation-engineerin

HETDEX pilot survey for emission-line galaxies - I. Survey design, performance, and catalog

We present a catalog of emission-line galaxies selected solely by their emission-line fluxes using a wide-field integral field spectrograph. This work is partially motivated as a pilot survey for the upcoming Hobby-Eberly Telescope Dark Energy Experiment (HETDEX). We describe the observations, reductions, detections, redshift classifications, line fluxes, and counterpart information for 397 emission-line galaxies detected over 169 sq.arcmin with a 3500-5800 Ang. bandpass under 5 Ang. full-width-half-maximum (FWHM) spectral resolution. The survey's best sensitivity for unresolved objects under photometric conditions is between 4-20 E-17 erg/s/sq.cm depending on the wavelength, and Ly-alpha luminosities between 3-6 E42 erg/s are detectable. This survey method complements narrowband and color-selection techniques in the search for high redshift galaxies with its different selection properties and large volume probed. The four survey fields within the COSMOS, GOODS-N, MUNICS, and XMM-LSS areas are rich with existing, complementary data. We find 104 galaxies via their high redshift Ly-alpha emission at 1.9<z<3.8, and the majority of the remainder objects are low redshift [OII]3727 emitters at z<0.56. The classification between low and high redshift objects depends on rest frame equivalent width, as well as other indicators, where available. Based on matches to X-ray catalogs, the active galactic nuclei (AGN) fraction amongst the Ly-alpha emitters (LAEs) is 6%. We also analyze the survey's completeness and contamination properties through simulations. We find five high-z, highly-significant, resolved objects with full-width-half-maximum sizes >44 sq.arcsec which appear to be extended Ly-alpha nebulae. We also find three high-z objects with rest frame Ly-alpha equivalent widths above the level believed to be achievable with normal star formation, EW(rest)>240 Ang.Comment: 45 pages, 36 figures, 5 tables, submitted to ApJ

Metabolomic profiles delineate potential role for sarcosine in prostate cancer progression

Multiple, complex molecular events characterize cancer development and progression(1,2). Deciphering the molecular networks that distinguish organ- confined disease from metastatic disease may lead to the identification of critical biomarkers for cancer invasion and disease aggressiveness. Although gene and protein expression have been extensively profiled in human tumours, little is known about the global metabolomic alterations that characterize neoplastic progression. Using a combination of high- throughput liquid- and- gas- chromatography- based mass spectrometry, we profiled more than 1,126 metabolites across 262 clinical samples related to prostate cancer ( 42 tissues and 110 each of urine and plasma). These unbiased metabolomic profiles were able to distinguish benign prostate, clinically localized prostate cancer and metastatic disease. Sarcosine, an N- methyl derivative of the amino acid glycine, was identified as a differential metabolite that was highly increased during prostate cancer progression to metastasis and can be detected non- invasively in urine. Sarcosine levels were also increased in invasive prostate cancer cell lines relative to benign prostate epithelial cells. Knockdown of glycine- N- methyl transferase, the enzyme that generates sarcosine from glycine, attenuated prostate cancer invasion. Addition of exogenous sarcosine or knockdown of the enzyme that leads to sarcosine degradation, sarcosine dehydrogenase, induced an invasive phenotype in benign prostate epithelial cells. Androgen receptor and the ERG gene fusion product coordinately regulate components of the sarcosine pathway. Here, by profiling the metabolomic alterations of prostate cancer progression, we reveal sarcosine as a potentially important metabolic intermediary of cancer cell invasion and aggressivity.Early Detection Research Network ; National Institutes of Health ; MTTC ; Clinical Translational Science Award ; Fund for Discovery of the University of Michigan Comprehensive Cancer Center ; University of Michigan Cancer Biostatistics Training Grant ; Doris Duke Charitable FoundationWe thank J. Granger for help in manuscript preparation, J. Siddiqui and R. Varambally for help with the clinical database, and A. Vellaichamy and S. Pullela for technical assistance. We thank K. Pienta for access to metastatic prostate cancer samples from the University of Michigan Prostate SPORE rapid autopsy programme. This work is supported in part by the Early Detection Research Network (A.M.C., J.T.W.), National Institutes of Health (A.S., S.P., J.B., T.M.R., D.G., G.S.O. and A.M.C.) and an MTTC grant (G.S.O. and A.S.). A.M.C. is supported by a Clinical Translational Science Award from the Burroughs Welcome Foundation. A. S. is supported by a grant from the Fund for Discovery of the University of Michigan Comprehensive Cancer Center. L. M. P. is supported by the University of Michigan Cancer Biostatistics Training Grant. A. M. C and S. P. are supported by the Doris Duke Charitable Foundation.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/62661/1/nature07762.pd

Improving additive manufacturing performance by build orientation optimization

Additive manufacturing (AM) is an emerging type of production technology to create three-dimensional objects layer-by-layer directly from a 3D CAD model. AM is being extensively used in several areas by engineers and designers. Build orientation is a critical issue in AM since it is associated with the part accuracy, the number of supports required and the processing time to produce the object. This paper presents an optimization approach to solve the part build orientation problem taking into account some characteristics or measures that can affect the accuracy of the part, namely the volumetric error, the support area, the staircase effect, the build time, the surface roughness and the surface quality. A global optimization method, the Electromagnetism-like algorithm, is used to solve the part build orientation problem.The authors are grateful to the anonymous referees for their fruitfulcomments and suggestions. This work has been supported and developed under the FIBR3Dproject - Hybrid processes based on additive manufacturing of composites with long or shortfibers reinforced thermoplastic matrix (POCI-01-0145-FEDER-016414), supported by theLisbon Regional Operational Programme 2020, under the PORTUGAL 2020 PartnershipAgreement, through the European Regional Development Fund (ERDF). This work hasbeen also supported by national funds through FCT - Funda ̧c ̃ao para a Ciˆencia e Tecnologiawithin the Project Scope: UID/CEC/00319/201

Accurate Protein Structure Annotation through Competitive Diffusion of Enzymatic Functions over a Network of Local Evolutionary Similarities

High-throughput Structural Genomics yields many new protein structures without known molecular function. This study aims to uncover these missing annotations by globally comparing select functional residues across the structural proteome. First, Evolutionary Trace Annotation, or ETA, identifies which proteins have local evolutionary and structural features in common; next, these proteins are linked together into a proteomic network of ETA similarities; then, starting from proteins with known functions, competing functional labels diffuse link-by-link over the entire network. Every node is thus assigned a likelihood z-score for every function, and the most significant one at each node wins and defines its annotation. In high-throughput controls, this competitive diffusion process recovered enzyme activity annotations with 99% and 97% accuracy at half-coverage for the third and fourth Enzyme Commission (EC) levels, respectively. This corresponds to false positive rates 4-fold lower than nearest-neighbor and 5-fold lower than sequence-based annotations. In practice, experimental validation of the predicted carboxylesterase activity in a protein from Staphylococcus aureus illustrated the effectiveness of this approach in the context of an increasingly drug-resistant microbe. This study further links molecular function to a small number of evolutionarily important residues recognizable by Evolutionary Tracing and it points to the specificity and sensitivity of functional annotation by competitive global network diffusion. A web server is at http://mammoth.bcm.tmc.edu/networks

A ring-like accretion structure in M87 connecting its black hole and jet

The nearby radio galaxy M87 is a prime target for studying black hole accretion and jet formation^{1,2}. Event Horizon Telescope observations of M87 in 2017, at a wavelength of 1.3 mm, revealed a ring-like structure, which was interpreted as gravitationally lensed emission around a central black hole^3. Here we report images of M87 obtained in 2018, at a wavelength of 3.5 mm, showing that the compact radio core is spatially resolved. High-resolution imaging shows a ring-like structure of 8.4_{-1.1}^{+0.5} Schwarzschild radii in diameter, approximately 50% larger than that seen at 1.3 mm. The outer edge at 3.5 mm is also larger than that at 1.3 mm. This larger and thicker ring indicates a substantial contribution from the accretion flow with absorption effects in addition to the gravitationally lensed ring-like emission. The images show that the edge-brightened jet connects to the accretion flow of the black hole. Close to the black hole, the emission profile of the jet-launching region is wider than the expected profile of a black-hole-driven jet, suggesting the possible presence of a wind associated with the accretion flow.Comment: 50 pages, 18 figures, 3 tables, author's version of the paper published in Natur

A ring-like accretion structure in M87 connecting its black hole and jet

The nearby radio galaxy M87 is a prime target for studying black hole accretion and jet formation1,2. Event Horizon Telescope observations of M87 in 2017, at a wavelength of 1.3 mm, revealed a ring-like structure, which was interpreted as gravitationally lensed emission around a central black hole3. Here we report images of M87 obtained in 2018, at a wavelength of 3.5 mm, showing that the compact radio core is spatially resolved. High-resolution imaging shows a ring-like structure of [Formula: see text] Schwarzschild radii in diameter, approximately 50% larger than that seen at 1.3 mm. The outer edge at 3.5 mm is also larger than that at 1.3 mm. This larger and thicker ring indicates a substantial contribution from the accretion flow with absorption effects, in addition\ua0to the gravitationally lensed ring-like emission. The images show that the edge-brightened jet connects to the accretion flow of the black hole. Close to the black hole, the emission profile of the jet-launching region is wider than the expected profile of a black-hole-driven jet, suggesting the possible presence of a wind associated with the accretion flow

A Ring-Like Accretion Structure in M87 Connecting Its Black Hole and Jet

The nearby radio galaxy M87 is a prime target for studying black hole accretion and jet formation1,2. Event Horizon Telescope observations of M87 in 2017, at a wavelength of 1.3 mm, revealed a ring-like structure, which was interpreted as gravitationally lensed emission around a central black hole3. Here we report images of M87 obtained in 2018, at a wavelength of 3.5 mm, showing that the compact radio core is spatially resolved. High-resolution imaging shows a ring-like structure of 8.4+0.5−1.1 Schwarzschild radii in diameter, approximately 50% larger than that seen at 1.3 mm. The outer edge at 3.5 mm is also larger than that at 1.3 mm. This larger and thicker ring indicates a substantial contribution from the accretion flow with absorption effects, in addition to the gravitationally lensed ring-like emission. The images show that the edge-brightened jet connects to the accretion flow of the black hole. Close to the black hole, the emission profile of the jet-launching region is wider than the expected profile of a black-hole-driven jet, suggesting the possible presence of a wind associated with the accretion flow

THEMIS: A Parameter Estimation Framework for the Event Horizon Telescope

The Event Horizon Telescope (EHT) provides the unprecedented ability to directly resolve the structure and dynamics of black hole emission regions on scales smaller than their horizons. This has the potential to critically probe the mechanisms by which black holes accrete and launch outflows, and the structure of supermassive black hole spacetimes. However, accessing this information is a formidable analysis challenge for two reasons. First, the EHT natively produces a variety of data types that encode information about the image structure in nontrivial ways; these are subject to a variety of systematic effects associated with very long baseline interferometry and are supplemented by a wide variety of auxiliary data on the primary EHT targets from decades of other observations. Second, models of the emission regions and their interaction with the black hole are complex, highly uncertain, and computationally expensive to construct. As a result, the scientific utilization of EHT observations requires a flexible, extensible, and powerful analysis framework. We present such a framework, Themis, which defines a set of interfaces between models, data, and sampling algorithms that facilitates future development. We describe the design and currently existing components of Themis, how Themis has been validated thus far, and present additional analyses made possible by Themis that illustrate its capabilities. Importantly, we demonstrate that Themis is able to reproduce prior EHT analyses, extend these, and do so in a computationally efficient manner that can efficiently exploit modern high-performance computing facilities. Themis has already been used extensively in the scientific analysis and interpretation of the first EHT observations of M87

SYMBA: An end-to-end VLBI synthetic data generation pipeline: Simulating Event Horizon Telescope observations of M 87

Context. Realistic synthetic observations of theoretical source models are essential for our understanding of real observational data. In using synthetic data, one can verify the extent to which source parameters can be recovered and evaluate how various data corruption effects can be calibrated. These studies are the most important when proposing observations of new sources, in the characterization of the capabilities of new or upgraded instruments, and when verifying model-based theoretical predictions in a direct comparison with observational data. Aims. We present the SYnthetic Measurement creator for long Baseline Arrays (SYMBA), a novel synthetic data generation pipeline for Very Long Baseline Interferometry (VLBI) observations. SYMBA takes into account several realistic atmospheric, instrumental, and calibration effects. Methods. We used SYMBA to create synthetic observations for the Event Horizon Telescope (EHT), a millimetre VLBI array, which has recently captured the first image of a black hole shadow. After testing SYMBA with simple source and corruption models, we study the importance of including all corruption and calibration effects, compared to the addition of thermal noise only. Using synthetic data based on two example general relativistic magnetohydrodynamics (GRMHD) model images of M 87, we performed case studies to assess the image quality that can be obtained with the current and future EHT array for different weather conditions. Results. Our synthetic observations show that the effects of atmospheric and instrumental corruptions on the measured visibilities are significant. Despite these effects, we demonstrate how the overall structure of our GRMHD source models can be recovered robustly with the EHT2017 array after performing calibration steps, which include fringe fitting, a priori amplitude and network calibration, and self-calibration. With the planned addition of new stations to the EHT array in the coming years, images could be reconstructed with higher angular resolution and dynamic range. In our case study, these improvements allowed for a distinction between a thermal and a non-thermal GRMHD model based on salient features in reconstructed images