Do Localization Methods Actually Localize Memorized Data in LLMs?

Large language models (LLMs) can memorize many pretrained sequences verbatim. This paper studies if we can locate a small set of neurons in LLMs responsible for memorizing a given sequence. While the concept of localization is often mentioned in prior work, methods for localization have never been systematically and directly evaluated; we address this with two benchmarking approaches. In our INJ Benchmark, we actively inject a piece of new information into a small subset of LLM weights and measure whether localization methods can identify these "ground truth" weights. In the DEL Benchmark, we study localization of pretrained data that LLMs have already memorized; while this setting lacks ground truth, we can still evaluate localization by measuring whether dropping out located neurons erases a memorized sequence from the model. We evaluate five localization methods on our two benchmarks, and both show similar rankings. All methods exhibit promising localization ability, especially for pruning-based methods, though the neurons they identify are not necessarily specific to a single memorized sequence

Spectral Line De-confusion in an Intensity Mapping Survey

Spectral line intensity mapping has been proposed as a promising tool to efficiently probe the cosmic reionization and the large-scale structure. Without detecting individual sources, line intensity mapping makes use of all available photons and measures the integrated light in the source confusion limit, to efficiently map the three-dimensional matter distribution on large scales as traced by a given emission line. One particular challenge is the separation of desired signals from astrophysical continuum foregrounds and line interlopers. Here we present a technique to extract large-scale structure information traced by emission lines from different redshifts, embedded in a three-dimensional intensity mapping data cube. The line redshifts are distinguished by the anisotropic shape of the power spectra when projected onto a common coordinate frame. We consider the case where high-redshift [CII] lines are confused with multiple low-redshift CO rotational lines. We present a semi-analytic model for [CII] and CO line estimates based on the cosmic infrared background measurements, and show that with a modest instrumental noise level and survey geometry, the large-scale [CII] and CO power spectrum amplitudes can be successfully extracted from a confusion-limited data set, without external information. We discuss the implications and limits of this technique for possible line intensity mapping experiments.Comment: 13 pages, 14 figures, accepted by Ap

Is the Radio Source Dipole from NVSS Consistent with the CMB and Λ\LambdaCDM?

The dipole moment in the angular distribution of the cosmic microwave background (CMB) is thought to originate from the Doppler Effect and our motion relative to the CMB frame. Observations of large-scale structure (LSS) should show a related "kinematic dipole" and help test the kinematic origin of the CMB dipole. Intriguingly, many previous LSS dipole studies suggest discrepancies with the expectations from the CMB. Here we reassess the apparent inconsistency between the CMB measurements and dipole estimates from the NVSS catalog of radio sources. We find that it is important to account for the shot-noise and clustering of the NVSS sources, as well as kinematic contributions, in determining the expected dipole signal. We use the clustering redshift method and a cross-matching technique to refine estimates of the clustering term. We then derive a probability distribution for the expected NVSS dipole in a standard $\Lambda$CDM cosmological model including all (i.e., kinematic, shot-noise and clustering) dipole components. Our model agrees with most of the previous NVSS dipole measurements in the literature at better than $\lesssim 2\sigma$. We conclude that the NVSS dipole is consistent with a kinematic origin for the CMB dipole within $\Lambda$CDM.Comment: 24 pages, 9 figures, submitted to Ap

Determinants Of Customer-Perceived Service Quality In Senior-Care Industry And Their Relationship To Customer Satisfaction And Behavioral Intentions: Research Findings From Taiwan

The senior-care market has been on the rise in Taiwan, especially in rural areas. Soaring competition among senior-care operators has led to escalating consumer demands on performances, driving the industry to become more customer-oriented. The authors examined the relationship between service quality of senior care and customer satisfaction in rural Taiwan based on Parasuraman, Zeithmal and Berry’s SERVQUAL ten dimensions (i.e., access, communication, competence, courtesy, credibility, reliability, responsiveness, security, tangibles and understanding the customer) and Lee’s food service. Multiple regression was conducted to test the relationships. The statistical results showed that access, courtesy and food service are significantly and positively related to customer satisfaction. This finding, among others, suggests that senior-care operators in rural Taiwan might have overlooked the above mentioned three dimensions as factors leading to customer satisfaction and, ultimately, to a sustainable competitive edge

Loss of vesicular dopamine release precedes tauopathy in degenerative dopaminergic neurons in a Drosophila model expressing human tau.

While a number of genome-wide association studies have identified microtubule-associated protein tau as a strong risk factor for Parkinson's disease (PD), little is known about the mechanism through which human tau can predispose an individual to this disease. Here, we demonstrate that expression of human wild-type tau is sufficient to disrupt the survival of dopaminergic neurons in a Drosophila model. Tau triggers a synaptic pathology visualized by vesicular monoamine transporter-pHGFP that precedes both the age-dependent formation of tau-containing neurofibrillary tangle-like pathology and the progressive loss of DA neurons, thereby recapitulating the pathological hallmarks of PD. Flies overexpressing tau also exhibit progressive impairments of both motor and learning behaviors. Surprisingly, contrary to common belief that hyperphosphorylated tau could aggravate toxicity, DA neuron degeneration is alleviated by expressing the modified, hyperphosphorylated tau(E14). Together, these results show that impairment of VMAT-containing synaptic vesicle, released to synapses before overt tauopathy may be the underlying mechanism of tau-associated PD and suggest that correction or prevention of this deficit may be appropriate targets for early therapeutic intervention

An Exploration On The Development Of The IT Management System In Taiwans Banking Industry: From The Marketing Perspectives

The focal point adopted in the present study is Customer Relationship Management (CRM) and its adoption in Taiwans banking industry. Since the current challenge banks are facing is in implementing and supporting new technological solutions that will enable them to be more responsive and flexible to their clients, a quantitative research methodology was employed in the present study in an attempt to answer the following research question: What are the critical factors that explain the degree of success in the deployment of CRM systems in Taiwans banking industry? First, based on the findings from the previous studies, an exploratory study consisting of focus-group interviews was conducted to uncover the nature of the problems confronting the banks in adopting CRM. Second, based on the findings from this preliminary investigation, a quantitative analysis using survey and statistical methods was conducted to identify possible answers to the research question. The research done with the present study has uncovered a number of factors which can be used to guide companies for a successful CRM deployment. These factors include primacy of customer service, customizing CRM functions/modules, discovering customers needs, maintaining employees moral, conducting a decision support system. If the major goal of implementing a CRM system is to improve the overall CRM deployment, the management in Taiwans banking industry should then emphasize three of two factors: primacy of customer service and customizing CRM functions/modules