1,182 research outputs found
Do Localization Methods Actually Localize Memorized Data in LLMs?
Large language models (LLMs) can memorize many pretrained sequences verbatim.
This paper studies if we can locate a small set of neurons in LLMs responsible
for memorizing a given sequence. While the concept of localization is often
mentioned in prior work, methods for localization have never been
systematically and directly evaluated; we address this with two benchmarking
approaches. In our INJ Benchmark, we actively inject a piece of new information
into a small subset of LLM weights and measure whether localization methods can
identify these "ground truth" weights. In the DEL Benchmark, we study
localization of pretrained data that LLMs have already memorized; while this
setting lacks ground truth, we can still evaluate localization by measuring
whether dropping out located neurons erases a memorized sequence from the
model. We evaluate five localization methods on our two benchmarks, and both
show similar rankings. All methods exhibit promising localization ability,
especially for pruning-based methods, though the neurons they identify are not
necessarily specific to a single memorized sequence
Spectral Line De-confusion in an Intensity Mapping Survey
Spectral line intensity mapping has been proposed as a promising tool to
efficiently probe the cosmic reionization and the large-scale structure.
Without detecting individual sources, line intensity mapping makes use of all
available photons and measures the integrated light in the source confusion
limit, to efficiently map the three-dimensional matter distribution on large
scales as traced by a given emission line. One particular challenge is the
separation of desired signals from astrophysical continuum foregrounds and line
interlopers. Here we present a technique to extract large-scale structure
information traced by emission lines from different redshifts, embedded in a
three-dimensional intensity mapping data cube. The line redshifts are
distinguished by the anisotropic shape of the power spectra when projected onto
a common coordinate frame. We consider the case where high-redshift [CII] lines
are confused with multiple low-redshift CO rotational lines. We present a
semi-analytic model for [CII] and CO line estimates based on the cosmic
infrared background measurements, and show that with a modest instrumental
noise level and survey geometry, the large-scale [CII] and CO power spectrum
amplitudes can be successfully extracted from a confusion-limited data set,
without external information. We discuss the implications and limits of this
technique for possible line intensity mapping experiments.Comment: 13 pages, 14 figures, accepted by Ap
Is the Radio Source Dipole from NVSS Consistent with the CMB and CDM?
The dipole moment in the angular distribution of the cosmic microwave
background (CMB) is thought to originate from the Doppler Effect and our motion
relative to the CMB frame. Observations of large-scale structure (LSS) should
show a related "kinematic dipole" and help test the kinematic origin of the CMB
dipole. Intriguingly, many previous LSS dipole studies suggest discrepancies
with the expectations from the CMB. Here we reassess the apparent inconsistency
between the CMB measurements and dipole estimates from the NVSS catalog of
radio sources. We find that it is important to account for the shot-noise and
clustering of the NVSS sources, as well as kinematic contributions, in
determining the expected dipole signal. We use the clustering redshift method
and a cross-matching technique to refine estimates of the clustering term. We
then derive a probability distribution for the expected NVSS dipole in a
standard CDM cosmological model including all (i.e., kinematic,
shot-noise and clustering) dipole components. Our model agrees with most of the
previous NVSS dipole measurements in the literature at better than . We conclude that the NVSS dipole is consistent with a kinematic
origin for the CMB dipole within CDM.Comment: 24 pages, 9 figures, submitted to Ap
Determinants Of Customer-Perceived Service Quality In Senior-Care Industry And Their Relationship To Customer Satisfaction And Behavioral Intentions: Research Findings From Taiwan
The senior-care market has been on the rise in Taiwan, especially in rural areas. Soaring competition among senior-care operators has led to escalating consumer demands on performances, driving the industry to become more customer-oriented. The authors examined the relationship between service quality of senior care and customer satisfaction in rural Taiwan based on Parasuraman, Zeithmal and Berry’s SERVQUAL ten dimensions (i.e., access, communication, competence, courtesy, credibility, reliability, responsiveness, security, tangibles and understanding the customer) and Lee’s food service. Multiple regression was conducted to test the relationships. The statistical results showed that access, courtesy and food service are significantly and positively related to customer satisfaction. This finding, among others, suggests that senior-care operators in rural Taiwan might have overlooked the above mentioned three dimensions as factors leading to customer satisfaction and, ultimately, to a sustainable competitive edge
Loss of vesicular dopamine release precedes tauopathy in degenerative dopaminergic neurons in a Drosophila model expressing human tau.
While a number of genome-wide association studies have identified microtubule-associated protein tau as a strong risk factor for Parkinson's disease (PD), little is known about the mechanism through which human tau can predispose an individual to this disease. Here, we demonstrate that expression of human wild-type tau is sufficient to disrupt the survival of dopaminergic neurons in a Drosophila model. Tau triggers a synaptic pathology visualized by vesicular monoamine transporter-pHGFP that precedes both the age-dependent formation of tau-containing neurofibrillary tangle-like pathology and the progressive loss of DA neurons, thereby recapitulating the pathological hallmarks of PD. Flies overexpressing tau also exhibit progressive impairments of both motor and learning behaviors. Surprisingly, contrary to common belief that hyperphosphorylated tau could aggravate toxicity, DA neuron degeneration is alleviated by expressing the modified, hyperphosphorylated tau(E14). Together, these results show that impairment of VMAT-containing synaptic vesicle, released to synapses before overt tauopathy may be the underlying mechanism of tau-associated PD and suggest that correction or prevention of this deficit may be appropriate targets for early therapeutic intervention
An Exploration On The Development Of The IT Management System In Taiwans Banking Industry: From The Marketing Perspectives
The focal point adopted in the present study is Customer Relationship Management (CRM) and its adoption in Taiwans banking industry. Since the current challenge banks are facing is in implementing and supporting new technological solutions that will enable them to be more responsive and flexible to their clients, a quantitative research methodology was employed in the present study in an attempt to answer the following research question: What are the critical factors that explain the degree of success in the deployment of CRM systems in Taiwans banking industry? First, based on the findings from the previous studies, an exploratory study consisting of focus-group interviews was conducted to uncover the nature of the problems confronting the banks in adopting CRM. Second, based on the findings from this preliminary investigation, a quantitative analysis using survey and statistical methods was conducted to identify possible answers to the research question. The research done with the present study has uncovered a number of factors which can be used to guide companies for a successful CRM deployment. These factors include primacy of customer service, customizing CRM functions/modules, discovering customers needs, maintaining employees moral, conducting a decision support system. If the major goal of implementing a CRM system is to improve the overall CRM deployment, the management in Taiwans banking industry should then emphasize three of two factors: primacy of customer service and customizing CRM functions/modules
- …