6 research outputs found
Evaluating the Ripple Effects of Knowledge Editing in Language Models
Modern language models capture a large body of factual knowledge. However,
some facts can be incorrectly induced or become obsolete over time, resulting
in factually incorrect generations. This has led to the development of various
editing methods that allow updating facts encoded by the model. Evaluation of
these methods has primarily focused on testing whether an individual fact has
been successfully injected, and if similar predictions for other subjects have
not changed. Here we argue that such evaluation is limited, since injecting one
fact (e.g. ``Jack Depp is the son of Johnny Depp'') introduces a ``ripple
effect'' in the form of additional facts that the model needs to update
(e.g.``Jack Depp is the sibling of Lily-Rose Depp''). To address this issue, we
propose a novel set of evaluation criteria that consider the implications of an
edit on related facts. Using these criteria, we then construct \ripple{}, a
diagnostic benchmark of 5K factual edits, capturing a variety of types of
ripple effects. We evaluate prominent editing methods on \ripple{}, showing
that current methods fail to introduce consistent changes in the model's
knowledge. In addition, we find that a simple in-context editing baseline
obtains the best scores on our benchmark, suggesting a promising research
direction for model editing
An evolutionary transcriptomics approach links CD36 to membrane remodeling in replicative senescence
German mathematicians in exile in Turkey: Richard von Mises, William Prager, Hilda Geiringer, and their impact on Turkish mathematics
There is a sizable and growing literature on scholars who fled from the Nazi regime, a literature which often focuses on the periods before leaving Germany and after settling permanently in the USA, but relatively less work on the interim period in which many of them found temporary homes in countries such as Turkey. In this article we would like to discuss the scholarly work, activities and the impact of mathematicians Richard von Mises, William Prager and Hilda Geiringer during their stay in Turkey. We argue that the establishment and the development of applied mathematics and mechanics in Turkey owe much to them