6,345 research outputs found
Nonlinear dynamic Interactions between flow-induced galloping and shell-like buckling
Acknowledgement The research of J.S. is supported by EPSRC Grant EP/J010820/1.Peer reviewedPublisher PD
Fluent dreaming for language models
Feature visualization, also known as "dreaming", offers insights into vision
models by optimizing the inputs to maximize a neuron's activation or other
internal component. However, dreaming has not been successfully applied to
language models because the input space is discrete. We extend Greedy
Coordinate Gradient, a method from the language model adversarial attack
literature, to design the Evolutionary Prompt Optimization (EPO) algorithm. EPO
optimizes the input prompt to simultaneously maximize the Pareto frontier
between a chosen internal feature and prompt fluency, enabling fluent dreaming
for language models. We demonstrate dreaming with neurons, output logits and
arbitrary directions in activation space. We measure the fluency of the
resulting prompts and compare language model dreaming with max-activating
dataset examples. Critically, fluent dreaming allows automatically exploring
the behavior of model internals in reaction to mildly out-of-distribution
prompts. Code for running EPO is available at
https://github.com/Confirm-Solutions/dreamy. A companion page demonstrating
code usage is at https://confirmlabs.org/posts/dreamy.htmlComment: 11 pages, 6 figures, 4 table
Recommended from our members
Air quality impacts of using overnight electricity generation to cahrge plug-in hybrid electric vehicles for daytime use
The air quality impacts of replacing 20% of the gasoline powered light duty vehicle miles
traveled with plug-in hybrid electric vehicles (PHEVs) in the region served by the Pennsylvania,
New Jersey, Maryland classic grid are examined. Unutilized, base-load nighttime electricity
generating capacity is assumed to charge PHEVs that would subsequently be used during urban
commutes. The net impact of this scenario on the emissions of precursors to the formation of
ozone is an increase in nitrogen oxide (NOx), volatile organic compound (VOC) and CO
emissions from electricity generating units during nighttime hours, and a greater decrease in
NOx, VOC and CO from mobile emissions in urban areas during daytime hours. The changes
in maximum daily 8 h ozone concentrations, predicted using a regional photochemical model
(CAMx), are decreases in ozone concentrations between 2 and 6 ppb that are widespread across
the urban areas, and increases in ozone concentrations of up to 8 ppb in highly localized areas.
Air quality indicators beyond maximum daily ozone concentration are also evaluated, and in
general indicate air quality improvements associated with the use of PHEVs. However, a
limited number of air quality indicators worsened with the use of PHEVs, suggesting that
overall impacts of the use of PHEVs will be complex.Mechanical Engineerin
- …