777 research outputs found
Efficient Attention: Attention with Linear Complexities
Dot-product attention has wide applications in computer vision and natural
language processing. However, its memory and computational costs grow
quadratically with the input size. Such growth prohibits its application on
high-resolution inputs. To remedy this drawback, this paper proposes a novel
efficient attention mechanism equivalent to dot-product attention but with
substantially less memory and computational costs. Its resource efficiency
allows more widespread and flexible integration of attention modules into a
network, which leads to better accuracies. Empirical evaluations demonstrated
the effectiveness of its advantages. Efficient attention modules brought
significant performance boosts to object detectors and instance segmenters on
MS-COCO 2017. Further, the resource efficiency democratizes attention to
complex models, where high costs prohibit the use of dot-product attention. As
an exemplar, a model with efficient attention achieved state-of-the-art
accuracies for stereo depth estimation on the Scene Flow dataset. Code is
available at https://github.com/cmsflash/efficient-attention.Comment: To appear at WACV 202
CSD: Discriminance with Conic Section for Improving Reverse k Nearest Neighbors Queries
The reverse nearest neighbor (RNN) query finds all points that have
the query point as one of their nearest neighbors (NN), where the NN
query finds the closest points to its query point. Based on the
characteristics of conic section, we propose a discriminance, named CSD (Conic
Section Discriminance), to determine points whether belong to the RNN set
without issuing any queries with non-constant computational complexity. By
using CSD, we also implement an efficient RNN algorithm CSD-RNN with a
computational complexity at . The comparative
experiments are conducted between CSD-RNN and other two state-of-the-art
RkNN algorithms, SLICE and VR-RNN. The experimental results indicate that
the efficiency of CSD-RNN is significantly higher than its competitors
Efficiently Disassemble-and-Pack for Mechanism
In this paper, we present a disassemble-and-pack approach for a mechanism to
seek a box which contains total mechanical parts with high space utilization.
Its key feature is that mechanism contains not only geometric shapes but also
internal motion structures which can be calculated to adjust geometric shapes
of the mechanical parts. Our system consists of two steps: disassemble
mechanical object into a group set and pack them within a box efficiently. The
first step is to create a hierarchy of possible group set of parts which is
generated by disconnecting the selected joints and adjust motion structures of
parts in groups. The aim of this step is seeking total minimum volume of each
group. The second step is to exploit the hierarchy based on
breadth-first-search to obtain a group set. Every group in the set is inserted
into specified box from maximum volume to minimum based on our packing
strategy. Until an approximated result with satisfied efficiency is accepted,
our approach finish exploiting the hierarchy.Comment: 2 pages, 2 figure
Remediation of Copper Contaminated Kaolin by Electrokinetics Coupled with Permeable Reactive Barrier
AbstractElectrokinetics is an in situ soil remediation technique by which the flow direction of the pollutants can be controlled and the soil with low permeability can be treated. In this study, the remediation of copper contaminated kaolin by electrokinetic process coupled with activated carbon permeable reactive barrier (PRB) was investigated. The experimental results showed that the integration of PRB with electrokinetics successfully removed copper from kaolin with pH control of the catholyte. The average removal rate reached the highest of 96.60% when the initial Cu2+ concentration was 2000mg/kg. Compared to the electrokinetic process without PRB, the application of the coupled system could reduce the pollution of the electrolyte
- …