70 research outputs found
OrchMoE: Efficient Multi-Adapter Learning with Task-Skill Synergy
We advance the field of Parameter-Efficient Fine-Tuning (PEFT) with our novel
multi-adapter method, OrchMoE, which capitalizes on modular skill architecture
for enhanced forward transfer in neural networks. Unlike prior models that
depend on explicit task identification inputs, OrchMoE automatically discerns
task categories, streamlining the learning process. This is achieved through an
integrated mechanism comprising an Automatic Task Classification module and a
Task-Skill Allocation module, which collectively deduce task-specific
classifications and tailor skill allocation matrices. Our extensive evaluations
on the 'Super Natural Instructions' dataset, featuring 1,600 diverse
instructional tasks, indicate that OrchMoE substantially outperforms comparable
multi-adapter baselines in terms of both performance and sample utilization
efficiency, all while operating within the same parameter constraints. These
findings suggest that OrchMoE offers a significant leap forward in multi-task
learning efficiency.Comment: 9 pages, 3 figure
TRINITY III: Quasar Luminosity Functions Decomposed by Halo, Galaxy, and Black Hole Masses and Eddington Ratios from z=0-10
We present the redshift evolution of quasar luminosity functions decomposed
by halo mass, galaxy mass, supermassive black hole (SMBH) mass, and Eddington
ratio, as well as SMBH kinetic/radiative energy output ratios from TRINITY, a
flexible empirical model that self-consistently infers the halo--galaxy--SMBH
connection that match observational data. Key findings include: 1) The
normalization of QLF increases by ~3-4 dex from z~10 to z~4, due to the fast
mass build-up of different SMBH populations; 2) From z~4 to z~1, less massive
galaxies and SMBHs make up bigger and bigger fractions of QLFs, due to the AGN
downsizing effect; 3) At z~0, massive haloes/galaxies/SMBHs are responsible for
most bright quasars due to low Eddington ratios among all SMBHs; 4) The bright
ends of quasar luminosity functions (QLFs) are dominated by SMBHs that are at
least 0.3 dex over-massive relative to the median SMBH mass-galaxy mass
relation; 5) QLFs at z~6-7 are dominated by SMBHs accreting at Eddington ratios
0.1 < < 1, but super-Eddington AGNs contribute more
significantly to QLFs towards z~9-10.Comment: 18 pages, 14 figures. Accepted by MNRAS. Comments welcome
TRINITY II: The Luminosity-dependent Bias of the Supermassive Black Hole Mass--Galaxy Mass Relation for Bright Quasars at
Using recent empirical constraints on the dark matter
halo--galaxy--supermassive black hole (SMBH) connection from , we infer
how undermassive, typical, and overmassive SMBHs contribute to the quasar
luminosity function (QLF) at . We find that beyond erg/s, the QLF is dominated by SMBHs that are at least
0.3 dex above the median relation. The QLF is dominated
by typical SMBHs (i.e., within dex around the
relation) at erg/s. At , the
intrinsic relation for all SMBHs is slightly steeper than the
scaling, with a similar normalization at . We
also predict the relation for bright quasars selected by
different bolometric luminosity thresholds, finding very good agreement with
observations. For quasars with ()
erg/s, the scaling relation is shifted upwards by (1.0) dex for
galaxies. To accurately measure the intrinsic
relation, it is essential to include fainter quasars with erg/s. At high redshifts, low-luminosity quasars are thus the
best targets for understanding typical formation paths for SMBHs in galaxies.Comment: 5 pages, 3 figures. Submitted to MNRAS Letters. Comments welcome
SM: Self-Supervised Multi-task Modeling with Multi-view 2D Images for Articulated Objects
Reconstructing real-world objects and estimating their movable joint
structures are pivotal technologies within the field of robotics. Previous
research has predominantly focused on supervised approaches, relying on
extensively annotated datasets to model articulated objects within limited
categories. However, this approach falls short of effectively addressing the
diversity present in the real world. To tackle this issue, we propose a
self-supervised interaction perception method, referred to as SM, which
leverages multi-view RGB images captured before and after interaction to model
articulated objects, identify the movable parts, and infer the parameters of
their rotating joints. By constructing 3D geometries and textures from the
captured 2D images, SM achieves integrated optimization of movable part and
joint parameters during the reconstruction process, obviating the need for
annotations. Furthermore, we introduce the MMArt dataset, an extension of
PartNet-Mobility, encompassing multi-view and multi-modal data of articulated
objects spanning diverse categories. Evaluations demonstrate that SM
surpasses existing benchmarks across various categories and objects, while its
adaptability in real-world scenarios has been thoroughly validated
TRINITY IV: Predictions for Supermassive Black Holes at
We present predictions for the high-redshift halo-galaxy-supermassive black
hole (SMBH) connection from the TRINITY model. Constrained by a comprehensive
compilation of galaxy () and SMBH datasets (), TRINITY finds: 1) The number of SMBHs with in
the observable Universe increases by six orders of magnitude from to
, and by another factor of from to ; 2) The
SMBHs at live in haloes with ; 3) the new JWST AGNs at are broadly consistent with the median SMBH mass-galaxy mass
relation for AGNs from TRINITY; 4) Seeds from runaway mergers in nuclear star
clusters are viable progenitors for the SMBHs in GN-z11 () and
CEERS_1019 (); 5) quasar luminosity functions from wide area
surveys by, e.g., Roman and Euclid, will reduce uncertainties in the
SMBH mass-galaxy mass relation by up to dex.Comment: 15 pages, 12 figures, submitted to MNRAS. Questions and comments are
welcome
DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field
Estimating 6D poses and reconstructing 3D shapes of objects in open-world
scenes from RGB-depth image pairs is challenging. Many existing methods rely on
learning geometric features that correspond to specific templates while
disregarding shape variations and pose differences among objects in the same
category. As a result, these methods underperform when handling unseen object
instances in complex environments. In contrast, other approaches aim to achieve
category-level estimation and reconstruction by leveraging normalized geometric
structure priors, but the static prior-based reconstruction struggles with
substantial intra-class variations. To solve these problems, we propose the
DTF-Net, a novel framework for pose estimation and shape reconstruction based
on implicit neural fields of object categories. In DTF-Net, we design a
deformable template field to represent the general category-wise shape latent
features and intra-category geometric deformation features. The field
establishes continuous shape correspondences, deforming the category template
into arbitrary observed instances to accomplish shape reconstruction. We
introduce a pose regression module that shares the deformation features and
template codes from the fields to estimate the accurate 6D pose of each object
in the scene. We integrate a multi-modal representation extraction module to
extract object features and semantic masks, enabling end-to-end inference.
Moreover, during training, we implement a shape-invariant training strategy and
a viewpoint sampling method to further enhance the model's capability to
extract object pose features. Extensive experiments on the REAL275 and CAMERA25
datasets demonstrate the superiority of DTF-Net in both synthetic and real
scenes. Furthermore, we show that DTF-Net effectively supports grasping tasks
with a real robot arm.Comment: The first two authors are with equal contributions. Paper accepted by
ACM MM 202
Measurement and correlation of liquid - Liquid equilibria of three imidazolium ionic liquids with acetone and cyclohexane
Ionic liquids (ILs) can be recycled as extractants for their low vapor pressure and volatility. More and more applications are applied to the separation of industrial organic matter. The industrial production of ILs has gradually been realized, which also widens the way for the application of ILs. In this work, the liquid-liquid extraction of cyclohexane-acetone azeotropic mixture with different ILs {1-butyl-3-methylimidazolium bis(trifluormethylsulfonyl), 1-butyl-3-methylimidazolium trifluoromethansulfonate and 1-butyl-3-methylimidazolium dicyanamide} is studied. The extraction mechanism is discussed based on the molecular scale. The relationship between hydrogen bond donor and acceptor between ILs and acetone is analyzed by COSMO-SAC. The interaction between molecules is optimized and calculated by Materials Studio 7.0. The extraction ability of ILs is analyzed by radial distribution function, and the experimental results are verified. The liquid-liquid equilibrium test is carried out at 298.15 K. Distribution and selectivity are indices used to judge the extraction efficiency of ILs. The NRTL model and UNIQUAC model are adopted to correlate the liquid-liquid equilibrium data. The results show that all of the two models can well correlate the experimental.This work is supported by the National Natural Science Foundation of China (No. 21776145), National Natural Science Foundation of China (No. 21676152)
Ultra-efficient frequency comb generation in AlGaAs-on-insulator microresonators
Recent advances in nonlinear optics have revolutionized integrated photonics, providing on-chip solutions to a wide range of new applications. Currently, state of the art integrated nonlinear photonic devices are mainly based on dielectric material platforms, such as Si₃N₄ and SiO₂. While semiconductor materials feature much higher nonlinear coefficients and convenience in active integration, they have suffered from high waveguide losses that prevent the realization of efficient nonlinear processes on-chip. Here, we challenge this status quo and demonstrate a low loss AlGaAs-on-insulator platform with anomalous dispersion and quality (Q) factors beyond 1.5 × 10⁶. Such a high quality factor, combined with high nonlinear coefficient and small mode volume, enabled us to demonstrate a Kerr frequency comb threshold of only ∼36 µW in a resonator with a 1 THz free spectral range, ∼100 times lower compared to that in previous semiconductor platforms. Moreover, combs with broad spans (>250 nm) have been generated with a pump power of ∼300 µW, which is lower than the threshold power of state-of the-art dielectric micro combs. A soliton-step transition has also been observed for the first time in an AlGaAs resonator
- …