70 research outputs found

    OrchMoE: Efficient Multi-Adapter Learning with Task-Skill Synergy

    Full text link
    We advance the field of Parameter-Efficient Fine-Tuning (PEFT) with our novel multi-adapter method, OrchMoE, which capitalizes on modular skill architecture for enhanced forward transfer in neural networks. Unlike prior models that depend on explicit task identification inputs, OrchMoE automatically discerns task categories, streamlining the learning process. This is achieved through an integrated mechanism comprising an Automatic Task Classification module and a Task-Skill Allocation module, which collectively deduce task-specific classifications and tailor skill allocation matrices. Our extensive evaluations on the 'Super Natural Instructions' dataset, featuring 1,600 diverse instructional tasks, indicate that OrchMoE substantially outperforms comparable multi-adapter baselines in terms of both performance and sample utilization efficiency, all while operating within the same parameter constraints. These findings suggest that OrchMoE offers a significant leap forward in multi-task learning efficiency.Comment: 9 pages, 3 figure

    TRINITY III: Quasar Luminosity Functions Decomposed by Halo, Galaxy, and Black Hole Masses and Eddington Ratios from z=0-10

    Full text link
    We present the redshift evolution of quasar luminosity functions decomposed by halo mass, galaxy mass, supermassive black hole (SMBH) mass, and Eddington ratio, as well as SMBH kinetic/radiative energy output ratios from TRINITY, a flexible empirical model that self-consistently infers the halo--galaxy--SMBH connection that match observational data. Key findings include: 1) The normalization of QLF increases by ~3-4 dex from z~10 to z~4, due to the fast mass build-up of different SMBH populations; 2) From z~4 to z~1, less massive galaxies and SMBHs make up bigger and bigger fractions of QLFs, due to the AGN downsizing effect; 3) At z~0, massive haloes/galaxies/SMBHs are responsible for most bright quasars due to low Eddington ratios among all SMBHs; 4) The bright ends of quasar luminosity functions (QLFs) are dominated by SMBHs that are at least 0.3 dex over-massive relative to the median SMBH mass-galaxy mass relation; 5) QLFs at z~6-7 are dominated by SMBHs accreting at Eddington ratios 0.1 < ηrad\eta_\mathrm{rad} < 1, but super-Eddington AGNs contribute more significantly to QLFs towards z~9-10.Comment: 18 pages, 14 figures. Accepted by MNRAS. Comments welcome

    TRINITY II: The Luminosity-dependent Bias of the Supermassive Black Hole Mass--Galaxy Mass Relation for Bright Quasars at z=6z=6

    Full text link
    Using recent empirical constraints on the dark matter halo--galaxy--supermassive black hole (SMBH) connection from z=07z=0-7, we infer how undermassive, typical, and overmassive SMBHs contribute to the quasar luminosity function (QLF) at z=6z=6. We find that beyond Lbol=5×1046L_\mathrm{bol} = 5 \times 10^{46} erg/s, the z=6z=6 QLF is dominated by SMBHs that are at least 0.3 dex above the z=6z=6 median MMM_\bullet-M_* relation. The QLF is dominated by typical SMBHs (i.e., within ±0.3\pm 0.3 dex around the MMM_\bullet-M_* relation) at Lbol1045L_\mathrm{bol} \lesssim 10^{45} erg/s. At z6z\sim 6, the intrinsic MMM_\bullet-M_* relation for all SMBHs is slightly steeper than the z=0z=0 scaling, with a similar normalization at M1011MM_* \sim 10^{11} M_\odot. We also predict the MMM_\bullet-M_* relation for z=6z=6 bright quasars selected by different bolometric luminosity thresholds, finding very good agreement with observations. For quasars with Lbol>3×1046L_\mathrm{bol} > 3 \times 10^{46} (104810^{48}) erg/s, the scaling relation is shifted upwards by 0.35\sim0.35 (1.0) dex for 1011M10^{11} M_\odot galaxies. To accurately measure the intrinsic MMM_\bullet-M_* relation, it is essential to include fainter quasars with Lbol1045L_\mathrm{bol} \lesssim 10^{45} erg/s. At high redshifts, low-luminosity quasars are thus the best targets for understanding typical formation paths for SMBHs in galaxies.Comment: 5 pages, 3 figures. Submitted to MNRAS Letters. Comments welcome

    SM3^3: Self-Supervised Multi-task Modeling with Multi-view 2D Images for Articulated Objects

    Full text link
    Reconstructing real-world objects and estimating their movable joint structures are pivotal technologies within the field of robotics. Previous research has predominantly focused on supervised approaches, relying on extensively annotated datasets to model articulated objects within limited categories. However, this approach falls short of effectively addressing the diversity present in the real world. To tackle this issue, we propose a self-supervised interaction perception method, referred to as SM3^3, which leverages multi-view RGB images captured before and after interaction to model articulated objects, identify the movable parts, and infer the parameters of their rotating joints. By constructing 3D geometries and textures from the captured 2D images, SM3^3 achieves integrated optimization of movable part and joint parameters during the reconstruction process, obviating the need for annotations. Furthermore, we introduce the MMArt dataset, an extension of PartNet-Mobility, encompassing multi-view and multi-modal data of articulated objects spanning diverse categories. Evaluations demonstrate that SM3^3 surpasses existing benchmarks across various categories and objects, while its adaptability in real-world scenarios has been thoroughly validated

    TRINITY IV: Predictions for Supermassive Black Holes at z7z \gtrsim 7

    Full text link
    We present predictions for the high-redshift halo-galaxy-supermassive black hole (SMBH) connection from the TRINITY model. Constrained by a comprehensive compilation of galaxy (0z100\leq z \leq 10) and SMBH datasets (0z6.50\leq z \leq 6.5), TRINITY finds: 1) The number of SMBHs with M>109MM_\bullet > 10^9 M_\odot in the observable Universe increases by six orders of magnitude from z10z\sim10 to z2z\sim2, and by another factor of 3\sim 3 from z2z\sim2 to z=0z=0; 2) The M>109/1010MM_\bullet > 10^9/10^{10} M_\odot SMBHs at z6z\sim 6 live in haloes with (23)/(35)×1012M\sim (2-3)/(3-5) \times 10^{12} M_\odot; 3) the new JWST AGNs at 7z117\lesssim z \lesssim 11 are broadly consistent with the median SMBH mass-galaxy mass relation for AGNs from TRINITY; 4) Seeds from runaway mergers in nuclear star clusters are viable progenitors for the SMBHs in GN-z11 (z=10.6z=10.6) and CEERS_1019 (z=8.7z=8.7); 5) z=610z=6-10 quasar luminosity functions from wide area surveys by, e.g., Roman and Euclid, will reduce uncertainties in the z=610z=6-10 SMBH mass-galaxy mass relation by up to 0.5\sim 0.5 dex.Comment: 15 pages, 12 figures, submitted to MNRAS. Questions and comments are welcome

    DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field

    Full text link
    Estimating 6D poses and reconstructing 3D shapes of objects in open-world scenes from RGB-depth image pairs is challenging. Many existing methods rely on learning geometric features that correspond to specific templates while disregarding shape variations and pose differences among objects in the same category. As a result, these methods underperform when handling unseen object instances in complex environments. In contrast, other approaches aim to achieve category-level estimation and reconstruction by leveraging normalized geometric structure priors, but the static prior-based reconstruction struggles with substantial intra-class variations. To solve these problems, we propose the DTF-Net, a novel framework for pose estimation and shape reconstruction based on implicit neural fields of object categories. In DTF-Net, we design a deformable template field to represent the general category-wise shape latent features and intra-category geometric deformation features. The field establishes continuous shape correspondences, deforming the category template into arbitrary observed instances to accomplish shape reconstruction. We introduce a pose regression module that shares the deformation features and template codes from the fields to estimate the accurate 6D pose of each object in the scene. We integrate a multi-modal representation extraction module to extract object features and semantic masks, enabling end-to-end inference. Moreover, during training, we implement a shape-invariant training strategy and a viewpoint sampling method to further enhance the model's capability to extract object pose features. Extensive experiments on the REAL275 and CAMERA25 datasets demonstrate the superiority of DTF-Net in both synthetic and real scenes. Furthermore, we show that DTF-Net effectively supports grasping tasks with a real robot arm.Comment: The first two authors are with equal contributions. Paper accepted by ACM MM 202

    Measurement and correlation of liquid - Liquid equilibria of three imidazolium ionic liquids with acetone and cyclohexane

    Get PDF
    Ionic liquids (ILs) can be recycled as extractants for their low vapor pressure and volatility. More and more applications are applied to the separation of industrial organic matter. The industrial production of ILs has gradually been realized, which also widens the way for the application of ILs. In this work, the liquid-liquid extraction of cyclohexane-acetone azeotropic mixture with different ILs {1-butyl-3-methylimidazolium bis(trifluormethylsulfonyl), 1-butyl-3-methylimidazolium trifluoromethansulfonate and 1-butyl-3-methylimidazolium dicyanamide} is studied. The extraction mechanism is discussed based on the molecular scale. The relationship between hydrogen bond donor and acceptor between ILs and acetone is analyzed by COSMO-SAC. The interaction between molecules is optimized and calculated by Materials Studio 7.0. The extraction ability of ILs is analyzed by radial distribution function, and the experimental results are verified. The liquid-liquid equilibrium test is carried out at 298.15 K. Distribution and selectivity are indices used to judge the extraction efficiency of ILs. The NRTL model and UNIQUAC model are adopted to correlate the liquid-liquid equilibrium data. The results show that all of the two models can well correlate the experimental.This work is supported by the National Natural Science Foundation of China (No. 21776145), National Natural Science Foundation of China (No. 21676152)

    Ultra-efficient frequency comb generation in AlGaAs-on-insulator microresonators

    Get PDF
    Recent advances in nonlinear optics have revolutionized integrated photonics, providing on-chip solutions to a wide range of new applications. Currently, state of the art integrated nonlinear photonic devices are mainly based on dielectric material platforms, such as Si₃N₄ and SiO₂. While semiconductor materials feature much higher nonlinear coefficients and convenience in active integration, they have suffered from high waveguide losses that prevent the realization of efficient nonlinear processes on-chip. Here, we challenge this status quo and demonstrate a low loss AlGaAs-on-insulator platform with anomalous dispersion and quality (Q) factors beyond 1.5 × 10⁶. Such a high quality factor, combined with high nonlinear coefficient and small mode volume, enabled us to demonstrate a Kerr frequency comb threshold of only ∼36 µW in a resonator with a 1 THz free spectral range, ∼100 times lower compared to that in previous semiconductor platforms. Moreover, combs with broad spans (>250 nm) have been generated with a pump power of ∼300 µW, which is lower than the threshold power of state-of the-art dielectric micro combs. A soliton-step transition has also been observed for the first time in an AlGaAs resonator
    corecore