LLM Augmented LLMs: Expanding Capabilities through Composition

Foundational models with billions of parameters which have been trained on large corpora of data have demonstrated non-trivial skills in a variety of domains. However, due to their monolithic structure, it is challenging and expensive to augment them or impart new skills. On the other hand, due to their adaptation abilities, several new instances of these models are being trained towards new domains and tasks. In this work, we study the problem of efficient and practical composition of existing foundation models with more specific models to enable newer capabilities. To this end, we propose CALM -- Composition to Augment Language Models -- which introduces cross-attention between models to compose their representations and enable new capabilities. Salient features of CALM are: (i) Scales up LLMs on new tasks by 're-using' existing LLMs along with a few additional parameters and data, (ii) Existing model weights are kept intact, and hence preserves existing capabilities, and (iii) Applies to diverse domains and settings. We illustrate that augmenting PaLM2-S with a smaller model trained on low-resource languages results in an absolute improvement of up to 13\% on tasks like translation into English and arithmetic reasoning for low-resource languages. Similarly, when PaLM2-S is augmented with a code-specific model, we see a relative improvement of 40\% over the base model for code generation and explanation tasks -- on-par with fully fine-tuned counterparts.Comment: 17 pages, 2 figures, 8 table

XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages

Data scarcity is a crucial issue for the development of highly multilingual NLP systems. Yet for many under-represented languages (ULs) -- languages for which NLP re-search is particularly far behind in meeting user needs -- it is feasible to annotate small amounts of data. Motivated by this, we propose XTREME-UP, a benchmark defined by: its focus on the scarce-data scenario rather than zero-shot; its focus on user-centric tasks -- tasks with broad adoption by speakers of high-resource languages; and its focus on under-represented languages where this scarce-data scenario tends to be most realistic. XTREME-UP evaluates the capabilities of language models across 88 under-represented languages over 9 key user-centric technologies including ASR, OCR, MT, and information access tasks that are of general utility. We create new datasets for OCR, autocomplete, semantic parsing, and transliteration, and build on and refine existing datasets for other tasks. XTREME-UP provides methodology for evaluating many modeling scenarios including text-only, multi-modal (vision, audio, and text),supervised parameter tuning, and in-context learning. We evaluate commonly used models on the benchmark. We release all code and scripts to train and evaluate model

Multicomponent self-sorting of a Pd-7 molecular boat and its use in catalytic Knoevenagel condensation

Unique three-component self-assembly of a cis-blocked 90 degrees Pd(II) acceptor with amixture of tri- and tetra-imidazole donors led to the self-sorting of a Pd-7 molecular boat with an internal nanocavity, which catalyses the Knoevenagel condensation of a series of aromatic aldehydes with 1,3-dimethylbarbituric acid and Meldrum's acid in aqueous media

Self-assembled multicomponent Pd-6 aggregates showing low-humidity proton conduction

Two Pd-6 molecular aggregates (1 and 2), self-sorted via a template-free three-component self-assembly process, represent new examples of discrete architectures exhibiting very high proton conductivity 0.78 x 10(-3) S cm(-1) (1) and 0.22 X 10(-3) S cm(-1) (2)] at 300 K at low relative humidity (B46%) with low activation energy comparable to that of currently used Nafion in fuel cells

Structural Diversity in Multinuclear PdII Assemblies that Show Low- Humidity Proton Conduction

Systematic investigation on synergetic effects of geometry, length, denticity, and asymmetry of donors was performed through the formation of a series of uncommon Pd-II aggregates by employing the donor in a multicomponent self-assembly of a cis-blocked 90 degrees Pd-II acceptor and a tetratopic donor. Some of these assemblies represent the first examples of these types of structures, and their formation is not anticipated by only taking the geometry of the donor and the acceptor building units into account. Analysis of the crystal packing of the X-ray structure revealed several H bonds between the counteranions (NO3-) and water molecules (OHON). Moreover, H-bonded 3D-networks of water are present in the molecular pockets, which show water-adsorption properties with some variation in water affinity. Interestingly, these complexes exhibit proton conductivity (1.87x10(-5)-6.52x10(-4)Scm(-1)) at 296K and low relative humidity (ca. 46%) with activation energies of 0.29-0.46eV. Moreover, the conductivities further increase with the enhancement of humidity. The ability of these assemblies to exhibit proton-conducting properties under low-humidity conditions makes these materials highly appealing as electrolytes in batteries and in fuel-cell applications

Sunlight-Induced Covalent Marriage of Two Triply Interlocked Pd-6 Cages and Their Facile Thermal Separation

A template-free triply interlocked Pd-6 cage (2) was synthesized by two-component self-assembly of cis-blocked 90 degrees acceptor cis-(tmen)Pd(NO3)(2) (M) and 1,3,5-tris((E)-2-(pyridin-3-yl)vinyl)benzene (L). Assembly 2 was characterized by H-1 NMR and ESI-MS, and the structure was confirmed by X-ray crystallography, which revealed a parallel conformation of the olefin double bonds belonging to the adjacent cages in the solid state at a distance of 3.656 angstrom, thereby indicating the feasibility of 2+2] photochemical reaction. Two adjacent interlocked cages were covalently married together by intermolecular 2+2] cycloaddition in a single crystal-to-single crystal fashion upon exposure to sunlight/UV irradiation. Most surprisingly, the covalently married pair was easily separated thermally in aqueous medium under mild reaction conditions

Pt-6(II) nanoscopic cages with an organometallic backbone as sensors for picric acid

An organometallic building block 1,3,5-tris(4-trans-Pt(PEt3)(2)I(ethynyl)phenyl)benzene (1) incorporating Pt-ethynyl functionality has been synthesized and characterized. 2 + 3] self-assembly of its nitrate analogue 1,3,5-tris(4-trans-Pt(PEt3)(2)(ONO2)(ethynyl)phenyl)benzene (2) with ``clip'' type bidentate donors (L-1-L-3) separately afforded three trigonal prismatic architectures (3a-3c), respectively. All these prisms were characterized and their shapes/sizes are predicted through geometry optimization employing molecular mechanics universal force field (MMUFF) simulation. The extended p-conjugation including the presence of Pt-ethynyl functionality makes them electron rich as well as luminescent in nature. Macrocycles 3b and 3c exhibit fluorescence quenching in solution upon addition of picric acid PA], which is a common constituent of many explosives. Interestingly, the non-responsive nature of fluorescent intensity towards other electron-deficient nitro-aromatic explosives (NAEs) makes them promising selective sensors for PA with a detection limit predicted to be ppb level. Furthermore, solid-state quenching of fluorescent intensity of the thin film of 3b upon exposure to saturated vapor of picric acid has drawn special attention for infield applications

Postcombustion CO2 capture using N-(3-trimethoxysilylpropyl)diethylenetriamine-grafted solid adsorbent

In this work, the performance of N-(3-trimethoxysilylpropyl)diethylenetriamine (DAEAPTS)-grafted mesoporous SBA-15 adsorbent for postcombustion carbon capture was studied. Wet grafting technique was adopted to functionalize SBA-15 surface. The adsorption of CO2 on the amine-grafted sorbent was measured by the thermogravimetric method over a CO2 partial pressure range of 0–90 kPa and a temperature range of 25–105°C under atmospheric pressure. The optimal amine loaded SBA-15 adsorbent containing 40 wt% DAEAPTS exhibited capture capacity up to 2.3 mmol/g under simulated gas conditions (88.2% CO2/N2) at 75°C. The CO2 adsorption–desorption kinetics of the grafted sorbents were found to be sufficiently fast in both dry and humid CO2 streams and it was observed that the grafted adsorbent achieved 75% of the total capacity in 5 min of adsorption time in dry 8.8% CO2/N2 and in less than 3.5 min in humid 8.8% CO2/N2. It was also observed that 95% of the total desorption occurred in less than 7 min at 150°C under pure N2. The grafted sorbents showed good reversibility and multicycle stability and the drop in capacity after 100 cycles in dry and humid 8.8% CO2/N2 streams was around 7.09% and 11.65%, respectively

Sunlight-Induced Covalent Marriage of Two Triply Interlocked Pd₆ Cages and Their Facile Thermal Separation

A template-free triply interlocked Pd₆ cage (<b>2</b>) was synthesized by two-component self-assembly of <i>cis</i>-blocked 90° acceptor <i>cis-</i>(tmen)­Pd­(NO₃)₂ (<b>M</b>) and 1,3,5-tris­((<i>E</i>)-2-(pyridin-3-yl)­vinyl)­benzene (<b>L</b>). Assembly <b>2</b> was characterized by ¹H NMR and ESI-MS, and the structure was confirmed by X-ray crystallography, which revealed a parallel conformation of the olefin double bonds belonging to the adjacent cages in the solid state at a distance of 3.656 Å, thereby indicating the feasibility of [2+2] photochemical reaction. Two adjacent interlocked cages were covalently married together by intermolecular [2+2] cycloaddition in a single crystal-to-single crystal fashion upon exposure to sunlight/UV irradiation. Most surprisingly, the covalently married pair was easily separated thermally in aqueous medium under mild reaction conditions

New Structural Topologies in a Series of 3d Metal Complexes with Isomeric Phenylenediacetates and 1,3,5-Tris(1-imidazolyl)benzene Ligand: Syntheses, Structures, and Magnetic and Luminescence Properties

In this article we present the syntheses, characterizations, magnetic and luminescence properties of five 3d-metal complexes, Co(tib)(1,2-phda)](n)center dot(H2O)(n) (1), Co-3(tib)(2)(1,3-phda)(3)(H2O)](n)center dot(H2O)(2n) (2), Co-5(tib)(3)(1,4-phda)(5)(H2O)(3)](n)center dot(H2O)(7n) (3), Zn-3(tib)(2)(1,3-phda)(3)](n)center dot(H2O)(4n) (4), and Mn(tib)(2)(H2O)(2)](n)center dot(1,4-phdaH)(2n)center dot(H2O)(4n) (5), obtained from the use of isomeric phenylenediacetates (phda) and the neutral 1,3,5-tris(1-imidazolyl)benzene (tib) ligand. Single crystal X-ray structures showed that 1 constitutes 3,5-connected 2-nodal nets with a double-layered two-dimensional (2D) structure, while 2 forms an interpenetrated 2D network (3,4-connected 3-nodal net). Complex 3 has a complicated three-dimensional structure with 10-nodal 3,4,5-connected nets. Complex 4, although it resembles 2 in stoichiometry and basic building structures, forms a very different overall 2D assembly. In complex 5 the dicarboxylic acid, upon losing only one of the acidic protons, does not take part in coordination; instead it forms a complicated hydrogen bonding network with water molecules. Magnetic susceptibility measurements over a wide range of temperatures revealed that the metal ions exchange very poorly through the tib ligand, but for the Co(II) complexes the effects of nonquenched orbital contributions are prominent. The 3d(10) metal complex 4 showed strong luminescence with lambda(max) = 415 nm (lambda(ex) = 360 nm)