On decoder-only architecture for speech-to-text and large language model integration

Large language models (LLMs) have achieved remarkable success in the field of natural language processing, enabling better human-computer interaction using natural language. However, the seamless integration of speech signals into LLMs has not been explored well. The "decoder-only" architecture has also not been well studied for speech processing tasks. In this research, we introduce Speech-LLaMA, a novel approach that effectively incorporates acoustic information into text-based large language models. Our method leverages Connectionist Temporal Classification and a simple audio encoder to map the compressed acoustic features to the continuous semantic space of the LLM. In addition, we further probe the decoder-only architecture for speech-to-text tasks by training a smaller scale randomly initialized speech-LLaMA model from speech-text paired data alone. We conduct experiments on multilingual speech-to-text translation tasks and demonstrate a significant improvement over strong baselines, highlighting the potential advantages of decoder-only models for speech-to-text conversion

Accelerating In-Browser Deep Learning Inference on Diverse Edge Clients through Just-in-Time Kernel Optimizations

Web applications are increasingly becoming the primary platform for AI service delivery, making in-browser deep learning (DL) inference more prominent. However, current in-browser inference systems fail to effectively utilize advanced web programming techniques and customize kernels for various client devices, leading to suboptimal performance. To address the issues, this paper presents the first in-browser inference system, nn-JIT.web, which enables just-in-time (JIT) auto-generation of optimized kernels for both CPUs and GPUs during inference. The system achieves this by using two novel web programming techniques that can significantly reduce kernel generation time, compared to other tensor compilers such as TVM, while maintaining or even improving performance. The first technique, Tensor-Web Compiling Co-Design, lowers compiling costs by unifying tensor and web compiling and eliminating redundant and ineffective compiling passes. The second technique, Web-Specific Lite Kernel Optimization Space Design, reduces kernel tuning costs by focusing on web programming requirements and efficient hardware resource utilization, limiting the optimization space to only dozens. nn-JIT.web is evaluated for modern transformer models on a range of client devices, including the mainstream CPUs and GPUs from ARM, Intel, AMD and Nvidia. Results show that nn-JIT.web can achieve up to 8.2x faster within 30 seconds compared to the baselines across various models

J. Mol. Model.

A three-dimensional model of the beta 3-homopentamer of the gamma-aminobutyric acid (GABA) receptor/chloride ionophore complex was developed by homology modeling using the cyro-electron microscopy structure of nicotinic acetylcholine as a template. Interactions between the beta 3-homopentamer and two classes of fipronil-related non-competitive antagonists were investigated using docking studies. The phenyl groups of these compounds were stabilized by strong hydrophobic and hydrophilic interactions with the rings formed by Thr256 and Ala252. Leu253 and Ile255 were involved mainly in hydrophobic contact with the pyrazole moiety. Different substitution at positions 15, 16 and 17 of the pyrazole ring of fipronil resulted in weakening of the hydrogen bonds and hydrophobic interactions between the beta 3-receptor and fipronil-related heterocyclic compounds, which maybe the principal cause of the decreased affinities reported in vitro. Moreover, a good correlation between total binding energies calculated by AutoDock and experimentally determined IC50 values proved our models to be reasonable in predicting the interaction mode of the antagonist with the GABA beta 3-receptor.A three-dimensional model of the beta 3-homopentamer of the gamma-aminobutyric acid (GABA) receptor/chloride ionophore complex was developed by homology modeling using the cyro-electron microscopy structure of nicotinic acetylcholine as a template. Interactions between the beta 3-homopentamer and two classes of fipronil-related non-competitive antagonists were investigated using docking studies. The phenyl groups of these compounds were stabilized by strong hydrophobic and hydrophilic interactions with the rings formed by Thr256 and Ala252. Leu253 and Ile255 were involved mainly in hydrophobic contact with the pyrazole moiety. Different substitution at positions 15, 16 and 17 of the pyrazole ring of fipronil resulted in weakening of the hydrogen bonds and hydrophobic interactions between the beta 3-receptor and fipronil-related heterocyclic compounds, which maybe the principal cause of the decreased affinities reported in vitro. Moreover, a good correlation between total binding energies calculated by AutoDock and experimentally determined IC50 values proved our models to be reasonable in predicting the interaction mode of the antagonist with the GABA beta 3-receptor

preparationofpolyisobutylenebtertbutylacrylatebytransformationoflivingcarbocationicpolymerizationintoradicalpolymerization

使用BCl3／CH2Cl2／DTBP／IB反应体系实现了异丁烯的正离子聚合，得到末端为硼氧烷基的聚异丁烯，其与苯基溴化镁发生金属转移反应，生成末端为二苯基硼烷的聚异丁烯，其在常温下与氧气发生氧化反应，生成碳氧自由基，从而引发丙烯酸叔丁酯的自由基聚合，得到异丁烯和丙烯酸叔丁酯的嵌段聚合物

preparationofpolyisobutylenebtertbutylacrylatebytransformationoflivingcarbocationicpolymerizationintoradicalpolymerization

使用BCl3／CH2Cl2／DTBP／IB反应体系实现了异丁烯的正离子聚合，得到末端为硼氧烷基的聚异丁烯，其与苯基溴化镁发生金属转移反应，生成末端为二苯基硼烷的聚异丁烯，其在常温下与氧气发生氧化反应，生成碳氧自由基，从而引发丙烯酸叔丁酯的自由基聚合，得到异丁烯和丙烯酸叔丁酯的嵌段聚合物

Protein J.

The three-dimensional structure of the GABA(A) receptor that included the ligand/agonist binding site was constructed and validated by using molecular modeling technology. Moreover, the putative binding-mode of GABA and diazepam with GABA(A) receptor were investigated by means of docking studies. Based on an rmsd-tolerance of 1.0 angstrom, the docking of GABA to alpha 1/beta 2 interface resulted in three multi-member conformational clusters and model 2 was supported by homologous sequence alignment data and experimental evidence. On the other hand, the docking of diazepam to alpha 1/gamma 2 interface revealed five multi-member conformational clusters in the binding site and model 1 seemed to represent the correct orientation of diazepam in the binding site.The three-dimensional structure of the GABA(A) receptor that included the ligand/agonist binding site was constructed and validated by using molecular modeling technology. Moreover, the putative binding-mode of GABA and diazepam with GABA(A) receptor were investigated by means of docking studies. Based on an rmsd-tolerance of 1.0 angstrom, the docking of GABA to alpha 1/beta 2 interface resulted in three multi-member conformational clusters and model 2 was supported by homologous sequence alignment data and experimental evidence. On the other hand, the docking of diazepam to alpha 1/gamma 2 interface revealed five multi-member conformational clusters in the binding site and model 1 seemed to represent the correct orientation of diazepam in the binding site

Synth. Commun.

The acetalization of aldehydes has been studied with ethyleneglycol, 3-chloro-1,2-propanediol, 1,2-propanediol, and 1,2,3-propanetriol using resin-D-72 catalyst in high yields under reflux and water separator conditions. The reaction is simple, efficient, and chemoselective and does not involve any other additive.The acetalization of aldehydes has been studied with ethyleneglycol, 3-chloro-1,2-propanediol, 1,2-propanediol, and 1,2,3-propanetriol using resin-D-72 catalyst in high yields under reflux and water separator conditions. The reaction is simple, efficient, and chemoselective and does not involve any other additive

The application of the mixed system of polyoxyethylene ether and polycarboxylate in 430 g·L^-1 tebuconazole suspension concentrate

The mixed surfactant system is helpful to improve suspension stability of pesticide suspension concentrate(SC). Herein, the effect of the mixed system of polysacchanate dispersant SD-840 and polyoxyethylene ether dispersant 601P on the stability of 430 g·L-1 tebuconazole SC was studied.The changes of the particle size, zeta potential, viscosity, and suspension rate of 430 g·L-1 tebuconazole SC before and after the thermal storage were carefully investigated.The results showed that the suspension stability of 430 g·L-1 tebuconazole SC obtained by the mixed system was superior to that of SC prepared by only SD-840 or 601P, respectively. Especially, the SC obtained by the mixed system with a 0.75 mass ratio between SD-840 and 601P exhibited the superior suspension stability and minimum variation of particle size and suspension rate before and after thermal storage.The suspension rates and D90 particle diameters before and after thermal storage were 99.47%, 96.58% and 2.35 μm, 2.50 μm, respectively