Towards Joint Modeling of Dialogue Response and Speech Synthesis based on Large Language Model

This paper explores the potential of constructing an AI spoken dialogue system that "thinks how to respond" and "thinks how to speak" simultaneously, which more closely aligns with the human speech production process compared to the current cascade pipeline of independent chatbot and Text-to-Speech (TTS) modules. We hypothesize that Large Language Models (LLMs) with billions of parameters possess significant speech understanding capabilities and can jointly model dialogue responses and linguistic features. We conduct two sets of experiments: 1) Prosodic structure prediction, a typical front-end task in TTS, demonstrating the speech understanding ability of LLMs, and 2) Further integrating dialogue response and a wide array of linguistic features using a unified encoding format. Our results indicate that the LLM-based approach is a promising direction for building unified spoken dialogue systems

Dynamic Modelling of an Automated Vehicle Storage and Retrieval System and a Simulation Analysis of its Efficiency

In this paper operating-time models for single and multiple instructions are set up considering an AVS/RS (automated vehicle storage and retrieval system). The operation times of AVS/RS and AS/RS (automated storage and retrieval system) are simulated in different situations by changing the shelf structure and order density. The results show that the AVS/RS is more efficient than the AS/RS in all situations. Furthermore, the numbers of rows and columns of storage shelves greatly influence the operation time. The graph of operation-time compression ratio against number of columns shows an inverted U-type distribution, and the compression ratio decreases and ultimately tends to zero as the number of rows is increased. Also, the order density affects the efficiency difference between the two systems: the higher the order density, the higher the AVS/RS operating-time compression rate. Finally, compared with the AS/RS, the AVS/RS operating-time compression ratio improves greatly with increasing density and number of rows because of parallel operations, whereas with decreasing density and number of rows the AVS/RS advantages are gradually lost and the compression ratio decreases and eventually even reaches zero

Taming Diffusion Models for Music-driven Conducting Motion Generation

Generating the motion of orchestral conductors from a given piece of symphony music is a challenging task since it requires a model to learn semantic music features and capture the underlying distribution of real conducting motion. Prior works have applied Generative Adversarial Networks (GAN) to this task, but the promising diffusion model, which recently showed its advantages in terms of both training stability and output quality, has not been exploited in this context. This paper presents Diffusion-Conductor, a novel DDIM-based approach for music-driven conducting motion generation, which integrates the diffusion model to a two-stage learning framework. We further propose a random masking strategy to improve the feature robustness, and use a pair of geometric loss functions to impose additional regularizations and increase motion diversity. We also design several novel metrics, including Frechet Gesture Distance (FGD) and Beat Consistency Score (BC) for a more comprehensive evaluation of the generated motion. Experimental results demonstrate the advantages of our model.Comment: Accepted by AAAI 2023 Summer Symposiu

Ibrutinib for B cell malignancies

Research over the role of Bruton’s agammaglobulinemia tyrosine kinase (BTK) in B-lymphocyte development, differentiation, signaling and survival has led to better understanding of the pathogenesis of B-cell malignancies. Down-regulation of BTK activity is an attractive novel strategy for treating patients with B-cell malignancies. Ibrutinib (PCI-32765), a potent inhibitor of BTK induces impressive responses in B-cell malignancies through irreversible bond with cysteine-481 in the active site of BTK (TH/SH1 domain) and inhibits BTK phosphorylation on Tyr(223). This review discussed in details the role of BTK in B-cell signaling, molecular interactions between B cell lymphoma/leukemia cells and their microenvironment. Clinical trials of the novel BTK inhibitor, ibrutinib (PCI-32765), in B cell malignancies were summarized

An Object SLAM Framework for Association, Mapping, and High-Level Tasks

Object SLAM is considered increasingly significant for robot high-level perception and decision-making. Existing studies fall short in terms of data association, object representation, and semantic mapping and frequently rely on additional assumptions, limiting their performance. In this paper, we present a comprehensive object SLAM framework that focuses on object-based perception and object-oriented robot tasks. First, we propose an ensemble data association approach for associating objects in complicated conditions by incorporating parametric and nonparametric statistic testing. In addition, we suggest an outlier-robust centroid and scale estimation algorithm for modeling objects based on the iForest and line alignment. Then a lightweight and object-oriented map is represented by estimated general object models. Taking into consideration the semantic invariance of objects, we convert the object map to a topological map to provide semantic descriptors to enable multi-map matching. Finally, we suggest an object-driven active exploration strategy to achieve autonomous mapping in the grasping scenario. A range of public datasets and real-world results in mapping, augmented reality, scene matching, relocalization, and robotic manipulation have been used to evaluate the proposed object SLAM framework for its efficient performance.Comment: Accepted by IEEE Transactions on Robotics(T-RO

Thermal analysis of FeCoCu pre-alloyed powders used for diamond tools

By simulating the pressureless sintering process, the thermal effects of FeCoCu pre-alloyed powders have been investigated. According to the notions of the Kissinger method, the activation energies in the expansion-shrinkage conversion stage are analyzed. Results show that with Fe content increasing, the specimens’ specific heat capacity values present the increasing trend. The 25 %Fe–15 %Co–60 %Cu specimens have negative enthalpy value at 10 and 20°C/min heating rate but positive values at 30 °С/min. For the specimens with lower Cu content, the enthalpies are always positive. It is established that both the specific heat capacity and enthalpy are larger when at higher heating rates. The activation energy of the 65 %Fe–15 %Co–20 %Cu specimens is 10 times higher than that of the 25 %Fe–15 %Co–60 %Cu specimens and the 45 %Fe–15 %Co–40 %Cu specimens.При моделюванні процесу спікання без тиску досліджено термічні ефекти в попередньо легованих порошках FeCoCu. З використанням методу Кіссінджера проаналізовано енергію активації на стадії розширення–усадка. Результати показують, що при збільшенні вмісту Fe значення питомої теплоємності демонструють тенденцію до зростання. Зразки 25 %Fe–15 %Co–60 %Cu мають негативні значення ентальпії при швидкості нагріву 10 ° і 20 °С/хв, але позитивні при 30 °С/хв. Для зразків з меншим вмістом Cu ентальпія завжди позитивна. Встановлено, що питома теплоємність і ентальпія більші при більш високіх швидкостях нагрівання. Енергія активації зразків 65 %Fe–15 %Co–20 %Cu у 10 разів вища, ніж зразків 25 %Fe–15 %Co–60 %Cu і 45 %Fe–15 %Co–40 %Cu.При моделировании процесса спекания без приложения давления исследованы термические эффекты в предварительно легированных порошках FeCoCu. С использованием метода Киссинджера проанализирована энергия активации на стадии расширение–усадка. Результаты показывают, что с увеличением содержания железа значения удельной теплоемкости образцов демонстрируют тенденцию к повышению. Образцы 25 %Fe–15 %Co–60 %Cu имеют отрицательные значения энтальпии при скорости нагрева 10 и 20 °С/мин, но положительные при 30 °С/мин. Для образцов с меньшим содержанием Cu энтальпия всегда положительна. Установлено, что удельная теплоемкость и энтальпия больше при более высоких скоростях нагрева. Энергия активации образцов 65 %Fe–15 %Co–20 %Cu в 10 раз выше, чем образцов 25 %Fe–15 %Co–60 %Cu и 45 %Fe–15 %Co–40 %Cu