An Efficient End-to-End Transformer with Progressive Tri-modal Attention for Multi-modal Emotion Recognition

Recent works on multi-modal emotion recognition move towards end-to-end models, which can extract the task-specific features supervised by the target task compared with the two-phase pipeline. However, previous methods only model the feature interactions between the textual and either acoustic and visual modalities, ignoring capturing the feature interactions between the acoustic and visual modalities. In this paper, we propose the multi-modal end-to-end transformer (ME2ET), which can effectively model the tri-modal features interaction among the textual, acoustic, and visual modalities at the low-level and high-level. At the low-level, we propose the progressive tri-modal attention, which can model the tri-modal feature interactions by adopting a two-pass strategy and can further leverage such interactions to significantly reduce the computation and memory complexity through reducing the input token length. At the high-level, we introduce the tri-modal feature fusion layer to explicitly aggregate the semantic representations of three modalities. The experimental results on the CMU-MOSEI and IEMOCAP datasets show that ME2ET achieves the state-of-the-art performance. The further in-depth analysis demonstrates the effectiveness, efficiency, and interpretability of the proposed progressive tri-modal attention, which can help our model to achieve better performance while significantly reducing the computation and memory cost. Our code will be publicly available

Inflammatory Mediator Profiling Reveals Immune Properties of Chemotactic Gradients and Macrophage Mediator Production Inhibition during Thioglycollate Elicited Peritoneal Inflammation

Understanding of spatiotemporal profiling of inflammatory mediators and their associations with MΦ accumulation is crucial to elucidate the complex immune properties. Here, we used murine thioglycollate elicited peritonitis to determine concentrations of 23 inflammatory mediators in peritoneal exudates and plasma before (day 0) and after (days 1 and 3) thioglycollate administration to peritoneal cavities; these mediators included TNF-, FGF-9, IFN-, IP-10, RANTES, IL-1 , IL-6, IL-7, IL-10, IL-11, IL-12p70, IL-17A, lymphotactin, OSM, KC/GRO, SCF, MIP-1 , MIP-2, TIMP-1, VEGF-A, MCP-1, MCP-3, and MCP-5. Our results showed that concentrations of most mediators in exudates and plasma reached peak levels on day 1 and were significantly reduced on day 3. Conversely, MΦ numbers started to increase on day 1 and reached peak levels on day 3. Moreover, LPS treatment in vitro significantly induced mediator productions in cell culture media and lysates from MΦ isolated on day 3. Our results also showed that on day 0, concentrations of many mediators in plasma were higher than those in exudates, whereas on day 1, the trend was reversed. Overall, the findings from thioglycollate elicited peritonitis reveal that reversible chemotactic gradients between peritoneal exudates and blood exist in basal and inflamed conditions and the inflammatory mediator production in vivo is disassociated with macrophage accumulation during inflammation resolution

Feasibility of laparoscopic enucleation for hemangioma in special hepatic segments

Background and aimThis study aims to evaluate the safety and efficacy of laparoscopic enucleation for liver hemangioma in special hepatic segments.MethodsWe retrospectively reviewed 58 patients who underwent laparoscopic surgery for hepatic hemangioma at a single center from January 2016 to January 2022. Segments I, IVa, VII, and VIII are defined as special hepatic segments, attributing to the bad visualization and adjacent to important vessels such as hepatic veins and inferior vena cava that lead to a high risk in laparoscopic surgery. Patients were categorized into a special location group (SLG) and a normal location group (NLG) according to the location of hemangioma. General data, intraoperative and postoperative outcomes, and postoperative complications of the two groups were compared and analyzed.ResultsThere were no significant differences in age (p = 0.288), gender (p = 0.331), body mass index (p = 0.168), the maximum diameter of hemangioma (p = 0.330), ASA risk grading (p = 0.615), and comorbidities (p > 0.05) between the two groups. The operation time (p < 0.001), intraoperative blood loss (p < 0.001), and intraoperative blood transfusion rate (p = 0.047) were significantly higher in the SLG. The rate of conversion to laparotomy was higher in the SLG, but there was no significant difference (p = 0.089). In addition, the exhaust time (p = 0.03) and postoperative hospital stay (p < 0.01) were significantly shorter in the NLG. The postoperative complications were comparable between the two groups, and there were no perioperative deaths.ConclusionLaparoscopic enucleation of hemangioma in special hepatic segments is difficult and has a critical risk of massive bleeding during surgery. Meanwhile, it is also safe, feasible, and effective