Modality-invariant and Specific Prompting for Multimodal Human Perception Understanding

Understanding human perceptions presents a formidable multimodal challenge for computers, encompassing aspects such as sentiment tendencies and sense of humor. While various methods have recently been introduced to extract modality-invariant and specific information from diverse modalities, with the goal of enhancing the efficacy of multimodal learning, few works emphasize this aspect in large language models. In this paper, we introduce a novel multimodal prompt strategy tailored for tuning large language models. Our method assesses the correlation among different modalities and isolates the modality-invariant and specific components, which are then utilized for prompt tuning. This approach enables large language models to efficiently and effectively assimilate information from various modalities. Furthermore, our strategy is designed with scalability in mind, allowing the integration of features from any modality into pretrained large language models. Experimental results on public datasets demonstrate that our proposed method significantly improves performance compared to previous methods

Memory-Inspired Temporal Prompt Interaction for Text-Image Classification

In recent years, large-scale pre-trained multimodal models (LMM) generally emerge to integrate the vision and language modalities, achieving considerable success in various natural language processing and computer vision tasks. The growing size of LMMs, however, results in a significant computational cost for fine-tuning these models for downstream tasks. Hence, prompt-based interaction strategy is studied to align modalities more efficiently. In this contex, we propose a novel prompt-based multimodal interaction strategy inspired by human memory strategy, namely Memory-Inspired Temporal Prompt Interaction (MITP). Our proposed method involves in two stages as in human memory strategy: the acquiring stage, and the consolidation and activation stage. We utilize temporal prompts on intermediate layers to imitate the acquiring stage, leverage similarity-based prompt interaction to imitate memory consolidation, and employ prompt generation strategy to imitate memory activation. The main strength of our paper is that we interact the prompt vectors on intermediate layers to leverage sufficient information exchange between modalities, with compressed trainable parameters and memory usage. We achieve competitive results on several datasets with relatively small memory usage and 2.0M of trainable parameters (about 1% of the pre-trained foundation model)

Comparison Between Movement-Based and Task-Based Mirror Therapies on Improving Upper Limb Functions in Patients With Stroke: A Pilot Randomized Controlled Trial

Objective: The aim of this trial was to compare the effect of movement-based mirror therapy (MMT) and task-based mirror therapy (TMT) on improving upper limb functions in patients with stroke.Methods: A total of 34 patients with sub-acute stroke with mildly to moderately impaired upper limb motor functions. The participants were randomly allocated to one of three groups: MMT, TMT, and conventional treatment (CT). The MMT group underwent movement-based mirror therapy for around 30 min/day, 5 days/week, for 4 weeks, whereas the TMT group underwent dose-matched TMT. The CT group underwent only conventional rehabilitation. The MMT and TMT groups underwent CT in addition to their mirror therapy. Blinded assessments were administered at baseline and immediately after the intervention. Upper limb motor functions, measured using Fugl-Meyer Assessment-upper extremity (FMA-UE), Wolf Motor Function Test (WMFT), and hand grip strength; upper limb spasticity, measured using the modified Ashworth scale (MAS); and activities of daily living, measured using the modified Barthel index (MBI).Results: A significant time-by-group interaction effect was noted in FMA-UE. Post-hoc analysis of change scores showed that MMT yielded a better effect on improving FMA-UE than the other two therapies, at a marginally significant level (P = 0.050 and 0.022, respectively). No significant interaction effect was noted in WMFT, hand grip strength, MAS, and MBI.Conclusion: Both MMT and TMT are effective in improving the upper limb function of patients with mild to moderate hemiplegia due to stroke. Nevertheless, MMT seems to be superior to TMT in improving hemiplegic upper extremity impairment. Further studies with larger stroke cohorts are expected to be inspired by this pilot trial.Trial registration number: No. ChiCTR1800019043 (http://www.chictr.org.cn/index.aspx

Robust estimation of bacterial cell count from optical density

Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals <1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data

Path Planning for Aircraft Fuel Tank Inspection Robot Based on Region Division

Path planning is indispensable in performing the inspection task using continuum robot in the environment like aircraft fuel tank. In order to obtain the optimal path and make it feasible for the robot traversal, a path planning strategy based on region division is put forward. The aircraft fuel tank is divided into several regions and mapped to a two-dimension plane by using dimension reduction which can reduce computation complexity. Three numerical methods are proposed in terms of different regions where the target point locates, and the shortest telescopic distance of the inspection robot can be solved. With bending and rotating of the inspection robot, the three methods ensure arbitrary point in the single cabin can be achieved. Simulation experiments are implemented on Matlab, and the accuracy, the effectiveness and feasibility of the algorithm are verified

Treatment of malignant airway stenosis with extracorporeal membrane oxygenation under low-dose anticoagulation: A case report

The occurrence of airway obstruction due to severe stenosis from lung cancer poses a significant risk of asphyxia. Although the placement of a metallic stent may relieve the obstruction, the procedure is associated with a high risk of asphyxia. To mitigate this risk, extracorporeal membrane pulmonary oxygenation (ECMO) has been proposed to temporarily substitute for cardiopulmonary function during the procedure. However, the use of systemic anticoagulation with heparin during ECMO may increase the likelihood of bleeding during surgery. This case report describes a successful treatment of a patient with malignant central airway obstruction through low-dose heparin veno-venous ECMO. This approach resulted in reduced intraoperative bleeding and invasive operation time, allowing for prompt postoperative withdrawal and recovery

High-efficiency V-shaped phase gratings to suppress high order diffractions

We propose a V-shaped phase grating to simultaneously improve the diffraction efficiency of the 1st order diffraction mode and suppression of high order modes. An analytic description is given that indicates the 0th, 2nd, 3rd, and 4th order diffractions can be completely suppressed while the 1st order absolute diffraction efficiency can reach a theoretical maximum of 27.72%, which is much higher than that reported from single order gratings, such as sinusoidal amplitude transmission gratings. The dependencies of the 1st order diffraction efficiency on the wavelength and depth deviations are also discussed. The experimental results show that the absolute efficiency of the 1st order diffraction is 25.85% while the 2nd, 3rd, and 4th order diffractions disappear completely, confirming the theoretical predictions. The diffraction patterns of a xenon lamp demonstrate the suppression of the high order diffractions from our quartz phase grating. The unique dispersive properties of the V-shaped phase grating make it attractive for broad spectroscopy and high-accuracy monochromatization applications

A Task-Centric Cooperative Sensing Scheme for Mobile Crowdsourcing Systems

In a densely distributed mobile crowdsourcing system, data collected by neighboring participants often exhibit strong spatial correlations. By exploiting this property, one may employ a portion of the users as active participants and set the other users as idling ones without compromising the quality of sensing or the connectivity of the network. In this work, two participant selection questions are considered: (a) how to recruit an optimal number of users as active participants to guarantee that the overall sensing data integrity is kept above a preset threshold; and (b) how to recruit an optimal number of participants with some inaccurate data so that the fairness of selection and resource conservation can be achieved while maintaining sufficient sensing data integrity. For question (a), we propose a novel task-centric approach to explicitly exploit data correlation among participants. This subset selection problem is regarded as a constrained optimization problem and we propose an efficient polynomial time algorithm to solve it. For question (b), we formulate this set partitioning problem as a constrained min-max optimization problem. A solution using an improved version of the polynomial time algorithm is proposed based on (a). We validate these algorithms using a publicly available Intel-Berkeley lab sensing dataset and satisfactory performance is achieved

Delayed Liver Regeneration after Partial Hepatectomy in Aged Nos2 Knockout Mice

Objective Patients over 60 years of age have higher mortality and morbidity after major liver resections. Nitric oxide (NO) derived from the catalytic activity of Nos2 plays a beneficial role in liver regeneration (LR) after partial hepatectomy (PH). In this experiment, we evaluated the effect of Nos2 knockout (KO) on LR in aged mice after PH. Materials and Methods In this experimental study, 52 two-year-old Nos2 KO and 46 the same age wild-type (WT) C57BL/6J mice were subjected to 2/3 PH. Liver tissues were collected at 11 time points after PH. Mice survival ratio and liver coefficient (liver-weight/ body-weight) was calculated. Transcript and protein levels were estimated by reverse transcriptase-quantitative polymerase chain reaction (RT-qPCR) and Western blot, respectively. Results The aged Nos2 KO mice had lower survival ratio (P=0.039) and liver coefficient (P=0.002) at the termination phase. Nos2 transcript level was obviously increased after PH in WT mice and undetected in the Nos2 KO mice. During LR, the expression at the transcript level of Cyclin D1, Cyclin A2 and Cyclin B1 and protein expression level of proliferation marker Ki67 and proliferation-associated transcription factors JNK1, NF-kB and STAT3 were decreased or delayed. The expression of pro-apoptotic proteins, CASPASE3, CASPASE9 and BAX, was increased in the Nos2 KO mice. Conclusion Decreased survival ratio and impaired LR in aged Nos2 KO mice is probably due to decreased liver cell proliferation and increased liver cell apoptosis