Dynamic MDETR: A Dynamic Multimodal Transformer Decoder for Visual Grounding

Multimodal transformer exhibits high capacity and flexibility to align image and text for visual grounding. However, the existing encoder-only grounding framework (e.g., TransVG) suffers from heavy computation due to the self-attention operation with quadratic time complexity. To address this issue, we present a new multimodal transformer architecture, coined as Dynamic Mutilmodal DETR (Dynamic MDETR), by decoupling the whole grounding process into encoding and decoding phases. The key observation is that there exists high spatial redundancy in images. Thus, we devise a new dynamic multimodal transformer decoder by exploiting this sparsity prior to speed up the visual grounding process. Specifically, our dynamic decoder is composed of a 2D adaptive sampling module and a text guided decoding module. The sampling module aims to select these informative patches by predicting the offsets with respect to a reference point, while the decoding module works for extracting the grounded object information by performing cross attention between image features and text features. These two modules are stacked alternatively to gradually bridge the modality gap and iteratively refine the reference point of grounded object, eventually realizing the objective of visual grounding. Extensive experiments on five benchmarks demonstrate that our proposed Dynamic MDETR achieves competitive trade-offs between computation and accuracy. Notably, using only 9% feature points in the decoder, we can reduce ~44% GFLOPs of the multimodal transformer, but still get higher accuracy than the encoder-only counterpart. In addition, to verify its generalization ability and scale up our Dynamic MDETR, we build the first one-stage CLIP empowered visual grounding framework, and achieve the state-of-the-art performance on these benchmarks.Comment: Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) in October 202

Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes

Recently, models based on deep neural networks have dominated the fields of scene text detection and recognition. In this paper, we investigate the problem of scene text spotting, which aims at simultaneous text detection and recognition in natural images. An end-to-end trainable neural network model for scene text spotting is proposed. The proposed model, named as Mask TextSpotter, is inspired by the newly published work Mask R-CNN. Different from previous methods that also accomplish text spotting with end-to-end trainable deep neural networks, Mask TextSpotter takes advantage of simple and smooth end-to-end learning procedure, in which precise text detection and recognition are acquired via semantic segmentation. Moreover, it is superior to previous methods in handling text instances of irregular shapes, for example, curved text. Experiments on ICDAR2013, ICDAR2015 and Total-Text demonstrate that the proposed method achieves state-of-the-art results in both scene text detection and end-to-end text recognition tasks.Comment: To appear in ECCV 201

Sirt3 Ameliorates Oxidative Stress and Mitochondrial Dysfunction After Intracerebral Hemorrhage in Diabetic Rats

Aim: Sirtuin3 (sirt3) plays a pivotal role in improving oxidative stress and mitochondrial dysfunction which directly induced neuronal apoptosis after intracerebral hemorrhage (ICH). Reactive oxygen species (ROS) is also a critical activator in triggering NACHT, LRR, and PYD domains-containing protein 3 (NLRP3) inflammasomes activation which can regulate inflammatory responses in brain. Moreover, hyperglycemia can aggravate the ICH-induced damage. Hence, this study was designed to investigate the mechanisms of neuroprotection of sirt3 in hyperglycemic ICH.Methods: ICH model was established by autologous blood injection. Hyperglycemia was induced by intraperitoneal injection with streptozotocin. Honokiol (HKL, a pharmacological agonist of sirt3) was injected intraperitoneally at doses of 2.5, 5, or 10 mg/kg. Sirt3 small interfering RNA transfection was implemented through intracerebroventricular injection. The expression of sirt3 and its downstream signaling molecules were detected using Western blotting or immunofluorescence staining. Morphological changes of mitochondria were detected by electron microscopy. SH-SY5Y cells were incubated with 10 μM oxyhemoglobin for 48 h to establish an in vitro ICH model, and then JC-1 staining was used to determine mitochondrial membrane potential (Δψm).Results: Hyperglycemia could suppress sirt3 expression after ICH when compared with non-diabetic rats. Sirt3 protein expression was decreased to the minimum at 24 h in perihematoma tissues. Electron microscope analysis indicated that hyperglycemic ICH induced extensive mitochondrial vacuolization. HKL attenuated ROS accumulation, adenosine triphosphate reduction, and Δψm through Sirt3–superoxide dismutase 2 (SOD2) and Sirt3–NRF1–TFAM pathway. Sirt3 knockdown could exacerbate the neuronal apoptosis and reverse the positive effects of HKL. Sirt3 activation could decrease NLRP3 and interleukin-1β levels through deacetylating SOD2 and scavenging ROS.Conclusion: HKL protects against hyperglycemic ICH-induced neuronal injury via a sirt3-dependent manner

Tirofiban for Stroke without Large or Medium-Sized Vessel Occlusion

The effects of the glycoprotein IIb/IIIa receptor inhibitor tirofiban in patients with acute ischemic stroke but who have no evidence of complete occlusion of large or medium-sized vessels have not been extensively studied. In a multicenter trial in China, we enrolled patients with ischemic stroke without occlusion of large or medium-sized vessels and with a National Institutes of Health Stroke Scale score of 5 or more and at least one moderately to severely weak limb. Eligible patients had any of four clinical presentations: ineligible for thrombolysis or thrombectomy and within 24 hours after the patient was last known to be well; progression of stroke symptoms 24 to 96 hours after onset; early neurologic deterioration after thrombolysis; or thrombolysis with no improvement at 4 to 24 hours. Patients were assigned to receive intravenous tirofiban (plus oral placebo) or oral aspirin (100 mg per day, plus intravenous placebo) for 2 days; all patients then received oral aspirin until day 90. The primary efficacy end point was an excellent outcome, defined as a score of 0 or 1 on the modified Rankin scale (range, 0 [no symptoms] to 6 [death]) at 90 days. Secondary end points included functional independence at 90 days and a quality-of-life score. The primary safety end points were death and symptomatic intracranial hemorrhage. A total of 606 patients were assigned to the tirofiban group and 571 to the aspirin group. Most patients had small infarctions that were presumed to be atherosclerotic. The percentage of patients with a score of 0 or 1 on the modified Rankin scale at 90 days was 29.1% with tirofiban and 22.2% with aspirin (adjusted risk ratio, 1.26; 95% confidence interval, 1.04 to 1.53, P = 0.02). Results for secondary end points were generally not consistent with the results of the primary analysis. Mortality was similar in the two groups. The incidence of symptomatic intracranial hemorrhage was 1.0% in the tirofiban group and 0% in the aspirin group. In this trial involving heterogeneous groups of patients with stroke of recent onset or progression of stroke symptoms and nonoccluded large and medium-sized cerebral vessels, intravenous tirofiban was associated with a greater likelihood of an excellent outcome than low-dose aspirin. Incidences of intracranial hemorrhages were low but slightly higher with tirofiban

Methylprednisolone as Adjunct to Endovascular Thrombectomy for Large-Vessel Occlusion Stroke

Importance It is uncertain whether intravenous methylprednisolone improves outcomes for patients with acute ischemic stroke due to large-vessel occlusion (LVO) undergoing endovascular thrombectomy. Objective To assess the efficacy and adverse events of adjunctive intravenous low-dose methylprednisolone to endovascular thrombectomy for acute ischemic stroke secondary to LVO. Design, Setting, and Participants This investigator-initiated, randomized, double-blind, placebo-controlled trial was implemented at 82 hospitals in China, enrolling 1680 patients with stroke and proximal intracranial LVO presenting within 24 hours of time last known to be well. Recruitment took place between February 9, 2022, and June 30, 2023, with a final follow-up on September 30, 2023.InterventionsEligible patients were randomly assigned to intravenous methylprednisolone (n = 839) at 2 mg/kg/d or placebo (n = 841) for 3 days adjunctive to endovascular thrombectomy. Main Outcomes and Measures The primary efficacy outcome was disability level at 90 days as measured by the overall distribution of the modified Rankin Scale scores (range, 0 [no symptoms] to 6 [death]). The primary safety outcomes included mortality at 90 days and the incidence of symptomatic intracranial hemorrhage within 48 hours. Results Among 1680 patients randomized (median age, 69 years; 727 female [43.3%]), 1673 (99.6%) completed the trial. The median 90-day modified Rankin Scale score was 3 (IQR, 1-5) in the methylprednisolone group vs 3 (IQR, 1-6) in the placebo group (adjusted generalized odds ratio for a lower level of disability, 1.10 [95% CI, 0.96-1.25]; P = .17). In the methylprednisolone group, there was a lower mortality rate (23.2% vs 28.5%; adjusted risk ratio, 0.84 [95% CI, 0.71-0.98]; P = .03) and a lower rate of symptomatic intracranial hemorrhage (8.6% vs 11.7%; adjusted risk ratio, 0.74 [95% CI, 0.55-0.99]; P = .04) compared with placebo. Conclusions and Relevance Among patients with acute ischemic stroke due to LVO undergoing endovascular thrombectomy, adjunctive methylprednisolone added to endovascular thrombectomy did not significantly improve the degree of overall disability.Trial RegistrationChiCTR.org.cn Identifier: ChiCTR210005172

Photovoltaic Effect in Graphene/MoS2/Si Van der Waals Heterostructures

This paper presents a study on the photovoltaic effect of a graphene/MoS2/Si double heterostructure, grown by rapid chemical vapor deposition. It was found that the double junctions of the graphene/MoS2 Schottky junction and the MoS2/Si heterostructure played important roles in enhancing the device’s performance. They allowed more electron-hole pairs to be efficiently generated, separated, and collected in the graphene/MoS2/Si double interface. The device demonstrated an open circuit voltage of 0.51 V and an energy conversion efficiency of 2.58% under an optical illumination of 500 mW/cm2. The photovoltaic effect of the device was partly attributed to the strong light absorption and photoresponse of the few-layer MoS2 film, and partly ascribed to the high carrier-collection-rate of the double van der Waals heterostructures (vdWHs) in the device

Parameter Optimization of Jet Control for Compression Ramps of Two-DimensionalInlet Based on Isight

Two-dimensional inlet is usually used in the wide-speed-range aircraft which has a higher flying velocity region. It is difficult to meet more requirements under both low-speed and high-speed flow conditions. Although the inlet perfor-mance could be improved by using jets to control shock waves on compression ramps, the existing jet excitation only push the shock wave toward the cowl, which may not achieve optimal performance. The optimization of jet control parameters is a significant problem. The effects of different optimization variables on inlet performance were investigated at Ma=6 based on Isight with the Hooke-Jeeves optimization method, in which different jet parameters were selected as optimization variables, flow coefficient was selected as constraint condition and maximum total pressure recovery coefficient was selected as objective function for optimization. The result show that the Hooke-Jeeves optimization method is able to optimize inlet with jet control. The optimized inlet can meet the requirements of flow coefficients. The total pressure recovery coefficient after optimizing the jet angle is increased by 18% compared to the inlet without jet, and the total pressure recovery coefficient after combination optimization is increased by 2.82% compared to only optimizing the jet angle