F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Models

We present F-VLM, a simple open-vocabulary object detection method built upon Frozen Vision and Language Models. F-VLM simplifies the current multi-stage training pipeline by eliminating the need for knowledge distillation or detection-tailored pretraining. Surprisingly, we observe that a frozen VLM: 1) retains the locality-sensitive features necessary for detection, and 2) is a strong region classifier. We finetune only the detector head and combine the detector and VLM outputs for each region at inference time. F-VLM shows compelling scaling behavior and achieves +6.5 mask AP improvement over the previous state of the art on novel categories of LVIS open-vocabulary detection benchmark. In addition, we demonstrate very competitive results on COCO open-vocabulary detection benchmark and cross-dataset transfer detection, in addition to significant training speed-up and compute savings. Code will be released.Comment: 19 pages, 6 figure

Video Question Answering with Iterative Video-Text Co-Tokenization

Video question answering is a challenging task that requires understanding jointly the language input, the visual information in individual video frames, as well as the temporal information about the events occurring in the video. In this paper, we propose a novel multi-stream video encoder for video question answering that uses multiple video inputs and a new video-text iterative co-tokenization approach to answer a variety of questions related to videos. We experimentally evaluate the model on several datasets, such as MSRVTT-QA, MSVD-QA, IVQA, outperforming the previous state-of-the-art by large margins. Simultaneously, our model reduces the required GFLOPs from 150-360 to only 67, producing a highly efficient video question answering model.Comment: ECCV 202

Extreme positive allometry of animal adhesive pads and the size limits of adhesion-based climbing.

Organismal functions are size-dependent whenever body surfaces supply body volumes. Larger organisms can develop strongly folded internal surfaces for enhanced diffusion, but in many cases areas cannot be folded so that their enlargement is constrained by anatomy, presenting a problem for larger animals. Here, we study the allometry of adhesive pad area in 225 climbing animal species, covering more than seven orders of magnitude in weight. Across all taxa, adhesive pad area showed extreme positive allometry and scaled with weight, implying a 200-fold increase of relative pad area from mites to geckos. However, allometric scaling coefficients for pad area systematically decreased with taxonomic level and were close to isometry when evolutionary history was accounted for, indicating that the substantial anatomical changes required to achieve this increase in relative pad area are limited by phylogenetic constraints. Using a comparative phylogenetic approach, we found that the departure from isometry is almost exclusively caused by large differences in size-corrected pad area between arthropods and vertebrates. To mitigate the expected decrease of weight-specific adhesion within closely related taxa where pad area scaled close to isometry, data for several taxa suggest that the pads' adhesive strength increased for larger animals. The combination of adjustments in relative pad area for distantly related taxa and changes in adhesive strength for closely related groups helps explain how climbing with adhesive pads has evolved in animals varying over seven orders of magnitude in body weight. Our results illustrate the size limits of adhesion-based climbing, with profound implications for large-scale bio-inspired adhesives.We are sincerely grateful to all our colleagues who readily shared published and unpublished data with us: Aaron M. Bauer, Jon Barnes, Niall Crawford, Thomas Endlein, Hanns Hagen Goetzke, Thomas E. Macrini, Anthony P. Russell & Joanna M. Smith. We also thank Casey Gilman, Dylan Briggs, Irina Showalter, Dan King and Mike Imburgia for their assistance with the collection of gecko toepad data. This study was supported by research grants from the UK Biotechnology and Biological Sciences Research Council (BB/I008667/1) to WF, the Human Frontier Science Programme (RGP0034/2012) to DI, AJC and WF, the Denman Baynes Senior Research Fellowship to DL and a Discovery Early Career Research Fellowship (DE120101503) to CJC.This is the author accepted manuscript. The final version is available from the National Academy of Sciences via http://dx.doi.org/ 10.1073/pnas.151945911

Effects of interdot hopping and Coulomb blockade on the thermoelectric properties of serially coupled quantum dots

We have theoretically studied the thermoelectric properties of serially coupled quantum dots (SCQD) embedded in an insulator matrix connected to metallic electrodes. In the framework of Keldysh Green's function technique, the Landauer formula of transmission factor is obtained by using the equation of motion method. Based on such analytical expressions of charge and heat currents, we calculate the electrical conductance, Seebeck coefficient, electron thermal conductance and figure of merit (ZT) of SCQD in the linear response regime. The effects of electron Coulomb interactions on the reduction and enhancement of ZT are analyzed. We demonstrate that ZT is not a monotonic increasing function of interdot electron hopping strength ($t_c$). We also show that in the absence of phonon thermal conductance, SCQD can reach the Carnot efficiency as $t_c$ approaches zero.Comment: corrected some argumenet

An essential role for the tumor suppressor Merlin in regulating fatty acid synthesis.

Neurofibromatosis type 2 (NF2) is an autosomal dominant disorder characterized by the development of multiple tumors in the central nervous system, most notably schwannomas and meningiomas. Mutational inactivation of the NF2 gene encoding the protein Merlin is found in most sporadic and inherited schwannomas, but the molecular mechanisms underlying neoplastic changes in schwannoma cells remain unclear. We report here that NF2-deficient cells display elevated expression levels of key enzymes involved in lipogenesis and that this upregulation is caused by increased activity of Torc1. Inhibition or knockdown of fatty acid synthase (FASN), the enzyme that catalyzes the formation of palmitic acid from malonyl-CoA, drove NF2-deficient cells into apoptosis. Treatment of NF2-mutant cells with agents that inhibit the production of malonyl-CoA reduced their sensitivity to FASN inhibitors. Collectively, these results suggest that the altered lipid metabolism found in NF2-mutant cells renders them sensitive to elevated levels of malonyl-CoA, as occurs following blockade of fatty acid synthase, suggesting new targeted strategies in the treatment of NF2-deficient tumors

Ethanol reversal of tolerance to the respiratory depressant effects of morphine

Opioids are the most common drugs associated with unintentional drug overdose. Death results from respiratory depression. Prolonged use of opioids results in the development of tolerance but the degree of tolerance is thought to vary between different effects of the drugs. Many opioid addicts regularly consume alcohol (ethanol), and post-mortem analyses of opioid overdose deaths have revealed an inverse correlation between blood morphine and ethanol levels. In the present study, we determined whether ethanol reduced tolerance to the respiratory depressant effects of opioids. Mice were treated with opioids (morphine, methadone, or buprenorphine) for up to 6 days. Respiration was measured in freely moving animals breathing 5% CO(2) in air in plethysmograph chambers. Antinociception (analgesia) was measured as the latency to remove the tail from a thermal stimulus. Opioid tolerance was assessed by measuring the response to a challenge dose of morphine (10 mg/kg i.p.). Tolerance developed to the respiratory depressant effect of morphine but at a slower rate than tolerance to its antinociceptive effect. A low dose of ethanol (0.3 mg/kg) alone did not depress respiration but in prolonged morphine-treated animals respiratory depression was observed when ethanol was co-administered with the morphine challenge. Ethanol did not alter the brain levels of morphine. In contrast, in methadone- or buprenorphine-treated animals no respiratory depression was observed when ethanol was co-administered along with the morphine challenge. As heroin is converted to morphine in man, selective reversal of morphine tolerance by ethanol may be a contributory factor in heroin overdose deaths

Micro-manufacturing : research, technology outcomes and development issues

Besides continuing effort in developing MEMS-based manufacturing techniques, latest effort in Micro-manufacturing is also in Non-MEMS-based manufacturing. Research and technological development (RTD) in this field is encouraged by the increased demand on micro-components as well as promised development in the scaling down of the traditional macro-manufacturing processes for micro-length-scale manufacturing. This paper highlights some EU funded research activities in micro/nano-manufacturing, and gives examples of the latest development in micro-manufacturing methods/techniques, process chains, hybrid-processes, manufacturing equipment and supporting technologies/device, etc., which is followed by a summary of the achievements of the EU MASMICRO project. Finally, concluding remarks are given, which raise several issues concerning further development in micro-manufacturing