Shot2Story20K: A New Benchmark for Comprehensive Understanding of Multi-shot Videos

A short clip of video may contain progression of multiple events and an interesting story line. A human need to capture both the event in every shot and associate them together to understand the story behind it. In this work, we present a new multi-shot video understanding benchmark Shot2Story20K with detailed shot-level captions and comprehensive video summaries. To facilitate better semantic understanding of videos, we provide captions for both visual signals and human narrations. We design several distinct tasks including single-shot video and narration captioning, multi-shot video summarization, and video retrieval with shot descriptions. Preliminary experiments show some challenges to generate a long and comprehensive video summary. Nevertheless, the generated imperfect summaries can already significantly boost the performance of existing video understanding tasks such as video question-answering, promoting an under-explored setting of video understanding with detailed summaries.Comment: See https://mingfei.info/shot2story for updates and more informatio

Применение метода фотометрии лежащих капель для задач клинической лабораторной диагностики

В статье представлены теоретические обоснования и экспериментальные исследования, посвященные разработке метода диагностики жидких сред на основе фотометрии образцов проб в виде лежащих капель. Приведены обоснования механизмов влияния протекающих в капельных пробах процессов на их оптические свойства. Представлены результаты апробации метода фотометрии капель для оценки динамики оседания эритроцитов и процесса образования фибринового сгустка при проведении клоттинговых тестов

A Joint Framework Towards Class-aware and Class-agnostic Alignment for Few-shot Segmentation

Few-shot segmentation (FSS) aims to segment objects of unseen classes given only a few annotated support images. Most existing methods simply stitch query features with independent support prototypes and segment the query image by feeding the mixed features to a decoder. Although significant improvements have been achieved, existing methods are still face class biases due to class variants and background confusion. In this paper, we propose a joint framework that combines more valuable class-aware and class-agnostic alignment guidance to facilitate the segmentation. Specifically, we design a hybrid alignment module which establishes multi-scale query-support correspondences to mine the most relevant class-aware information for each query image from the corresponding support features. In addition, we explore utilizing base-classes knowledge to generate class-agnostic prior mask which makes a distinction between real background and foreground by highlighting all object regions, especially those of unseen classes. By jointly aggregating class-aware and class-agnostic alignment guidance, better segmentation performances are obtained on query images. Extensive experiments on PASCAL-$5^i$ and COCO-$20^i$ datasets demonstrate that our proposed joint framework performs better, especially on the 1-shot setting

Quadruple bonding between iron and boron in the BFe(CO)3- complex.

While main group elements have four valence orbitals accessible for bonding, quadruple bonding to main group elements is extremely rare. Here we report that main group element boron is able to form quadruple bonding interactions with iron in the BFe(CO)3- anion complex, which has been revealed by quantum chemical investigation and identified by mass-selected infrared photodissociation spectroscopy in the gas phase. The complex is characterized to have a B-Fe(CO)3- structure of C3v symmetry and features a B-Fe bond distance that is much shorter than that expected for a triple bond. Various chemical bonding analyses indicate that the complex involves unprecedented B≣Fe quadruple bonding interactions. Besides the common one electron-sharing σ bond and two Fe→B dative π bonds, there is an additional weak B→Fe dative σ bonding interaction. This finding of the new quadruple bonding indicates that there might exist a wide range of boron-metal complexes that contain such high multiplicity of chemical bonds

Wind tunnel test study on the wind load variation law of a point focus solar furnace

This work studied the wind load acting on a point focus solar furnace composed of a 110 m2 heliostat and a 77 m2 concentrator through wind tunnel testing. Based on wind tunnel test data under 305 different working conditions, the variation laws of the wind pressure coefficient, power spectral density, and wind load coefficient of the heliostat and concentrator were analyzed. The results showed that due to the interaction between the concentrator and heliostat, the wind speed near the heliostat and concentrator decreased but the turbulence intensity increased, which caused the peak wind load coefficient to rise slightly. The results suggested that a safety factor of 1.1–1.2 should be considered for structural design and optimization of solar furnaces

Soliton generation in CaF2_2 crystalline whispering gallery mode resonators with negative thermal-optical effects

Calcium fluoride (CaF$_2$) crystalline whispering gallery mode resonators (WGMRs) exhibit ultrahigh intrinsic quality factors and a low power anomalous dispersion in the communication and mid-infrared bands, making them attractive platforms for microresonator-based comb generation. However, their unique negative thermo-optic effects pose challenges when achieving thermal equilibrium. To our knowledge, our experiments serve as the first demonstration of soliton microcombs in Q > 109 CaF$_2$ WGMRs. We observed soliton mode-locking and bidirectional switching of soliton numbers caused by the negative thermo-optic effects. Additionally, various soliton formation dynamics are shown, including breathing and vibrational solitons, which can be attributed to thermo-photomechanical oscillations. Thus, our results enrich the soliton generation platform and provide a reference for generating solitons from WGMRs that comprise other materials with negative thermo-optic effects. In the future, the ultrahigh quality factor of CaF$_2$ crystal cavities may enable the generation of sub-milliwatt-level broad-spectrum soliton combs.Comment: 4 pages,5 pictures,description of soliton generation in a calcium fluoride whisper gallery mode microresonators with negative thermo-optical effect,ready for publication in optics lette

Influencing factors on green supply chain resilience of agricultural products: an improved gray-DEMATEL-ISM approach

IntroductionNatural disasters and the COVID-19 epidemic have caused serious consequences such as long-term disruption and chain reaction to the global supply chain. Global warming caused by a large number of greenhouse gases has accelerated the attention of society to environmental sustainability. Therefore, identifying the transmission path of the factors that affect the green supply chain resilience of agricultural products is the primary task to accelerate the construction of a modern circulation system of agricultural products, ensure market supply and protect the environment.MethodsBased on the stakeholder theory, this study uses the literature research method to identify 15 factors that affect the green supply chain resilience of agricultural products. Through improving DEMATEL and ISM to study the internal relationship between the influencing factors, build a multi-level hierarchical structure model, and identify the basic transmission process and path of the influencing factors.ResultsThe results show that the government’s issuance of environmental policies and the provision of financial subsidies are important driving forces to strengthen the green supply chain resilience of agricultural products; The collaboration capability and business sustainability goals directly affect the green supply chain resilience of agricultural products; Agility, digital infrastructure construction, sustainability beliefs of top managers, public opinion with environment information disclosure and other factors indirectly affect the green supply chain resilience of agricultural products.DiscussionThe conclusion shows that the most important way to guide the green supply chain of agricultural products to develop towards standardization, normalization and sustainability is to guide the organization to set business sustainable goals and strengthen the collaborative cooperation ability of all stakeholders in the supply chain, with the government issuing environmental policies and providing financial subsidies as the driving factors. This study can provide theoretical basis for the government and enterprises to strengthen the green supply chain resilience of agricultural products