Understanding ME? Multimodal Evaluation for Fine-grained Visual Commonsense

Visual commonsense understanding requires Vision Language (VL) models to not only understand image and text but also cross-reference in-between to fully integrate and achieve comprehension of the visual scene described. Recently, various approaches have been developed and have achieved high performance on visual commonsense benchmarks. However, it is unclear whether the models really understand the visual scene and underlying commonsense knowledge due to limited evaluation data resources. To provide an in-depth analysis, we present a Multimodal Evaluation (ME) pipeline to automatically generate question-answer pairs to test models' understanding of the visual scene, text, and related knowledge. We then take a step further to show that training with the ME data boosts the model's performance in standard VCR evaluation. Lastly, our in-depth analysis and comparison reveal interesting findings: (1) semantically low-level information can assist the learning of high-level information but not the opposite; (2) visual information is generally under utilization compared with text.Comment: Accepted to EMNLP 2022 Long Pape

Multicarrier Modulation-Based Digital Radio-over-Fibre System Achieving Unequal Bit Protection with Over 10 dB SNR Gain

We propose a multicarrier modulation-based digital radio-over-fibre system achieving unequal bit protection by bit and power allocation for subcarriers. A theoretical SNR gain of 16.1 dB is obtained in the AWGN channel and the simulation results show a 13.5 dB gain in the bandwidth-limited case

Overprotection and overcontrol in childhood: An evaluation on reliability and validity of 33-item expanded Childhood Trauma Questionnaire (CTQ-33), Chinese version

Overprotection and overcontrol from parents or other family members, which are not rare in the Chinese culture, have been suggested to be traumatic experiences for some children. However, research on overprotection/overcontrol is much rarer in China compared with other childhood trauma subtypes. One of the possible reasons for this is the lack of easy and feasible screening tools. In this study, we therefore translated and validated a Chinese version of the 33-item Childhood Trauma Questionnaire (CTQ-33), which was expanded from the widely-used 28-item CTQ with an additional overprotection/overcontrol subscale. A total of 248 young healthy participants were recruited and completed the Chinese version of CTQ-33, and 50 of them were retested after an interval of two weeks. At baseline, all participants also completed the 9-item Patient Health Questionnaire and the 7-item Generalized Anxiety Disorder Scale to assess their depression and anxiety, respectively. Our main findings include that: (1) the Chinese version of CTQ-33 showed a good internal consistency (Cronbach\u27s α coefficient = 0.733) and an excellent test-retest reliability over a two-week period (ICC = 0.861); (2) the previously reported significant associations between the overprotection/overcontrol and other subtypes of childhood trauma (abuse and neglect), as well as psychopathological conditions such as depression can all be replicated using the Chinese version of CTQ-33. These results suggest that the Chinese version of CTQ-33 would be a promising tool for assessing various subtypes of childhood adversities, especially the overprotection/overcontrol experiences in Chinese populations

SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks

We introduce SwiftSage, a novel agent framework inspired by the dual-process theory of human cognition, designed to excel in action planning for complex interactive reasoning tasks. SwiftSage integrates the strengths of behavior cloning and prompting large language models (LLMs) to enhance task completion performance. The framework comprises two primary modules: the Swift module, representing fast and intuitive thinking, and the Sage module, emulating deliberate thought processes. The Swift module is a small encoder-decoder LM fine-tuned on the oracle agent's action trajectories, while the Sage module employs LLMs such as GPT-4 for subgoal planning and grounding. We develop a heuristic method to harmoniously integrate the two modules, resulting in a more efficient and robust problem-solving process. In 30 tasks from the ScienceWorld benchmark, SwiftSage significantly outperforms other methods such as SayCan, ReAct, and Reflexion, demonstrating its effectiveness in solving complex real-world tasks.Comment: Project website: https://yuchenlin.xyz/swiftsage

LIN28 Is Involved in Glioma Carcinogenesis and Predicts Outcomes of Glioblastoma Multiforme Patients

LIN28, an evolutionarily conversed RNA binding protein which can bind to the terminal loops of let-7 family microRNA precursors and block their processing to maturation, is highly expressed in several subsets of tumors that carry poor prognoses, such as ovarian carcinoma, hepatocellular carcinoma, colon carcinoma and germ cell carcinoma. However, there has been no study on the expression of LIN28 in glioma tissues or their importance as a prognostic predictor of glioma patients. This study aimed to examine the expression of LIN28 in glioma and correlate the results to patient outcome. We found that LIN28 expression was significantly higher in the group of patients with a poor prognosis compared to patients with a good prognosis by gene microarray. Log-rank analysis showed patients with higher LIN28 expression level in tumor had a shorter progression-free survival and overall survival times compared to those with lower LIN28 expression level. Similar results were also obtained from the tissue microarray analysis. Univariate and multivariate analyses showed high LIN28 expression was an independent prognostic factor for a shorter progression-free survival and overall survival in GBM patients. Furthermore in vitro experiments showed that down-regulation of LIN28 in U251 and U373 cells caused cell cycle arrest in the G1 phase, delayed cell proliferation, increased apoptosis, and resulted in fewer colonies compared to controls. Summarily, our data provides a potential target for cancer therapy as an approach to overcome the poor options currently available for GBM patients

A Looming Spatial Localization Neural Network Inspired by MLG1 Neurons in the Crab Neohelice

Similar to most visual animals, the crab Neohelice granulata relies predominantly on visual information to escape from predators, to track prey and for selecting mates. It, therefore, needs specialized neurons to process visual information and determine the spatial location of looming objects. In the crab Neohelice granulata, the Monostratified Lobula Giant type1 (MLG1) neurons have been found to manifest looming sensitivity with finely tuned capabilities of encoding spatial location information. MLG1s neuronal ensemble can not only perceive the location of a looming stimulus, but are also thought to be able to influence the direction of movement continuously, for example, escaping from a threatening, looming target in relation to its position. Such specific characteristics make the MLG1s unique compared to normal looming detection neurons in invertebrates which can not localize spatial looming. Modeling the MLG1s ensemble is not only critical for elucidating the mechanisms underlying the functionality of such neural circuits, but also important for developing new autonomous, efficient, directionally reactive collision avoidance systems for robots and vehicles. However, little computational modeling has been done for implementing looming spatial localization analogous to the specific functionality of MLG1s ensemble. To bridge this gap, we propose a model of MLG1s and their pre-synaptic visual neural network to detect the spatial location of looming objects. The model consists of 16 homogeneous sectors arranged in a circular field inspired by the natural arrangement of 16 MLG1s’ receptive fields to encode and convey spatial information concerning looming objects with dynamic expanding edges in different locations of the visual field. Responses of the proposed model to systematic real-world visual stimuli match many of the biological characteristics of MLG1 neurons. The systematic experiments demonstrate that our proposed MLG1s model works effectively and robustly to perceive and localize looming information, which could be a promising candidate for intelligent machines interacting within dynamic environments free of collision. This study also sheds light upon a new type of neuromorphic visual sensor strategy that can extract looming objects with locational information in a quick and reliable manner

Nonapotassium trialuminium hexa­phosphate

In the title compound, K9Al3(PO4)6, the anionic substructure is built of inter­linked [PO4] and [AlO4] tetra­hedra. Each O atom of the [AlO4] tetra­hedron is common to a positionally different [PO4] tetra­hedron; thus, each [AlO4] tetra­hedron is surrounded by four positionally different [PO4] tetra­hedra. On the other hand, each [PO4] tetra­hedron shares its two O atoms with two positionally different [AlO4] tetra­hedra; the other two phosphate O atoms are terminal ones coordinated by K atoms. The terminal O atoms are usually closer to the K atoms than the bridging O atoms between the [AlO4] and [PO4] tetra­hedra. There are nine symmetry-independent K atoms in the structure. The coordination numbers of the K atoms are 6 or 7 or 8 up to a distance of 3.31 Å. There are channels in the anionic substructure oriented along the [10] direction that are filled by K atoms

PgtE Enzyme of Salmonella enterica Shares the Similar Biological Roles to Plasminogen Activator (Pla) in Interacting With DEC-205 (CD205), and Enhancing Host Dissemination and Infectivity by Yersinia pestis

Yersinia pestis, the cause of plague, is a newly evolved Gram-negative bacterium. Through the acquisition of the plasminogen activator (Pla), Y. pestis gained the means to rapidly disseminate throughout its mammalian hosts. It was suggested that Y. pestis utilizes Pla to interact with the DEC-205 (CD205) receptor on antigen-presenting cells (APCs) to initiate host dissemination and infection. However, the evolutionary origin of Pla has not been fully elucidated. The PgtE enzyme of Salmonella enterica, involved in host dissemination, shows sequence similarity with the Y. pestis Pla. In this study, we demonstrated that both Escherichia coli K-12 and Y. pestis bacteria expressing the PgtE-protein were able to interact with primary alveolar macrophages and DEC-205-transfected CHO cells. The interaction between PgtE-expressing bacteria and DEC-205-expressing transfectants could be inhibited by the application of an anti-DEC-205 antibody. Moreover, PgtE-expressing Y. pestis partially re-gained the ability to promote host dissemination and infection. In conclusion, the DEC-205-PgtE interaction plays a role in promoting the dissemination and infection of Y. pestis, suggesting that Pla and the PgtE of S. enterica might share a common evolutionary origin.Peer reviewe

WEBSITE CONSTRUCTION FOR SMALL COSMETICS ENTERPRISES

The aim of this thesis is about to creating a dynamic website for a virtual cosmetic company called “Purus”. Although Purus is a virtual company, but it represents most of small business in the world. The website should enable the company to get their business in the right way. The thesis focused on two things: the first part is to collect the research about creating the website: for example, the tools and technologies, the process of building, the type of the website and the background information about the market. The second part is about creating the website. This is also divided into two parts: the front end development and back end development. The front end is the website interface development which gives the user a visible interface. And the back end development allows the users to communicate with the server through the browser. As a result of the thesis, the website is an example of small business website. But it could be an example of small business on how to create the website step by step