Semantic-visual Guided Transformer for Few-shot Class-incremental Learning

Few-shot class-incremental learning (FSCIL) has recently attracted extensive attention in various areas. Existing FSCIL methods highly depend on the robustness of the feature backbone pre-trained on base classes. In recent years, different Transformer variants have obtained significant processes in the feature representation learning of massive fields. Nevertheless, the progress of the Transformer in FSCIL scenarios has not achieved the potential promised in other fields so far. In this paper, we develop a semantic-visual guided Transformer (SV-T) to enhance the feature extracting capacity of the pre-trained feature backbone on incremental classes. Specifically, we first utilize the visual (image) labels provided by the base classes to supervise the optimization of the Transformer. And then, a text encoder is introduced to automatically generate the corresponding semantic (text) labels for each image from the base classes. Finally, the constructed semantic labels are further applied to the Transformer for guiding its hyperparameters updating. Our SV-T can take full advantage of more supervision information from base classes and further enhance the training robustness of the feature backbone. More importantly, our SV-T is an independent method, which can directly apply to the existing FSCIL architectures for acquiring embeddings of various incremental classes. Extensive experiments on three benchmarks, two FSCIL architectures, and two Transformer variants show that our proposed SV-T obtains a significant improvement in comparison to the existing state-of-the-art FSCIL methods.Comment: Accepted by IEEE International Conference on Multimedia and Expo (ICME 2023

Miniaturized Head-Mount Doppler Optical Coherence Tomography Scope for Freely Moving Mouse.

This study presents a miniaturized head-mount optical coherence tomography (OCT) system tailored for high-resolution brain imaging in freely moving mice, providing an advanced noninvasive imaging tool in neuroscience research. Leveraging optical coherence tomography technology, the system enables depth-resolved imaging and integrates functional OCT extensions, including angiography and Doppler imaging. Remarkably lightweight at 1.5 g, the device allows for the preservation of natural mouse behavior during imaging sessions. With a maximum 4 × 4 mm field of view and 7.4 μm axial resolution, the system offers reliable imaging capabilities. Noteworthy features include focal adjustability, rotary joint integration for fiber-twist-free operation, and a high-speed swept-source OCT laser at 200 kHz, facilitating real-time imaging. By providing insights into brain mechanisms and neurological disorders without disrupting natural behavior, this innovative system holds promise as a powerful tool in neuroscience research. Its compact design and comprehensive imaging capabilities make it well-suited for studying various brain regions and dynamic processes, contributing significantly to our understanding of brain function and pathology

Matching Tabular Data to Knowledge Graph with Effective Core Column Set Discovery.

Matching tabular data to a knowledge graph (KG) is critical for understanding the semantic column types, column relationships, and entities of a table. Existing matching approaches rely heavily on core columns that represent primary subject entities on which other columns in the table depend. However, discovering these core columns before understanding the table’s semantics is challenging. Most prior works use heuristic rules, such as the leftmost column, to discover a single core column, while an insightful discovery of the core column set that accurately captures the dependencies between columns is often overlooked. To address these challenges, we introduce Dependency-aware Core Column Set Discovery (DaCo), an iterative method that uses a novel rough matching strategy to identify both inter-column dependencies and the core column set. Additionally, DaCo can be seamlessly integrated with pre-trained language models, as proposed in the optimization module. Unlike other methods, DaCo does not require labeled data or contextual information, making it suitable for real-world scenarios. In addition, it can identify multiple core columns within a table, which is common in real-world tables. We conduct experiments on six datasets, including five datasets with single core columns and one dataset with multiple core columns. Our experimental results show that DaCo outperforms existing core column set detection methods, further improving the effectiveness of table understanding tasks

SCULPTOR: Skeleton-Consistent Face Creation Using a Learned Parametric Generator

Recent years have seen growing interest in 3D human faces modelling due to its wide applications in digital human, character generation and animation. Existing approaches overwhelmingly emphasized on modeling the exterior shapes, textures and skin properties of faces, ignoring the inherent correlation between inner skeletal structures and appearance. In this paper, we present SCULPTOR, 3D face creations with Skeleton Consistency Using a Learned Parametric facial generaTOR, aiming to facilitate easy creation of both anatomically correct and visually convincing face models via a hybrid parametric-physical representation. At the core of SCULPTOR is LUCY, the first large-scale shape-skeleton face dataset in collaboration with plastic surgeons. Named after the fossils of one of the oldest known human ancestors, our LUCY dataset contains high-quality Computed Tomography (CT) scans of the complete human head before and after orthognathic surgeries, critical for evaluating surgery results. LUCY consists of 144 scans of 72 subjects (31 male and 41 female) where each subject has two CT scans taken pre- and post-orthognathic operations. Based on our LUCY dataset, we learn a novel skeleton consistent parametric facial generator, SCULPTOR, which can create the unique and nuanced facial features that help define a character and at the same time maintain physiological soundness. Our SCULPTOR jointly models the skull, face geometry and face appearance under a unified data-driven framework, by separating the depiction of a 3D face into shape blend shape, pose blend shape and facial expression blend shape. SCULPTOR preserves both anatomic correctness and visual realism in facial generation tasks compared with existing methods. Finally, we showcase the robustness and effectiveness of SCULPTOR in various fancy applications unseen before.Comment: 16 page, 13 fig

Galectin-9 as an indicator of functional limitations and radiographic joint damage in patients with rheumatoid arthritis

BackgroundPrevious studies have revealed that Galectin-9 (Gal-9) acts as an apoptosis modulator in autoimmunity and rheumatic inflammation. In the present study, we investigated the potential role of Gal-9 as a biomarker in patients with rheumatoid arthritis (RA), especially as an indicator of functional limitations and radiographic joint damage.MethodsA total of 146 patients with RA and 52 age- and sex-matched healthy controls were included in this study. Clinical data including disease activity, physical function, and radiographic joint damage were assessed. Functional limitation was defined as the Stanford Health Assessment Questionnaire (HAQ) disability index >1. Subjects with joint erosion >0 or joint space narrowing >0 were considered to have radiographic joint damage. Serum Gal-9 levels were detected by an enzyme-linked immunosorbent assay. Univariate and multivariate logistic regression analysis were used to evaluate the association between Gal-9 and high disease activity and functional limitations, and a prediction model was established to construct predictive nomograms.ResultsSerum levels of Gal-9 were significantly increased in patients with RA compared to those in healthy controls (median 13.1 ng/mL vs. 7.6 ng/mL). Patients with RA who were older (>65 years), had a longer disease duration (>5 years), longer morning stiffness (>60mins), elevated serum erythrocyte sedimentation rate and C-reactive protein, and difficult-to-treat RA had significantly higher Gal-9 levels than those in the corresponding control subgroups (all p <0.05). Patients with RA were divided into two subgroups according to the cut-off value of Gal-9 of 11.6 ng/mL. Patients with RA with Gal-9 >11.6 ng/mL had a significantly higher core clinical disease activity index, HAQ scores, Sharp/van der Heijde modified Sharp scores, as well as a higher percentage of advanced joint damage (all p<0.05) than patients with Gal-9 ≤11.6 ng/mL. Accordingly, patients with RA presenting either functional limitations or radiographic joint damage had significantly higher serum Gal-9 levels than those without (both p <0.05). Furthermore, multivariate logistic regression analysis showed that a serum level of Gal-9 >11.6 ng/mL was an independent risk factor for high disease activity (OR=3.138, 95% CI 1.150–8.567, p=0.026) and presence of functional limitations (OR=2.455, 95% CI 1.017–5.926, p=0.046), respectively.ConclusionGal-9 could be considered as a potential indicator in patients with RA, especially with respect to functional limitations and joint damage

Vaccination against coronavirus disease 2019 in patients with pulmonary hypertension: a national prospective cohort study

Background: Coronavirus disease 2019 (COVID-19) has potential risks for both clinically worsening pulmonary hypertension (PH) and increasing mortality. However, the data regarding the protective role of vaccination in this population are still lacking. This study aimed to assess the safety of approved vaccination for patients with PH. Methods: In this national prospective cohort study, patients diagnosed with PH (World Health Organization [WHO] groups 1 and 4) were enrolled from October 2021 to April 2022. The primary outcome was the composite of PH-related major adverse events. We used an inverse probability weighting (IPW) approach to control for possible confounding factors in the baseline characteristics of patients. Results: In total, 706 patients with PH participated in this study (mean age, 40.3 years; mean duration after diagnosis of PH, 8.2 years). All patients received standardized treatment for PH in accordance with guidelines for the diagnosis and treatment of PH in China. Among them, 278 patients did not receive vaccination, whereas 428 patients completed the vaccination series. None of the participants were infected with COVID-19 during our study period. Overall, 398 patients received inactivated severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) vaccine, whereas 30 received recombinant protein subunit vaccine. After adjusting for baseline covariates using the IPW approach, the odds of any adverse events due to PH in the vaccinated group did not statistically significantly increase (27/428 [6.3%] vs. 24/278 [8.6%], odds ratio = 0.72, P = 0.302). Approximately half of the vaccinated patients reported at least one post-vaccination side effects, most of which were mild, including pain at the injection site (159/428, 37.1%), fever (11/428, 2.6%), and fatigue (26/428, 6.1%). Conclusions: COVID-19 vaccination did not significantly augment the PH-related major adverse events for patients with WHO groups 1 and 4 PH, although there were some tolerable side effects. A large-scale randomized controlled trial is warranted to confirm this finding. The final approval of the COVID-19 vaccination for patients with PH as a public health strategy is promising

Methodology and experiences of rapid advice guideline development for children with COVID-19: responding to the COVID-19 outbreak quickly and efficiently

BACKGROUND: Rapid Advice Guidelines (RAG) provide decision makers with guidance to respond to public health emergencies by developing evidence-based recommendations in a short period of time with a scientific and standardized approach. However, the experience from the development process of a RAG has so far not been systematically summarized. Therefore, our working group will take the experience of the development of the RAG for children with COVID-19 as an example to systematically explore the methodology, advantages, and challenges in the development of the RAG. We shall propose suggestions and reflections for future research, in order to provide a more detailed reference for future development of RAGs. RESULT: The development of the RAG by a group of 67 researchers from 11 countries took 50 days from the official commencement of the work (January 28, 2020) to submission (March 17, 2020). A total of 21 meetings were held with a total duration of 48 h (average 2.3 h per meeting) and an average of 16.5 participants attending. Only two of the ten recommendations were fully supported by direct evidence for COVID-19, three recommendations were supported by indirect evidence only, and the proportion of COVID-19 studies among the body of evidence in the remaining five recommendations ranged between 10 and 83%. Six of the ten recommendations used COVID-19 preprints as evidence support, and up to 50% of the studies with direct evidence on COVID-19 were preprints. CONCLUSIONS: In order to respond to public health emergencies, the development of RAG also requires a clear and transparent formulation process, usually using a large amount of indirect and non-peer-reviewed evidence to support the formation of recommendations. Strict following of the WHO RAG handbook does not only enhance the transparency and clarity of the guideline, but also can speed up the guideline development process, thereby saving time and labor costs

Methodology and experiences of rapid advice guideline development for children with COVID-19: responding to the COVID-19 outbreak quickly and efficiently.

BACKGROUND Rapid Advice Guidelines (RAG) provide decision makers with guidance to respond to public health emergencies by developing evidence-based recommendations in a short period of time with a scientific and standardized approach. However, the experience from the development process of a RAG has so far not been systematically summarized. Therefore, our working group will take the experience of the development of the RAG for children with COVID-19 as an example to systematically explore the methodology, advantages, and challenges in the development of the RAG. We shall propose suggestions and reflections for future research, in order to provide a more detailed reference for future development of RAGs. RESULT The development of the RAG by a group of 67 researchers from 11 countries took 50 days from the official commencement of the work (January 28, 2020) to submission (March 17, 2020). A total of 21 meetings were held with a total duration of 48 h (average 2.3 h per meeting) and an average of 16.5 participants attending. Only two of the ten recommendations were fully supported by direct evidence for COVID-19, three recommendations were supported by indirect evidence only, and the proportion of COVID-19 studies among the body of evidence in the remaining five recommendations ranged between 10 and 83%. Six of the ten recommendations used COVID-19 preprints as evidence support, and up to 50% of the studies with direct evidence on COVID-19 were preprints. CONCLUSIONS In order to respond to public health emergencies, the development of RAG also requires a clear and transparent formulation process, usually using a large amount of indirect and non-peer-reviewed evidence to support the formation of recommendations. Strict following of the WHO RAG handbook does not only enhance the transparency and clarity of the guideline, but also can speed up the guideline development process, thereby saving time and labor costs