FILP-3D: Enhancing 3D Few-shot Class-incremental Learning with Pre-trained Vision-Language Models

Few-shot class-incremental learning (FSCIL) aims to mitigate the catastrophic forgetting issue when a model is incrementally trained on limited data. While the Contrastive Vision-Language Pre-Training (CLIP) model has been effective in addressing 2D few/zero-shot learning tasks, its direct application to 3D FSCIL faces limitations. These limitations arise from feature space misalignment and significant noise in real-world scanned 3D data. To address these challenges, we introduce two novel components: the Redundant Feature Eliminator (RFE) and the Spatial Noise Compensator (SNC). RFE aligns the feature spaces of input point clouds and their embeddings by performing a unique dimensionality reduction on the feature space of pre-trained models (PTMs), effectively eliminating redundant information without compromising semantic integrity. On the other hand, SNC is a graph-based 3D model designed to capture robust geometric information within point clouds, thereby augmenting the knowledge lost due to projection, particularly when processing real-world scanned data. Considering the imbalance in existing 3D datasets, we also propose new evaluation metrics that offer a more nuanced assessment of a 3D FSCIL model. Traditional accuracy metrics are proved to be biased; thus, our metrics focus on the model's proficiency in learning new classes while maintaining the balance between old and new classes. Experimental results on both established 3D FSCIL benchmarks and our dataset demonstrate that our approach significantly outperforms existing state-of-the-art methods

A Targeted Quantitative Proteomic Method Revealed a Substantial Reprogramming of Kinome during Melanoma Metastasis.

Kinases are involved in numerous critical cell signaling processes, and dysregulation in kinase signaling is implicated in many types of human cancers. In this study, we applied a parallel-reaction monitoring (PRM)-based targeted proteomic method to assess kinome reprogramming during melanoma metastasis in three pairs of matched primary/metastatic human melanoma cell lines. Around 300 kinases were detected in each pair of cell lines, and the results showed that Janus kinase 3 (JAK3) was with reduced expression in the metastatic lines of all three pairs of melanoma cells. Interrogation of The Cancer Genome Atlas (TCGA) data showed that reduced expression of JAK3 is correlated with poorer prognosis in melanoma patients. Additionally, metastatic human melanoma cells/tissues exhibited diminished levels of JAK3 mRNA relative to primary melanoma cells/tissues. Moreover, JAK3 suppresses the migration and invasion of cultured melanoma cells by modulating the activities of matrix metalloproteinases 2 and 9 (MMP-2 and MMP-9). In summary, our targeted kinome profiling method provided by far the most comprehensive dataset for kinome reprogramming associated with melanoma progression, which builds a solid foundation for examining the functions of other kinases in melanoma metastasis. Moreover, our results reveal a role of JAK3 as a potential suppressor for melanoma metastasis

U-shaped fusion convolutional transformer based workflow for fast optical coherence tomography angiography generation in lips

Oral disorders, including oral cancer, pose substantial diagnostic challenges due to late-stage diagnosis, invasive biopsy procedures, and the limitations of existing non-invasive imaging techniques. Optical coherence tomography angiography (OCTA) shows potential in delivering non-invasive, real-time, high-resolution vasculature images. However, the quality of OCTA images are often compromised due to motion artifacts and noise, necessitating more robust and reliable image reconstruction approaches. To address these issues, we propose a novel model, a U-shaped fusion convolutional transformer (UFCT), for the reconstruction of high-quality, low-noise OCTA images from two-repeated OCT scans. UFCT integrates the strengths of convolutional neural networks (CNNs) and transformers, proficiently capturing both local and global image features. According to the qualitative and quantitative analysis in normal and pathological conditions, the performance of the proposed pipeline outperforms that of the traditional OCTA generation methods when only two repeated B-scans are performed. We further provide a comparative study with various CNN and transformer models and conduct ablation studies to validate the effectiveness of our proposed strategies. Based on the results, the UFCT model holds the potential to significantly enhance clinical workflow in oral medicine by facilitating early detection, reducing the need for invasive procedures, and improving overall patient outcomes.</p

U-shaped fusion convolutional transformer based workflow for fast optical coherence tomography angiography generation in lips

Oral disorders, including oral cancer, pose substantial diagnostic challenges due to late-stage diagnosis, invasive biopsy procedures, and the limitations of existing non-invasive imaging techniques. Optical coherence tomography angiography (OCTA) shows potential in delivering non-invasive, real-time, high-resolution vasculature images. However, the quality of OCTA images are often compromised due to motion artifacts and noise, necessitating more robust and reliable image reconstruction approaches. To address these issues, we propose a novel model, a U-shaped fusion convolutional transformer (UFCT), for the reconstruction of high-quality, low-noise OCTA images from two-repeated OCT scans. UFCT integrates the strengths of convolutional neural networks (CNNs) and transformers, proficiently capturing both local and global image features. According to the qualitative and quantitative analysis in normal and pathological conditions, the performance of the proposed pipeline outperforms that of the traditional OCTA generation methods when only two repeated B-scans are performed. We further provide a comparative study with various CNN and transformer models and conduct ablation studies to validate the effectiveness of our proposed strategies. Based on the results, the UFCT model holds the potential to significantly enhance clinical workflow in oral medicine by facilitating early detection, reducing the need for invasive procedures, and improving overall patient outcomes.</p

MoEC: Mixture of Expert Clusters

Sparsely Mixture of Experts (MoE) has received great interest due to its promising scaling capability with affordable computational overhead. MoE converts dense layers into sparse experts, and utilizes a gated routing network to make experts conditionally activated. However, as the number of experts grows, MoE with outrageous parameters suffers from overfitting and sparse data allocation. Such problems are especially severe on tasks with limited data, thus hindering the progress for MoE models to improve performance by scaling up. In this work, we propose Mixture of Expert Clusters - a general approach to enable expert layers to learn more diverse and appropriate knowledge by imposing variance-based constraints on the routing stage. We further propose a cluster-level expert dropout strategy specifically designed for the expert cluster structure. Our experiments reveal that MoEC could improve performance on machine translation and natural language understanding tasks, and raise the performance upper bound for scaling up experts under limited data. We also verify that MoEC plays a positive role in mitigating overfitting and sparse data allocation

Collaborative Governance for Responsible Innovation in the Context of Sharing Economy:Studies on the Shared Bicycle Sector in China

The shared bicycle sector is a new type of rental business that combines the sharing economy with technology platforms. With its convenience, efficiency and low cost, the business has become popular in China. However, alongside the development of the shared bicycle industry, the increasing number of products, lack of governance, distrust between companies and users cause problems due to irresponsibility. This paper focuses on the governance of the shared bicycle sector, with the aim of achieving responsible innovation through a collaboration among stakeholders. Through case studies on two cities in China, the paper identifies government policies in the traditional context of hard-law regulation, and in the new context of multi-collaborative governance. The roles of government, industry and society are specified in the innovation ecosystem and are linked with the key dimensions of responsible innovation, anticipation, reflectiveness, inclusiveness and responsiveness. Based on the findings, a model is proposed, suggesting the new government roles of alliance facilitator and platform coordinator. Finally, our recommendations for the improvement of the shared bicycle sector are made and areas for future research are discussed