SCA-PVNet: Self-and-Cross Attention Based Aggregation of Point Cloud and Multi-View for 3D Object Retrieval

To address 3D object retrieval, substantial efforts have been made to generate highly discriminative descriptors of 3D objects represented by a single modality, e.g., voxels, point clouds or multi-view images. It is promising to leverage the complementary information from multi-modality representations of 3D objects to further improve retrieval performance. However, multi-modality 3D object retrieval is rarely developed and analyzed on large-scale datasets. In this paper, we propose self-and-cross attention based aggregation of point cloud and multi-view images (SCA-PVNet) for 3D object retrieval. With deep features extracted from point clouds and multi-view images, we design two types of feature aggregation modules, namely the In-Modality Aggregation Module (IMAM) and the Cross-Modality Aggregation Module (CMAM), for effective feature fusion. IMAM leverages a self-attention mechanism to aggregate multi-view features while CMAM exploits a cross-attention mechanism to interact point cloud features with multi-view features. The final descriptor of a 3D object for object retrieval can be obtained via concatenating the aggregated features from both modules. Extensive experiments and analysis are conducted on three datasets, ranging from small to large scale, to show the superiority of the proposed SCA-PVNet over the state-of-the-art methods

Keyword-Aware Relative Spatio-Temporal Graph Networks for Video Question Answering

The main challenge in video question answering (VideoQA) is to capture and understand the complex spatial and temporal relations between objects based on given questions. Existing graph-based methods for VideoQA usually ignore keywords in questions and employ a simple graph to aggregate features without considering relative relations between objects, which may lead to inferior performance. In this paper, we propose a Keyword-aware Relative Spatio-Temporal (KRST) graph network for VideoQA. First, to make question features aware of keywords, we employ an attention mechanism to assign high weights to keywords during question encoding. The keyword-aware question features are then used to guide video graph construction. Second, because relations are relative, we integrate the relative relation modeling to better capture the spatio-temporal dynamics among object nodes. Moreover, we disentangle the spatio-temporal reasoning into an object-level spatial graph and a frame-level temporal graph, which reduces the impact of spatial and temporal relation reasoning on each other. Extensive experiments on the TGIF-QA, MSVD-QA and MSRVTT-QA datasets demonstrate the superiority of our KRST over multiple state-of-the-art methods.Comment: under revie

A Study on Differentiable Logic and LLMs for EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition 2023

In this technical report, we present our findings from a study conducted on the EPIC-KITCHENS-100 Unsupervised Domain Adaptation task for Action Recognition. Our research focuses on the innovative application of a differentiable logic loss in the training to leverage the co-occurrence relations between verb and noun, as well as the pre-trained Large Language Models (LLMs) to generate the logic rules for the adaptation to unseen action labels. Specifically, the model's predictions are treated as the truth assignment of a co-occurrence logic formula to compute the logic loss, which measures the consistency between the predictions and the logic constraints. By using the verb-noun co-occurrence matrix generated from the dataset, we observe a moderate improvement in model performance compared to our baseline framework. To further enhance the model's adaptability to novel action labels, we experiment with rules generated using GPT-3.5, which leads to a slight decrease in performance. These findings shed light on the potential and challenges of incorporating differentiable logic and LLMs for knowledge extraction in unsupervised domain adaptation for action recognition. Our final submission (entitled `NS-LLM') achieved the first place in terms of top-1 action recognition accuracy.Comment: Technical report submitted to CVPR 2023 EPIC-Kitchens challenge

Dynamical approach to heavy ion-induced fission

Deep inelastic collisions (DICs) can compete strongly with fusion in collisions of heavy nuclei. However, standard coupled-channels calculations do not take DIC processes into account. As a result, calculations have been shown to overestimate the fusion cross-sections, resulting in a discrepancy between experimental data and theoretical calculations, particularly at energies above the fusion barrier. To investigate this discrepancy, we conducted a series of experiments using the ANU 14UD tandem accelerator and the CUBE 2-body fission spectrometer to examine the competition between transfer/DIC and fusion. In particular, fusion-fission and 3-body fission yields have been extracted for 34S + 232Th and 40Ca + 232Th systems. This work shows that the transfer-fission probability is enhanced relative to fusion-fission for 40Ca + 232Th, when compared to 34S+ 232Th. It is suggested that the enhancement of this DIC process in 40Ca + 232Th is linked to an increase in the density overlap of the colliding nuclei as a function of the charge product and contributes to fusion hindrance

Three-dimensional heterostructure of metallic nanoparticles and carbon nanotubes as potential nanofiller

The effect of the dimensionality of metallic nanoparticle-and carbon nanotube-based fillers on the mechanical properties of an acrylonitrile butadiene styrene (ABS) polymer matrix was examined. ABS composite films, reinforced with low dimensional metallic nanoparticles (MNPs, 0-D) and carbon nanotubes (CNTs, 1-D) as nanofillers, were fabricated by a combination of wet phase inversion and hot pressing. The tensile strength and elongation of the ABS composite were increased by 39% and 6%, respectively, by adding a mixture of MNPs and CNTs with a total concentration of 2 wt%. However, the tensile strength and elongation of the ABS composite were found to be significantly increased by 62% and 55%, respectively, upon addition of 3-D heterostructures with a total concentration of 2 wt%. The 3-D heterostructures were composed of multiple CNTs grown radially on the surface of MNP cores, resembling a sea urchin. The mechanical properties of the ABS/3-D heterostructured nanofiller composite films were much improved compared to those of an ABS/mixture of 0-D and 1-D nanofillers composite films at various filler concentrations. This suggests that the 3-D heterostructure of the MNPs and CNTs plays a key role as a strong reinforcing agent in supporting the polymer matrix and simultaneously serves as a discrete force-transfer medium to transfer the loaded tension throughout the polymer matrix

E3 Ligase Activity of XIAP RING Domain Is Required for XIAP-Mediated Cancer Cell Migration, but Not for Its RhoGDI Binding Activity

Although an increased expression level of XIAP is associated with cancer cell metastasis, the underlying molecular mechanisms remain largely unexplored. To verify the specific structural basis of XIAP for regulation of cancer cell migration, we introduced different XIAP domains into XIAP−/− HCT116 cells, and found that reconstitutive expression of full length HA-XIAP and HA-XIAP ΔBIR, both of which have intact RING domain, restored β-Actin expression, actin polymerization and cancer cell motility. Whereas introduction of HA-XIAP ΔRING or H467A mutant, which abolished its E3 ligase function, did not show obvious restoration, demonstrating that E3 ligase activity of XIAP RING domain played a crucial role of XIAP in regulation of cancer cell motility. Moreover, RING domain rather than BIR domain was required for interaction with RhoGDI independent on its E3 ligase activity. To sum up, our present studies found that role of XIAP in regulating cellular motility was uncoupled from its caspase-inhibitory properties, but related to physical interaction between RhoGDI and its RING domain. Although E3 ligase activity of RING domain contributed to cell migration, it was not involved in RhoGDI binding nor its ubiquitinational modification

31st Annual Meeting and Associated Programs of the Society for Immunotherapy of Cancer (SITC 2016) : part two

Background The immunological escape of tumors represents one of the main ob- stacles to the treatment of malignancies. The blockade of PD-1 or CTLA-4 receptors represented a milestone in the history of immunotherapy. However, immune checkpoint inhibitors seem to be effective in specific cohorts of patients. It has been proposed that their efficacy relies on the presence of an immunological response. Thus, we hypothesized that disruption of the PD-L1/PD-1 axis would synergize with our oncolytic vaccine platform PeptiCRAd. Methods We used murine B16OVA in vivo tumor models and flow cytometry analysis to investigate the immunological background. Results First, we found that high-burden B16OVA tumors were refractory to combination immunotherapy. However, with a more aggressive schedule, tumors with a lower burden were more susceptible to the combination of PeptiCRAd and PD-L1 blockade. The therapy signifi- cantly increased the median survival of mice (Fig. 7). Interestingly, the reduced growth of contralaterally injected B16F10 cells sug- gested the presence of a long lasting immunological memory also against non-targeted antigens. Concerning the functional state of tumor infiltrating lymphocytes (TILs), we found that all the immune therapies would enhance the percentage of activated (PD-1pos TIM- 3neg) T lymphocytes and reduce the amount of exhausted (PD-1pos TIM-3pos) cells compared to placebo. As expected, we found that PeptiCRAd monotherapy could increase the number of antigen spe- cific CD8+ T cells compared to other treatments. However, only the combination with PD-L1 blockade could significantly increase the ra- tio between activated and exhausted pentamer positive cells (p= 0.0058), suggesting that by disrupting the PD-1/PD-L1 axis we could decrease the amount of dysfunctional antigen specific T cells. We ob- served that the anatomical location deeply influenced the state of CD4+ and CD8+ T lymphocytes. In fact, TIM-3 expression was in- creased by 2 fold on TILs compared to splenic and lymphoid T cells. In the CD8+ compartment, the expression of PD-1 on the surface seemed to be restricted to the tumor micro-environment, while CD4 + T cells had a high expression of PD-1 also in lymphoid organs. Interestingly, we found that the levels of PD-1 were significantly higher on CD8+ T cells than on CD4+ T cells into the tumor micro- environment (p < 0.0001). Conclusions In conclusion, we demonstrated that the efficacy of immune check- point inhibitors might be strongly enhanced by their combination with cancer vaccines. PeptiCRAd was able to increase the number of antigen-specific T cells and PD-L1 blockade prevented their exhaus- tion, resulting in long-lasting immunological memory and increased median survival