Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence

Incremental learning (IL) has received a lot of attention recently, however, the literature lacks a precise problem definition, proper evaluation settings, and metrics tailored specifically for the IL problem. One of the main objectives of this work is to fill these gaps so as to provide a common ground for better understanding of IL. The main challenge for an IL algorithm is to update the classifier whilst preserving existing knowledge. We observe that, in addition to forgetting, a known issue while preserving knowledge, IL also suffers from a problem we call intransigence, inability of a model to update its knowledge. We introduce two metrics to quantify forgetting and intransigence that allow us to understand, analyse, and gain better insights into the behaviour of IL algorithms. We present RWalk, a generalization of EWC++ (our efficient version of EWC [Kirkpatrick2016EWC]) and Path Integral [Zenke2017Continual] with a theoretically grounded KL-divergence based perspective. We provide a thorough analysis of various IL algorithms on MNIST and CIFAR-100 datasets. In these experiments, RWalk obtains superior results in terms of accuracy, and also provides a better trade-off between forgetting and intransigence

A large eddy simulation turbulence model for coastal seas and shallow water problems

2001-2002 > Academic research: refereed > Publication in refereed journalVersion of RecordPublishe

An experimental investigation on the two-phase flow structure of sand jets

2002-2003 > Academic research: refereed > Publication in refereed journalVersion of RecordPublishe

Unsupervised learning for cross-domain medical image synthesis using deformation invariant cycle consistency networks

Recently, the cycle-consistent generative adversarial networks (CycleGAN) has been widely used for synthesis of multi-domain medical images. The domain-specific nonlinear deformations captured by CycleGAN make the synthesized images difficult to be used for some applications, for example, generating pseudo-CT for PET-MR attenuation correction. This paper presents a deformation-invariant CycleGAN (DicycleGAN) method using deformable convolutional layers and new cycle-consistency losses. Its robustness dealing with data that suffer from domain-specific nonlinear deformations has been evaluated through comparison experiments performed on a multi-sequence brain MR dataset and a multi-modality abdominal dataset. Our method has displayed its ability to generate synthesized data that is aligned with the source while maintaining a proper quality of signal compared to CycleGAN-generated data. The proposed model also obtained comparable performance with CycleGAN when data from the source and target domains are alignable through simple affine transformations

Double-diffusive Marangoni convection in a rectangular cavity : onset of convection

2009-2010 > Academic research: refereed > Publication in refereed journalVersion of RecordPublishe

The development and validation of questionnaire to assess the collaboration and teamwork between doctors and nurses in public hospital in China

This study reports the development and psychometric properties of a Chinese in-strument to assess doctor-nurse teamwork and collaboration. 398 doctors and nurses participated in the study. Feedback from experts with international medical or nursing background and doctors and nurses working in hospitals in China informed the questionnaire refinement. Through validity and reliability test, a 26-item questionnaire was developed. Three were identified. The overall questionnaire as well as each factor had high construct validity. The internal consistency reliabil-ity and test-retest reliability are also satis-factory.published_or_final_versio

Teamwork and collaboration among doctors and nurses in two public hospitals in China

The Work-related Collaboration among Doctor-Nurse Scale (WCDNS) was ad-ministered to 398 doctors and nurses working in one of two hospitals in Guangzhou to assess 1) inter professional (doctor-nurse) differences in collaboration and teamwork and 2) inter hospital (general-specialist) differences in doctor nurse collaboration. Significant between profession and hospital differences were observed. Implications for future studies in doctor-nurse collaboration are discussed.published_or_final_versio

The Underestimation Of Egocentric Distance: Evidence From Frontal Matching Tasks

There is controversy over the existence, nature, and cause of error in egocentric distance judgments. One proposal is that the systematic biases often found in explicit judgments of egocentric distance along the ground may be related to recently observed biases in the perceived declination of gaze (Durgin & Li, Attention, Perception, & Psychophysics, in press), To measure perceived egocentric distance nonverbally, observers in a field were asked to position themselves so that their distance from one of two experimenters was equal to the frontal distance between the experimenters. Observers placed themselves too far away, consistent with egocentric distance underestimation. A similar experiment was conducted with vertical frontal extents. Both experiments were replicated in panoramic virtual reality. Perceived egocentric distance was quantitatively consistent with angular bias in perceived gaze declination (1.5 gain). Finally, an exocentric distance-matching task was contrasted with a variant of the egocentric matching task. The egocentric matching data approximate a constant compression of perceived egocentric distance with a power function exponent of nearly 1; exocentric matches had an exponent of about 0.67. The divergent pattern between egocentric and exocentric matches suggests that they depend on different visual cues

Optimum pHs for Cr(VI) co-removal with nucleated Cu(II) precipitation in continuous-flow fluidised metal strippers

A compact nucleated precipitation technology using two fluidised sand columns in series was developed to pretreat model metal-plating wastewater containing high concentrations of Cu(II) and Cr(VI). Since either Cu(II) precipitation or Cr(VI) co-removal with Cu(II) precipitation was found to be highly pH dependent in batch tests, the continuous-flow studies were conducted under different pHs. Experimental results show that high pH has no positive influence on either Cr(VI) or Cu(II) removal in the continuous-flow fluidised metal stripper technology. Operation at pH 6.5 in both columns can obtain significantly higher levels of both total Cr(VI) and total Cu(II) removal compared with work at pH 9.5 in both columns and work at pH 6.5 and 9.5 in the 1st and 2nd columns, respectivel