3D Human Activity Recognition with Reconfigurable Convolutional Neural Networks

Human activity understanding with 3D/depth sensors has received increasing attention in multimedia processing and interactions. This work targets on developing a novel deep model for automatic activity recognition from RGB-D videos. We represent each human activity as an ensemble of cubic-like video segments, and learn to discover the temporal structures for a category of activities, i.e. how the activities to be decomposed in terms of classification. Our model can be regarded as a structured deep architecture, as it extends the convolutional neural networks (CNNs) by incorporating structure alternatives. Specifically, we build the network consisting of 3D convolutions and max-pooling operators over the video segments, and introduce the latent variables in each convolutional layer manipulating the activation of neurons. Our model thus advances existing approaches in two aspects: (i) it acts directly on the raw inputs (grayscale-depth data) to conduct recognition instead of relying on hand-crafted features, and (ii) the model structure can be dynamically adjusted accounting for the temporal variations of human activities, i.e. the network configuration is allowed to be partially activated during inference. For model training, we propose an EM-type optimization method that iteratively (i) discovers the latent structure by determining the decomposed actions for each training example, and (ii) learns the network parameters by using the back-propagation algorithm. Our approach is validated in challenging scenarios, and outperforms state-of-the-art methods. A large human activity database of RGB-D videos is presented in addition.Comment: This manuscript has 10 pages with 9 figures, and a preliminary version was published in ACM MM'14 conferenc

Geoinformation, Geotechnology, and Geoplanning in the 1990s

Over the last decade, there have been some significant changes in the geographic information available to support those involved in spatial planning and policy-making in different contexts. Moreover, developments have occurred apace in the technology with which to handle geoinformation. This paper provides an overview of trends during the 1990s in data provision, in the technology required to manipulate and analyse spatial information, and in the domain of planning where applications of computer technology in the processing of geodata are prominent. It draws largely on experience in western Europe, and in the UK and the Netherlands in particular, and suggests that there are a number of pressures for a strengthened role for geotechnology in geoplanning in the years ahead

An Interactive Zoo Guide: A Case Study of Collaborative Learning

Real Industry Projects and team work can have a great impact on student learning but providing these activities requires significant commitment from academics. It requires several years planning implementing to create a collaborative learning environment that mimics the real world ICT (Information and Communication Technology) industry workplace. In this project, staff from all the three faculties, namely the Faculty of Health, Engineering and Science, Faculty of Arts, Education and Human Development, and Faculty of Business and Law in higher education work together to establish a detailed project management plan and to develop the unit guidelines for participating students. The proposed project brings together students from business, multimedia and computer science degrees studying their three project-based units within each faculty to work on a relatively large IT project with our industry partner, Melbourne Zoo. This paper presents one multimedia software project accomplished by one of the multi-discipline student project teams. The project was called 'Interactive ZooOz Guide' and developed on a GPS-enabled PDA device in 2007. The developed program allows its users to navigate through the Zoo via an interactive map and provides multimedia information of animals on hotspots at the 'Big Cats' section of the Zoo so that it enriches user experience at the Zoo. A recent development in zoo applications is also reviewed. This paper is also intended to encourage academia to break boundaries to enhance students' learning beyond classroom.Comment: 11 Page

Abnormality Detection in Mammography using Deep Convolutional Neural Networks

Breast cancer is the most common cancer in women worldwide. The most common screening technology is mammography. To reduce the cost and workload of radiologists, we propose a computer aided detection approach for classifying and localizing calcifications and masses in mammogram images. To improve on conventional approaches, we apply deep convolutional neural networks (CNN) for automatic feature learning and classifier building. In computer-aided mammography, deep CNN classifiers cannot be trained directly on full mammogram images because of the loss of image details from resizing at input layers. Instead, our classifiers are trained on labelled image patches and then adapted to work on full mammogram images for localizing the abnormalities. State-of-the-art deep convolutional neural networks are compared on their performance of classifying the abnormalities. Experimental results indicate that VGGNet receives the best overall accuracy at 92.53\% in classifications. For localizing abnormalities, ResNet is selected for computing class activation maps because it is ready to be deployed without structural change or further training. Our approach demonstrates that deep convolutional neural network classifiers have remarkable localization capabilities despite no supervision on the location of abnormalities is provided.Comment: 6 page