Novice-Friendly Text-based Video Search with vitrivr

Video retrieval still offers many challenges which can so far only be effectively mediated through interactive, human-in-the-loop retrieval approaches. The vitrivr multimedia retrieval stack offers a broad range of query mechanisms to enable users to perform such interactive retrieval. While these multiple mechanisms offer various options to experienced users, they can be difficult to use for novices. In this paper, we present a minimal user interface geared towards novice users that only exposes a subset of vitrivr’s functionality but simplifies user interaction

Travel Recommendation via Author Topic Model Based Collaborative Filtering

Ministry of Education, Singapore under its Academic Research Funding Tier

Multidimensional context awareness in mobile devices

Ministry of Education, Singapore under its Academic Research Funding Tier

Automated curation of brand-related social media images with deep learning

This paper presents a work consisting in using deep convolutional neural networks (CNNs) to facilitate the curation of brand-related social media images. The final goal is to facilitate searching and discovering user-generated content (UGC) with potential value for digital marketing tasks. The images are captured in real time and automatically annotated with multiple CNNs. Some of the CNNs perform generic object recognition tasks while others perform what we call visual brand identity recognition. When appropriate, we also apply object detection, usually to discover images containing logos. We report experiments with 5 real brands in which more than 1 million real images were analyzed. In order to speed-up the training of custom CNNs we applied a transfer learning strategy. We examine the impact of different configurations and derive conclusions aiming to pave the way towards systematic and optimized methodologies for automatic UGC curation.Peer ReviewedPostprint (author's final draft

A Closer Look into Recent Video-based Learning Research: A Comprehensive Review of Video Characteristics, Tools, Technologies, and Learning Effectiveness

People increasingly use videos on the Web as a source for learning. To support this way of learning, researchers and developers are continuously developing tools, proposing guidelines, analyzing data, and conducting experiments. However, it is still not clear what characteristics a video should have to be an effective learning medium. In this paper, we present a comprehensive review of 257 articles on video-based learning for the period from 2016 to 2021. One of the aims of the review is to identify the video characteristics that have been explored by previous work. Based on our analysis, we suggest a taxonomy which organizes the video characteristics and contextual aspects into eight categories: (1) audio features, (2) visual features, (3) textual features, (4) instructor behavior, (5) learners activities, (6) interactive features (quizzes, etc.), (7) production style, and (8) instructional design. Also, we identify four representative research directions: (1) proposals of tools to support video-based learning, (2) studies with controlled experiments, (3) data analysis studies, and (4) proposals of design guidelines for learning videos. We find that the most explored characteristics are textual features followed by visual features, learner activities, and interactive features. Text of transcripts, video frames, and images (figures and illustrations) are most frequently used by tools that support learning through videos. The learner activity is heavily explored through log files in data analysis studies, and interactive features have been frequently scrutinized in controlled experiments. We complement our review by contrasting research findings that investigate the impact of video characteristics on the learning effectiveness, report on tasks and technologies used to develop tools that support learning, and summarize trends of design guidelines to produce learning video

UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletons

The automatic co-speech gesture generation draws much attention in computer animation. Previous works designed network structures on individual datasets, which resulted in a lack of data volume and generalizability across different motion capture standards. In addition, it is a challenging task due to the weak correlation between speech and gestures. To address these problems, we present UnifiedGesture, a novel diffusion model-based speech-driven gesture synthesis approach, trained on multiple gesture datasets with different skeletons. Specifically, we first present a retargeting network to learn latent homeomorphic graphs for different motion capture standards, unifying the representations of various gestures while extending the dataset. We then capture the correlation between speech and gestures based on a diffusion model architecture using cross-local attention and self-attention to generate better speech-matched and realistic gestures. To further align speech and gesture and increase diversity, we incorporate reinforcement learning on the discrete gesture units with a learned reward function. Extensive experiments show that UnifiedGesture outperforms recent approaches on speech-driven gesture generation in terms of CCA, FGD, and human-likeness. All code, pre-trained models, databases, and demos are available to the public at https://github.com/YoungSeng/UnifiedGesture.Comment: 16 pages, 11 figures, ACM MM 202

Measuring knowledge sharing processes through social network analysis within construction organisations

The construction industry is a knowledge intensive and information dependent industry. Organisations risk losing valuable knowledge, when the employees leave them. Therefore, construction organisations need to nurture opportunities to disseminate knowledge through strengthening knowledge-sharing networks. This study aimed at evaluating the formal and informal knowledge sharing methods in social networks within Australian construction organisations and identifying how knowledge sharing could be improved. Data were collected from two estimating teams in two case studies. The collected data through semi-structured interviews were analysed using UCINET, a Social Network Analysis (SNA) tool, and SNA measures. The findings revealed that one case study consisted of influencers, while the other demonstrated an optimal knowledge sharing structure in both formal and informal knowledge sharing methods. Social networks could vary based on the organisation as well as the individuals’ behaviour. Identifying networks with specific issues and taking steps to strengthen networks will enable to achieve optimum knowledge sharing processes. This research offers knowledge sharing good practices for construction organisations to optimise their knowledge sharing processes

The 45th Australasian Universities Building Education Association Conference: Global Challenges in a Disrupted World: Smart, Sustainable and Resilient Approaches in the Built Environment, Conference Proceedings, 23 - 25 November 2022, Western Sydney University, Kingswood Campus, Sydney, Australia

This is the proceedings of the 45th Australasian Universities Building Education Association (AUBEA) conference which will be hosted by Western Sydney University in November 2022. The conference is organised by the School of Engineering, Design, and Built Environment in collaboration with the Centre for Smart Modern Construction, Western Sydney University. This year’s conference theme is “Global Challenges in a Disrupted World: Smart, Sustainable and Resilient Approaches in the Built Environment”, and expects to publish over a hundred double-blind peer review papers under the proceedings

Advancing Dietetic Practice through the Implementation and Integration of Smartphone Apps

As the burden of obesity and its related chronic diseases grows, dietitians have integral roles in providing individualised medical nutrition therapy. Smartphone mobile health (mHealth) applications (apps) have potential to support and extend reach of dietetic services. This thesis examines how mHealth apps could be implemented and integrated by dietitians to advance nutrition care. Based on a narrative review of current evidence, the novel mobile Nutrition Care Process grid was developed, providing dietitians with best-practice guidance for using mHealth apps across the nutrition care process. Surveying dietitians internationally revealed that 62% used mHealth apps in their practice, although primarily as an information resource and for patient self-monitoring rather than as an integral part of the nutrition care process. Similarly, the public used commercial health and fitness apps, such as MyFitnessPal, to track health behaviours. However, individuals performed suboptimally when using MyFitnessPal to track dietary intake, with the app underestimating mean energy intake by -1863kJ (SD=2952kJ, P=0.0002) compared to 24-hour recalls. Qualitative feedback from dietitians, the public and patients are presented to guide app developers in designing quality mHealth apps. A behavioural analysis was conducted using the COM-B model and intervention recommendations were formulated to facilitate uptake of mHealth apps into dietetic practice. These recommendations were incorporated into a two-phase intervention comprising of an educational and training workshop and a 12-week phase where dietitians used an integrated commercial app platform with their patients. The intervention was found to be feasible to deliver and improved dietitians’ mHealth app self-efficacy. There is translational potential for this intervention to equip the profession with greater capability, opportunity, motivation and self-efficacy to use mHealth apps in dietetic practice and in patient nutrition care

Moving Towards Sustainable Coastal Development in South Asia By Linking Coastal Climate Change Adaptation With Integrated Coastal Zone Management Through the Instrumentality of Law

For long, coastal management focused on the sustainable utilization of coastal resources and avoidance and management of conflict, as well as the promotion of complementarities between users. However, with rising sea levels and other climate change impacts, coastal management has become increasingly complex. This thesis investigates the legal instruments underpinning the management of coastal zones, exploring the concept of sustainable coastal development (SCD) and the relevance of the integrated coastal zone management (ICZM) process. Specifically, the discourse analyzes how law and legal regimes play a backbone role in strengthening and supporting ICZM implementation by facilitating the linkage between ICZM and coastal climate change adaptation (CCCA) to contribute to SCD. Countless reports and studies testify that several of the world’s coastal regions have already and will continue to be detrimentally impacted by sea level rise (SLR) and climate change. One of the major theaters where these impacts will be most acute is South Asia, where vast populations are crowded into low-lying coastal areas. Most of the residents in these zones are economically constrained and have poor adaptive capacities, leaving them particularly vulnerable to climate change and SLR. Accordingly, operationalizing ICZM and linking it with CCCA is vital to these coastal communities, as is enacting and reengineering their coastal laws to affect the linkage. However, given the magnitude of the problem and the inability of most of the South Asian coastal countries to be able to respond singularly to the challenges there is an urgent need for greater regional co-operation. Drawing on the experiences of other coastal countries and regions, certain core principles that can inform coastal law-making for South Asia are identified. The idea is that these principles when set in a regional level instrument (in the instant case, the South Asian Seas Action Plan), will not only go a long way to strengthen regional cooperation, but also, and more importantly, will help coastal countries develop their respective coastal laws by effectuating the linkage between ICZM and CCCA implementation. This reform agenda has significant potential to facilitate the move towards SCD