Visual Estimation of Fingertip Pressure on Diverse Surfaces using Easily Captured Data

People often use their hands to make contact with the world and apply pressure. Machine perception of this important human activity could be widely applied. Prior research has shown that deep models can estimate hand pressure based on a single RGB image. Yet, evaluations have been limited to controlled settings, since performance relies on training data with high-resolution pressure measurements that are difficult to obtain. We present a novel approach that enables diverse data to be captured with only an RGB camera and a cooperative participant. Our key insight is that people can be prompted to perform actions that correspond with categorical labels describing contact pressure (contact labels), and that the resulting weakly labeled data can be used to train models that perform well under varied conditions. We demonstrate the effectiveness of our approach by training on a novel dataset with 51 participants making fingertip contact with instrumented and uninstrumented objects. Our network, ContactLabelNet, dramatically outperforms prior work, performs well under diverse conditions, and matched or exceeded the performance of human annotators

Bread stories: understanding the drivers of bread consumption for digital food customisation

Consumer demand for food that satisfies specific needs rather than generic mass produced food is growing. In response, the food industry is actively investigating techniques for efficient and comprehensive food customisation. Digital approaches to food customisation are starting to emerge, however, the majority is currently limited to the ingredient level thus excluding consumption drivers such as people’s practices and values around food. Using the approach of cultural probes, we identified four distinct narratives around bread consumption: the healthy bread, the fresh bread, the ethical bread, and the exceptional bread. These themes encapsulate drivers of bread consumption, which we argue can inform the design of digital food innovation platforms

Building Blocks for IoT Analytics Internet-of-Things Analytics

Internet-of-Things (IoT) Analytics are an integral element of most IoT applications, as it provides the means to extract knowledge, drive actuation services and optimize decision making. IoT analytics will be a major contributor to IoT business value in the coming years, as it will enable organizations to process and fully leverage large amounts of IoT data, which are nowadays largely underutilized. The Building Blocks of IoT Analytics is devoted to the presentation the main technology building blocks that comprise advanced IoT analytics systems. It introduces IoT analytics as a special case of BigData analytics and accordingly presents leading edge technologies that can be deployed in order to successfully confront the main challenges of IoT analytics applications. Special emphasis is paid in the presentation of technologies for IoT streaming and semantic interoperability across diverse IoT streams. Furthermore, the role of cloud computing and BigData technologies in IoT analytics are presented, along with practical tools for implementing, deploying and operating non-trivial IoT applications. Along with the main building blocks of IoT analytics systems and applications, the book presents a series of practical applications, which illustrate the use of these technologies in the scope of pragmatic applications. Technical topics discussed in the book include: Cloud Computing and BigData for IoT analyticsSearching the Internet of ThingsDevelopment Tools for IoT Analytics ApplicationsIoT Analytics-as-a-ServiceSemantic Modelling and Reasoning for IoT AnalyticsIoT analytics for Smart BuildingsIoT analytics for Smart CitiesOperationalization of IoT analyticsEthical aspects of IoT analyticsThis book contains both research oriented and applied articles on IoT analytics, including several articles reflecting work undertaken in the scope of recent European Commission funded projects in the scope of the FP7 and H2020 programmes. These articles present results of these projects on IoT analytics platforms and applications. Even though several articles have been contributed by different authors, they are structured in a well thought order that facilitates the reader either to follow the evolution of the book or to focus on specific topics depending on his/her background and interest in IoT and IoT analytics technologies. The compilation of these articles in this edited volume has been largely motivated by the close collaboration of the co-authors in the scope of working groups and IoT events organized by the Internet-of-Things Research Cluster (IERC), which is currently a part of EU's Alliance for Internet of Things Innovation (AIOTI)

Building Blocks for IoT Analytics Internet-of-Things Analytics

Internet-of-Things (IoT) Analytics are an integral element of most IoT applications, as it provides the means to extract knowledge, drive actuation services and optimize decision making. IoT analytics will be a major contributor to IoT business value in the coming years, as it will enable organizations to process and fully leverage large amounts of IoT data, which are nowadays largely underutilized. The Building Blocks of IoT Analytics is devoted to the presentation the main technology building blocks that comprise advanced IoT analytics systems. It introduces IoT analytics as a special case of BigData analytics and accordingly presents leading edge technologies that can be deployed in order to successfully confront the main challenges of IoT analytics applications. Special emphasis is paid in the presentation of technologies for IoT streaming and semantic interoperability across diverse IoT streams. Furthermore, the role of cloud computing and BigData technologies in IoT analytics are presented, along with practical tools for implementing, deploying and operating non-trivial IoT applications. Along with the main building blocks of IoT analytics systems and applications, the book presents a series of practical applications, which illustrate the use of these technologies in the scope of pragmatic applications. Technical topics discussed in the book include: Cloud Computing and BigData for IoT analyticsSearching the Internet of ThingsDevelopment Tools for IoT Analytics ApplicationsIoT Analytics-as-a-ServiceSemantic Modelling and Reasoning for IoT AnalyticsIoT analytics for Smart BuildingsIoT analytics for Smart CitiesOperationalization of IoT analyticsEthical aspects of IoT analyticsThis book contains both research oriented and applied articles on IoT analytics, including several articles reflecting work undertaken in the scope of recent European Commission funded projects in the scope of the FP7 and H2020 programmes. These articles present results of these projects on IoT analytics platforms and applications. Even though several articles have been contributed by different authors, they are structured in a well thought order that facilitates the reader either to follow the evolution of the book or to focus on specific topics depending on his/her background and interest in IoT and IoT analytics technologies. The compilation of these articles in this edited volume has been largely motivated by the close collaboration of the co-authors in the scope of working groups and IoT events organized by the Internet-of-Things Research Cluster (IERC), which is currently a part of EU's Alliance for Internet of Things Innovation (AIOTI)

Modelling and optimisation of resource usage in an IoT enabled smart campus

University campuses are essentially a microcosm of a city. They comprise diverse facilities such as residences, sport centres, lecture theatres, parking spaces, and public transport stops. Universities are under constant pressure to improve efficiencies while offering a better experience to various stakeholders including students, staff, and visitors. Nonetheless, anecdotal evidence indicates that campus assets are not being utilized efficiently, often due to the lack of data collection and analysis, thereby limiting the ability to make informed decisions on the allocation and management of resources. Advances in the Internet of Things (IoT) technologies that can sense and communicate data from the physical world, coupled with data analytics and Artificial intelligence (AI) that can predict usage patterns, have opened up new opportunities for organizations to lower cost and improve user experience. This thesis explores this opportunity via theory and experimentation using UNSW Sydney as a living laboratory. The building blocks of this thesis consist of three pillars of execution, namely, IoT deployment, predictive modelling, and optimization. Together, these components create an end-to-end framework that provides informed decisions to estate manager in regards to the optimal allocation of campus resources. The main contributions of this thesis are three application domains, which lies on top of the execution pillars, defining campus resources as classrooms, car parks, and transit buses. Specifically, our contributions are: i) We evaluate several IoT occupancy sensing technologies and instrument 9 lecture halls of varying capacities with the most appropriate sensing solution. The collected data provides us with insights into attendance patterns, such as cancelled lectures and class tests, of over 250 courses. We then develop predictive models using machine learning algorithms and quantile regression technique to predict future attendance patterns. Finally, we propose an intelligent optimisation model that allows allocations of classes to rooms based on the dynamics of predicted attendance as opposed to static enrolment number. We show that the data-driven assignment of classroom resources can achieve a potential saving in room cost of over 10\% over the course of a semester, while incurring a very low risk of disrupting student experience due to classroom overflow; ii) We instrument a car park with IoT sensors for real-time monitoring of parking demand and comprehensively analyse the usage data spanning over 15 months. We then develop machine learning models to forecast future parking demand at multiple forecast horizons ranging from 1 day to 10 weeks, our models achieve a mean absolute error (MAE) of 4.58 cars per hour. Finally, we propose a novel optimal allocation framework that allows campus manager to re-dimension the car park to accommodate new paradigms of car use while minimizing the risk of rejecting users and maintaining a certain level of revenue from the parking infrastructure; iii) We develop sensing technology for measuring an outdoor orderly queue using ultrasonic sensor and LoRaWAN, and deploy the solution at an on campus bus stop. Our solution yields a reasonable accuracy with MAE of 10.7 people for detecting a queue length of up to 100 people. We then develop an optimisation model to reschedule bus dispatch times based on the actual dynamics of passenger demand. The result suggests that a potential wait time reduction of 42.93% can be achieved with demand-driven bus scheduling. Taken together, our contributions demonstrates that there are significant resource efficiency gains to be realised in a smart-campus that employs IoT sensing coupled with predictive modelling and dynamic optimisation algorithms

Modelling and optimisation of resource usage in an IoT enabled smart campus

University campuses are essentially a microcosm of a city. They comprise diverse facilities such as residences, sport centres, lecture theatres, parking spaces, and public transport stops. Universities are under constant pressure to improve efficiencies while offering a better experience to various stakeholders including students, staff, and visitors. Nonetheless, anecdotal evidence indicates that campus assets are not being utilized efficiently, often due to the lack of data collection and analysis, thereby limiting the ability to make informed decisions on the allocation and management of resources. Advances in the Internet of Things (IoT) technologies that can sense and communicate data from the physical world, coupled with data analytics and Artificial intelligence (AI) that can predict usage patterns, have opened up new opportunities for organizations to lower cost and improve user experience. This thesis explores this opportunity via theory and experimentation using UNSW Sydney as a living laboratory. The building blocks of this thesis consist of three pillars of execution, namely, IoT deployment, predictive modelling, and optimization. Together, these components create an end-to-end framework that provides informed decisions to estate manager in regards to the optimal allocation of campus resources. The main contributions of this thesis are three application domains, which lies on top of the execution pillars, defining campus resources as classrooms, car parks, and transit buses. Specifically, our contributions are: i) We evaluate several IoT occupancy sensing technologies and instrument 9 lecture halls of varying capacities with the most appropriate sensing solution. The collected data provides us with insights into attendance patterns, such as cancelled lectures and class tests, of over 250 courses. We then develop predictive models using machine learning algorithms and quantile regression technique to predict future attendance patterns. Finally, we propose an intelligent optimisation model that allows allocations of classes to rooms based on the dynamics of predicted attendance as opposed to static enrolment number. We show that the data-driven assignment of classroom resources can achieve a potential saving in room cost of over 10\% over the course of a semester, while incurring a very low risk of disrupting student experience due to classroom overflow; ii) We instrument a car park with IoT sensors for real-time monitoring of parking demand and comprehensively analyse the usage data spanning over 15 months. We then develop machine learning models to forecast future parking demand at multiple forecast horizons ranging from 1 day to 10 weeks, our models achieve a mean absolute error (MAE) of 4.58 cars per hour. Finally, we propose a novel optimal allocation framework that allows campus manager to re-dimension the car park to accommodate new paradigms of car use while minimizing the risk of rejecting users and maintaining a certain level of revenue from the parking infrastructure; iii) We develop sensing technology for measuring an outdoor orderly queue using ultrasonic sensor and LoRaWAN, and deploy the solution at an on campus bus stop. Our solution yields a reasonable accuracy with MAE of 10.7 people for detecting a queue length of up to 100 people. We then develop an optimisation model to reschedule bus dispatch times based on the actual dynamics of passenger demand. The result suggests that a potential wait time reduction of 42.93% can be achieved with demand-driven bus scheduling. Taken together, our contributions demonstrates that there are significant resource efficiency gains to be realised in a smart-campus that employs IoT sensing coupled with predictive modelling and dynamic optimisation algorithms