State-of-the-art on research and applications of machine learning in the building life cycle

Fueled by big data, powerful and affordable computing resources, and advanced algorithms, machine learning has been explored and applied to buildings research for the past decades and has demonstrated its potential to enhance building performance. This study systematically surveyed how machine learning has been applied at different stages of building life cycle. By conducting a literature search on the Web of Knowledge platform, we found 9579 papers in this field and selected 153 papers for an in-depth review. The number of published papers is increasing year by year, with a focus on building design, operation, and control. However, no study was found using machine learning in building commissioning. There are successful pilot studies on fault detection and diagnosis of HVAC equipment and systems, load prediction, energy baseline estimate, load shape clustering, occupancy prediction, and learning occupant behaviors and energy use patterns. None of the existing studies were adopted broadly by the building industry, due to common challenges including (1) lack of large scale labeled data to train and validate the model, (2) lack of model transferability, which limits a model trained with one data-rich building to be used in another building with limited data, (3) lack of strong justification of costs and benefits of deploying machine learning, and (4) the performance might not be reliable and robust for the stated goals, as the method might work for some buildings but could not be generalized to others. Findings from the study can inform future machine learning research to improve occupant comfort, energy efficiency, demand flexibility, and resilience of buildings, as well as to inspire young researchers in the field to explore multidisciplinary approaches that integrate building science, computing science, data science, and social science

Fuzzy logic control system to provide autonomous collision avoidance for Mars rover vehicle

NASA is currently involved with planning unmanned missions to Mars to investigate the terrain and process soil samples in advance of a manned mission. A key issue involved in unmanned surface exploration on Mars is that of supporting autonomous maneuvering since radio communication involves lengthy delays. It is anticipated that specific target locations will be designated for sample gathering. In maneuvering autonomously from a starting position to a target position, the rover will need to avoid a variety of obstacles such as boulders or troughs that may block the shortest path to the target. The physical integrity of the rover needs to be maintained while minimizing the time and distance required to attain the target position. Fuzzy logic lends itself well to building reliable control systems that function in the presence of uncertainty or ambiguity. The following major issues are discussed: (1) the nature of fuzzy logic control systems and software tools to implement them; (2) collision avoidance in the presence of fuzzy parameters; and (3) techniques for adaptation in fuzzy logic control systems

An expert fuzzy logic controller employing adaptive learning for servo systems

An expert fuzzy logic controller with adaptive learning is proposed as an intelligent controller for servo systems. A key component of this controller is an adaptive learning mechanism which is used to self-regulate the scaling factors and the control action based on the error between the desired value and the plant output. The inference engine of this controller is based on the principle of approximate reasoning and the learning strategy is based on reinforcement learning. A novel approach of model reference adaptive control is also proposed for servo systems. The comparison of the performance between the proposed controller and PID controllers is discussed. The simulation results show that the performance of the proposed controller is better than the conventional approach or previous research. The real-time application demonstrates that a faster response of a servo system can be achieved. Furthermore, the proposed controller is relatively insensitive to variations in the parameters of control systems

Neurofuzzy control to address stochastic variation in actuated-coordinated systems at closely-spaced intersections

This dissertation documents a method of addressing stochastic variation at closely-spaced signalized intersections using neurofuzzy control. Developed on the conventional actuated-coordinated control system, the neurofuzzy traffic signal control keeps the advantage of the conventional control system. Beyond this, the neurofuzzy signal control coordinates the coordinated phase with one of the non-coordinated phases with no reduction of the green band assigned to the coordination along the arterial, reduces variations of traffic signal times in the cycle caused by early return to green , hence, makes more sufficient utilization of green time at closely-spaced intersections. The neurofuzzy signal control system manages a non-coordinated movement in order to manage queue spillbacks and variations of signal timings.Specifically, the neurofuzzy controller establishes a secondary coordination between the upstream coordinated phase (through phase) and the downstream non-coordinated phase (left turn phase) based on real-time traffic demand. Under the fuzzy logic signal control, the traffic from the upstream intersection can arrive and join the queue at the downstream left turn lane and be served, and hence, less possibly be blocked on the downstream left turn lane. This secondary coordination favors left turn progression and, hence, reduces the queue spillbacks. The fuzzy logic method overcomes the natural disadvantage of currently widely used actuated-coordinated traffic signal control in that the fuzzy logic method could coordinate a coordinated movement with a non-coordinated movement. The experiment was conducted and evaluated using a simulation model created using the microscopic simulation program - VISSIM.The neurofuzzy control algorithm was coded with MATLAB which interacts with the traffic simulation model via VISSIM\u27s COM interface. The membership functions in the neurofuzzy signal control system were calibrated using reinforcement learning to further the performance. Comparisons were made between the trained neurofuzzy control, the untrained neurofuzzy control, and the conventional actuated-coordinated control under five different traffic volumes. The simulation results indicated that the trained neurofuzzy signal control outperformed the other two for each traffic case. Comparing to the conventional actuated-coordinated control, the trained neurofuzzy signal control reduced the average delay by 7% and the average number of stops by 6% under the original traffic volume; as traffic volume increasing to 120%, the reductions doubled

Adaptive nonlinear control using fuzzy logic and neural networks

The problem of adaptive nonlinear control, i.e. the control of nonlinear dynamic systems with unknown parameters, is considered. Current techniques usually assume that either the control system is linearizable or the type of nonlinearity is known. This results in poor control quality for many practical problems. Moreover, the control system design becomes too complex for a practicing engineer. The objective of this thesis is to provide a practical, systematic approach for solving the problem of identification and control of nonlinear systems with unknown parameters, when the explicit linear parametrization is either unknown or impossible. Fuzzy logic (FL) and neural networks (NNs) have proven to be the tools for universal approximation, and hence are considered. However, FL requires expert knowledge and there is a lack of systematic procedures to design NNs for control. A hybrid technique, called fuzzy logic adaptive network (FLAN), which combines the structure of an FL controller with the learning aspects of the NNs is developed. FLAN is designed such that it is capable of both structure learning and parameter learning. Gradient descent based technique is utilized for the parameter learning in FLAN, and it is tested through a variety of simulated experiments in identification and control of nonlinear systems. The results indicate the success of FLAN in terms of accuracy of estimation, speed of convergence, insensitivity against a range of initial learning rates, robustness against sudden changes in the input as well as noise in the training data. The performance of FLAN is also compared with the techniques based on FL and NNs, as well as several hybrid techniques

Fuzzy and tile coding approximation techniques for coevolution in reinforcement learning

PhDThis thesis investigates reinforcement learning algorithms suitable for learning in large state space problems and coevolution. In order to learn in large state spaces, the state space must be collapsed to a computationally feasible size and then generalised about. This thesis presents two new implementations of the classic temporal difference (TD) reinforcement learning algorithm Sarsa that utilise fuzzy logic principles for approximation, FQ Sarsa and Fuzzy Sarsa. The effectiveness of these two fuzzy reinforcement learning algorithms is investigated in the context of an agent marketplace. It presents a practical investigation into the design of fuzzy membership functions and tile coding schemas. A critical analysis of the fuzzy algorithms to a related technique in function approximation, a coarse coding approach called tile coding is given in the context of three different simulation environments; the mountain-car problem, a predator/prey gridworld and an agent marketplace. A further comparison between Fuzzy Sarsa and tile coding in the context of the nonstationary environments of the agent marketplace and predator/prey gridworld is presented. This thesis shows that the Fuzzy Sarsa algorithm achieves a significant reduction of state space over traditional Sarsa, without loss of the finer detail that the FQ Sarsa algorithm experiences. It also shows that Fuzzy Sarsa and gradient descent Sarsa(λ) with tile coding learn similar levels of distinction against a stationary strategy. Finally, this thesis demonstrates that Fuzzy Sarsa performs better in a competitive multiagent domain than the tile coding solution

Fundamental Uncertainty, Portfolio Choice, and Liquidity Preference Theory

One of Keynes' core issues in his liquidity preference theory is how fundamental uncertainty affects the propensity to hold money as a liquid asset. The paper critically assesses various formal representations of fundamental uncertainty and provides an argument for a more boundedly rational approach to portfolio choice between liquidity and risky assets. The choice is made on the basis of individual beliefs which are subject to mental representations of the underlying economic structure. Self-consciousness arises when the agent is aware of the fact that beliefs are dispersed among agents due to the absence of a "true" model. Responding to this fact by increasing liquidity preference is rationalized by the higher ex post performance of choice. Moreover, we analyze the case that the portfolio is partially financed by debt. It is explored how fundamental uncertainty affects the volume of the portfolio and hence money and credit demand as well as the probability of debt failures.liquidity preference, portfolio choice, self-confidence, self-consciousness, fundamental uncertainty, bounded rationality, Keynes, Knight