Reinforcement Learning

Brains rule the world, and brain-like computation is increasingly used in computers and electronic devices. Brain-like computation is about processing and interpreting data or directly putting forward and performing actions. Learning is a very important aspect. This book is on reinforcement learning which involves performing actions to achieve a goal. The first 11 chapters of this book describe and extend the scope of reinforcement learning. The remaining 11 chapters show that there is already wide usage in numerous fields. Reinforcement learning can tackle control tasks that are too complex for traditional, hand-designed, non-learning controllers. As learning computers can deal with technical complexities, the tasks of human operators remain to specify goals on increasingly higher levels. This book shows that reinforcement learning is a very dynamic area in terms of theory and applications and it shall stimulate and encourage new research in this field

Modelling and design of the eco-system of causality for real-time systems

This thesis was submitted for the award of Doctor of Philosophy and was awarded by Brunel University London.The purpose of this research work is to propose an improved method for real-time sensitivity analysis (SA) applicable to large-scale complex systems. Borrowed from the EventTracker principle of the interrelation of causal events, it deploys the Rank Order Clustering (ROC) method to automatically group every relevant system input to parameters that represent the system state (i.e. output). The fundamental principle of event modelling is that the state of a given system is a function of every acquirable piece of knowledge or data (input) of events that occur within the system and its wider operational environment unless proven otherwise. It therefore strives to build the theoretical and practical foundation for the engineering of input data. The event modelling platform proposed attempts to filter unwanted data, and more importantly, include information that was thought to be irrelevant at the outset of the design process. The underpinning logic of the proposed Event Clustering technique (EventiC) is to build causal relationship between the events that trigger the inputs and outputs of the system. EventiC groups inputs with relevant corresponding outputs and measures the impact of each input variable on the output variables in short spans of time (relative real-time). It is believed that this grouping of relevant input-output event data by order of its importance in real-time is the key contribution to knowledge in this subject area. Our motivation is that components of current complex and organised systems are capable of generating and sharing information within their network of interrelated devices and systems. In addition to being an intelligent recorder of events, EventiC could also be a platform for preliminary data and knowledge construction. This improvement in the quality, and at times the quantity of input data, may lead to improved higher level mathematical formalism. It is hoped that better models will translate into superior controls and decision making. It is therefore believed that the projected outcome of this research work can be used to predict, stabilize (control), and optimize (operational research) the work of complex systems in the shortest possible time. For proof of concept, EventiC was designed using the MATLAB package and implemented using real-time data from the monitoring and control system of a typical cement manufacturing plant. The purpose for this deployment was to test and validate the concept, and to demonstrate whether the clusters of input data and their levels of importance against system performance indicators could be approved by industry experts. EventiC was used as an input variable selection tool for improving the existing fuzzy controller of the plant. Finally, EventiC was compared with its predecessor EventTracker using the same case study. The results revealed improvements in both computational efficiency and the quality of input variable selection

Green Technologies for Production Processes

This book focuses on original research works about Green Technologies for Production Processes, including discrete production processes and process production processes, from various aspects that tackle product, process, and system issues in production. The aim is to report the state-of-the-art on relevant research topics and highlight the barriers, challenges, and opportunities we are facing. This book includes 22 research papers and involves energy-saving and waste reduction in production processes, design and manufacturing of green products, low carbon manufacturing and remanufacturing, management and policy for sustainable production, technologies of mitigating CO2 emissions, and other green technologies

Enhancing Future Skills and Entrepreneurship

This open access book presents the proceedings of the 3rd Indo-German Conference on Sustainability in Engineering held at Birla Institute of Technology and Science, Pilani, India, on September 16–17, 2019. Intended to foster the synergies between research and education, the conference is one of the joint activities of the BITS Pilani and TU Braunschweig conducted under the auspices of Indo-German Center for Sustainable Manufacturing, established in 2009. The book is divided into three sections: engineering, education and entrepreneurship, covering a range of topics, such as renewable energy forecasting, design & simulation, Industry 4.0, and soft & intelligent sensors for energy efficiency. It also includes case studies on lean and green manufacturing, and life cycle analysis of ceramic products, as well as papers on teaching/learning methods based on the use of learning factories to improve students’problem-solving and personal skills. Moreover, the book discusses high-tech ideas to help the large number of unemployed engineering graduates looking for jobs become tech entrepreneurs. Given its broad scope, it will appeal to academics and industry professionals alike

Recent Development of Hybrid Renewable Energy Systems

Abstract: The use of renewable energies continues to increase. However, the energy obtained from renewable resources is variable over time. The amount of energy produced from the renewable energy sources (RES) over time depends on the meteorological conditions of the region chosen, the season, the relief, etc. So, variable power and nonguaranteed energy produced by renewable sources implies intermittence of the grid. The key lies in supply sources integrated to a hybrid system (HS)

Biomass for Energy Country Specific Show Case Studies

In many domestic and industrial processes, vast percentages of primary energy are produced by the combustion of fossil fuels. Apart from diminishing the source of fossil fuels and the increasing risk of higher costs and energy security, the impact on the environment is worsening continually. Renewables are becoming very popular, but are, at present, more expensive than fossil fuels, especially photovoltaics and hydropower. Biomass is one of the most established and common sources of fuel known to mankind, and has been in continuous use for domestic heating and cooking over the years, especially in poorer communities. The use of biomass to produce electricity is interesting and is gaining ground. There are several ways to produce electricity from biomass. Steam and gas turbine technology is well established but requires temperatures in excess of 250 °C to work effectively. The organic Rankine cycle (ORC), where low-boiling-point organic solutions can be used to tailor the appropriate solution, is particularly successful for relatively low temperature heat sources, such as waste heat from coal, gas and biomass burners. Other relatively recent technologies have become more visible, such as the Stirling engine and thermo-electric generators are particularly useful for small power production. However, the uptake of renewables in general, and biomass in particular, is still considered somewhat risky due to the lack of best practice examples to demonstrate how efficient the technology is today. Hence, the call for this Special Issue, focusing on country files, so that different nations’ experiences can be shared and best practices can be published, is warranted. This is realistic, as it seems that some nations have different attitudes to biomass, perhaps due to resource availability, or the technology needed to utilize biomass. Therefore, I suggest that we go forward with this theme, and encourage scientists and engineers who are researching in this field to present case studies related to different countries. I certainly have one case study for the UK to present

Assessing Atmospheric Pollution and Its Impacts on the Human Health

This reprint contains articles published in the Special Issue entitled "Assessing Atmospheric Pollution and Its Impacts on the Human Health" in the journal Atmosphere. The research focuses on the evaluation of atmospheric pollution by statistical methods on the one hand, and on the other hand, on the evaluation of the relationship between the level of pollution and the extent of its effect on the population's health, especially on pulmonary diseases

Gasification for Practical Applications

Although there were many books and papers that deal with gasification, there has been only a few practical book explaining the technology in actual application and the market situation in reality. Gasification is a key technology in converting coal, biomass, and wastes to useful high-value products. Until renewable energy can provide affordable energy hopefully by the year 2030, gasification can bridge the transition period by providing the clean liquid fuels, gas, and chemicals from the low grade feedstock. Gasification still needs many upgrades and technology breakthroughs. It remains in the niche market, not fully competitive in the major market of electricity generation, chemicals, and liquid fuels that are supplied from relatively cheap fossil fuels. The book provides the practical information for researchers and graduate students who want to review the current situation, to upgrade, and to bring in a new idea to the conventional gasification technologies