Configurable Low Power Analog Multilayer Perceptron

A configurable, low power analog implementation of a multilayer perceptron (MLP) is presented in this work. It features a highly programmable system that allows the user to create a MLP neural network design of their choosing. In addition to the configurability, this neural network provides the ability of low power operation via analog circuitry in its neurons. The main MLP system is made up of 12 neurons that can be configurable to any number of layers and neurons per layer until all available resources are utilized. The MLP network is fabricated in a standard 0.13 μm CMOS process occupying approximately 1 mm2 of on-chip area. The MLP system is analyzed at several different configurations with all achieving a greater than 1 Tera-operations per second per Watt figure of merit. This work offers a high speed, low power, and scalable alternative to digital configurable neural networks

DeepSecure: Scalable Provably-Secure Deep Learning

This paper proposes DeepSecure, a novel framework that enables scalable execution of the state-of-the-art Deep Learning (DL) models in a privacy-preserving setting. DeepSecure targets scenarios in which neither of the involved parties including the cloud servers that hold the DL model parameters or the delegating clients who own the data is willing to reveal their information. Our framework is the first to empower accurate and scalable DL analysis of data generated by distributed clients without sacrificing the security to maintain efficiency. The secure DL computation in DeepSecure is performed using Yao's Garbled Circuit (GC) protocol. We devise GC-optimized realization of various components used in DL. Our optimized implementation achieves more than 58-fold higher throughput per sample compared with the best-known prior solution. In addition to our optimized GC realization, we introduce a set of novel low-overhead pre-processing techniques which further reduce the GC overall runtime in the context of deep learning. Extensive evaluations of various DL applications demonstrate up to two orders-of-magnitude additional runtime improvement achieved as a result of our pre-processing methodology. This paper also provides mechanisms to securely delegate GC computations to a third party in constrained embedded settings

Prediction of surface treatment effects on the tribological performance of tool steels using artificial neural networks

The present paper discussed the development of a reliable and robust artificial neural network (ANN) capable of predicting the tribological performance of three highly alloyed tool steel grades. Experimental results were obtained by performing plane-contact sliding tests under non-lubrication conditions on a pin-on-disk tribometer. The specimens were tested both in untreated state with different hardening levels, and after surface treatment of nitrocarburizing. We concluded that wear maps via ANN modeling were a user-friendly approach for the presentation of wear-related information, since they easily permitted the determination of areas under steady-state wear that were appropriate for use. Furthermore, the achieved optimum ANN model seemed to be a simple and helpful design/educational tool, which could assist both in educational seminars, as well as in the interpretation of the surface treatment effects on the tribological performance of tool steels

Development of a virtual power plant based on a flexible biogas plant and a photovoltaic-system

The aim of this project is to develop an integrated power plant through Virtual Power Plant (VPP) in order to respond to load demands by considering a corresponding power market product. The results show that the deployment of Multi-Agent based System (MAS) and Smart Grid Architecture Model (SGAM) concepts support the idea of the integration of intermittent RES (Photovoltaic) and flexible power generators (biogas, battery) in a VPP. The developed VPP quickly reacts to changing requirements (legal, economic, technical) without harming the stability of the system.Das Hauptziel dieser Studie ist die Entwicklung einer integrierten Stromerzeugung durch virtuelles Kraftwerk (VK), um auf die Lastnachfrage zu reagieren bzw. Strommarktprodukte zu liefern. Die Ergebnisse zeigen, dass Multi-Agent basiertes System (MAS) und Smart Grid Architekturmodell (SGAM) die Integration intermittierender erneuerbarer Energien (Photovoltaik) und flexibler Kraftwerke (Biogas, Batterie) in ein VK ermöglichen. Das entwickelte VK kann schnell auf sich ändernde Anforderungen (rechtlich, wirtschaftlich, technisch) reagieren, ohne die Stabilität des Systems zu beeinträchtigen

Artificial neural networks model for air quality in the region of İzmir

Thesis (Master)--Izmir Institute of Technology, Environmental Engineering, Izmir, 2002Includes bibliographical references (leaves: 68-72)Text in English; Abstract: Turkish and Englishxiv, 88 leavesIn this study, a systematic approach to the development of the artificial neural networks based forecasting model is presented. S02, and dust values are predicted with different topologies, inputs and transfer functions. Temperature and wind speed values are used as input parameters for the models. The back-propagation learning algorithm is used to train the networks. R 2 (correlation coefficient), and daily average errors are employed to investigate the accuracy of the networks. MATLAB 6 neural network toolbox is used for this study. The study results indicate that the neural networks are able to make accurate predictions even with the limited number of parameters. Results also show that increasing the topology of the network and number of the inputs, increases the accuracy of the network. Best results for the S02 forecasting are obtained with the network with two hidden layers, hyperbolic tangent function as transfer function and three input variables (R2 was found as 0,94 and daily average error was found as 3,6 j..lg/m3).The most accurate results for the dust forecasting are also obtained with the network with two hidden layer, hyperbolic tangent function as transfer function and three input variables (R2 was found as 0,92 and daily average error was found as 3,64 j..lg/m3).S02 and dust predictions using their last seven days values as an input are also studied, and R2 is calculated as 0,94 and daily average error is calculated as 4,03 Jlg/m3 for S02 prediction and R2 is calculated as 0,93 and daily average error is calculated as 4,32 Jlg/m3 for dust prediction and these results show that the neural network can make accurate predictions

An artificial neural network model for rainfall forecasting in Bangkok, Thailand

This paper presents a new approach using an Artificial Neural Network technique to improve rainfall forecast performance. A real world case study was set up in Bangkok; 4 years of hourly data from 75 rain gauge stations in the area were used to develop the ANN model. The developed ANN model is being applied for real time rainfall forecasting and flood management in Bangkok, Thailand. Aimed at providing forecasts in a near real time schedule, different network types were tested with different kinds of input information. Preliminary tests showed that a generalized feedforward ANN model using hyperbolic tangent transfer function achieved the best generalization of rainfall. Especially, the use of a combination of meteorological parameters (relative humidity, air pressure, wet bulb temperature and cloudiness), the rainfall at the point of forecasting and rainfall at the surrounding stations, as an input data, advanced ANN model to apply with continuous data containing rainy and non-rainy period, allowed model to issue forecast at any moment. Additionally, forecasts by ANN model were compared to the convenient approach namely simple persistent method. Results show that ANN forecasts have superiority over the ones obtained by the persistent model. Rainfall forecasts for Bangkok from 1 to 3 h ahead were highly satisfactory. Sensitivity analysis indicated that the most important input parameter besides rainfall itself is the wet bulb temperature in forecasting rainfall

ELECTRICITY FORECASTING FOR SMALL SCALE POWER SYSTEM USING ARTIFICIAL NEURAL NETWORK

Short-term load forecast is an essential part of electric power system planning and operation. For this project, the main focus will be on the Gas District Cooling Plant (GDC) which acts as the primary source of energy for Universiti Teknologi PETRONAS (UTP). This project is looking into weekly forecast of the electricity production for the GDC plant using Artificial Neural Network Approach. This forecasting method will be very useful to support plant operation as the trending of load demand for an educational centre such as UTP is very much dependent on the university activities itself. The project involve MATLAB program for the STLF with Artificial Neural Network prediction model. The obtained results showed that introducing Multilayer Perceptron (MLP) Neural Network architecture improve the prediction significantly by obtaining a very small value of Mean Absolute Percent Error (MAPE). Besides that, by getting the smaller value of MAPE, it represents higher forecast accuracy of the model itself. The report consists of an introduction, problem statement, objectives, literature review and methodology used to solve the problem. It further looks into the obtained results with consistent discussion

A Novel Systolic Parallel Hardware Architecture for the FPGA Acceleration of Feedforward Neural Networks

New chips for machine learning applications appear, they are tuned for a specific topology, being efficient by using highly parallel designs at the cost of high power or large complex devices. However, the computational demands of deep neural networks require flexible and efficient hardware architectures able to fit different applications, neural network types, number of inputs, outputs, layers, and units in each layer, making the migration from software to hardware easy. This paper describes novel hardware implementing any feedforward neural network (FFNN): multilayer perceptron, autoencoder, and logistic regression. The architecture admits an arbitrary input and output number, units in layers, and a number of layers. The hardware combines matrix algebra concepts with serial-parallel computation. It is based on a systolic ring of neural processing elements (NPE), only requiring as many NPEs as neuron units in the largest layer, no matter the number of layers. The use of resources grows linearly with the number of NPEs. This versatile architecture serves as an accelerator in real-time applications and its size does not affect the system clock frequency. Unlike most approaches, a single activation function block (AFB) for the whole FFNN is required. Performance, resource usage, and accuracy for several network topologies and activation functions are evaluated. The architecture reaches 550 MHz clock speed in a Virtex7 FPGA. The proposed implementation uses 18-bit fixed point achieving similar classification performance to a floating point approach. A reduced weight bit size does not affect the accuracy, allowing more weights in the same memory. Different FFNN for Iris and MNIST datasets were evaluated and, for a real-time application of abnormal cardiac detection, a x256 acceleration was achieved. The proposed architecture can perform up to 1980 Giga operations per second (GOPS), implementing the multilayer FFNN of up to 3600 neurons per layer in a single chip. The architecture can be extended to bigger capacity devices or multi-chip by the simple NPE ring extension