257 research outputs found

    Spatiotemporal Deep Learning ๋ชจ๋ธ์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•œ ๋„์‹œ ์ „์—ญ์˜ ๋Œ€๊ธฐ ์˜ค์—ผ ๋ณด๊ฐ„๊ณผ ์˜ˆ์ธก

    Get PDF
    ํ•™์œ„๋…ผ๋ฌธ (์„์‚ฌ)-- ์„œ์šธ๋Œ€ํ•™๊ต ๋Œ€ํ•™์› : ๊ณต๊ณผ๋Œ€ํ•™ ์ „๊ธฐยท์ •๋ณด๊ณตํ•™๋ถ€, 2019. 2. ์ฐจ์ƒ๊ท .๋Œ€๊ธฐ ์˜ค์—ผ์€ ๋Œ€๋„์‹œ์—์„œ ๊ฐ€์žฅ ํฐ ๋ฌธ์ œ ์ค‘ ํ•˜๋‚˜์ด๋‹ค. ๋งŽ์€ ๊ตญ๊ฐ€๋“ค์€ ์ฃผ์š” ๋„์‹œ ์ฃผ๋ณ€์— ๋Œ€๊ธฐ ์˜ค์—ผ ๋ชจ๋‹ˆํ„ฐ๋ง ์„ผํ„ฐ๋ฅผ ๊ฑด์„คํ•˜์—ฌ ๋Œ€๊ธฐ ์˜ค์—ผ ๋ฌผ์งˆ์„ ์ˆ˜์ง‘ํ•˜๊ณ  ํ•ด๋‹น ์ง€์—ญ์˜ ์‹œ๋ฏผ๋“ค์—๊ฒŒ ๋Œ€๊ธฐ ์˜ค์—ผ์„ ๊ฒฝ๊ณ ํ•œ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ๋„์‹œ์—์„œ์˜ ๋Œ€๊ธฐ ์˜ค์—ผ์€ ๊ท ์ผํ•˜์ง€ ์•Š์œผ๋ฉฐ ์‹œ๊ณต๊ฐ„ (spatiotemporal)์ ์ธ ๋ฌธ์ œ์ด๋‹ค. ๋Œ€๊ธฐ ์˜ค์—ผ์€ ์œ„์น˜ (๊ณต๊ฐ„์  ํŠน์„ฑ)๊ณผ ์‹œ๊ฐ (์‹œ๊ฐ„์  ํŠน์„ฑ)์— ๋”ฐ๋ผ ๋‹ฌ๋ผ์ง„๋‹ค. ๋”ฐ๋ผ์„œ, ๋„์‹œ ์ „์ฒด์˜ ๋Œ€๊ธฐ ์˜ค์—ผ ๋ณด๊ฐ„๊ณผ ์˜ˆ์ธก์€ ์‹œ๋ฏผ๋“ค์ด ์‹œ๊ฐ„๊ณผ ๊ณต๊ฐ„์— ๋Œ€ํ•ด ๋Œ€๊ธฐ์˜ ์งˆ์„ ํŒŒ์•…ํ•˜๊ณ , ๋‚˜์•„๊ฐ€ ๊ฑด๊ฐ•์— ๋Œ€ํ•œ ์œ„ํ˜‘์„ ์ œ๊ฑฐํ•˜๊ธฐ ์œ„ํ•œ ํ•„์š” ์กฐ๊ฑด์ด๋‹ค. ๋Œ€๊ธฐ ์˜ค์—ผ์€ ๋„์‹œ ์ „์—ญ์˜ ์—ฌ๋Ÿฌ ์‹œ๊ณต๊ฐ„์  ์š”์ธ์— ์˜ํ•ด ์˜ํ–ฅ์„ ๋ฐ›๋Š” ๊ฒƒ์œผ๋กœ ์•Œ๋ ค์ ธ ์žˆ๋‹ค. ๊ทธ ์ค‘, ๊ธฐ์ƒ์ด ๋Œ€๊ธฐ ์˜ค์—ผ์— ๊ฐ€์žฅ ํฐ ์˜ํ–ฅ์„ ์ฃผ๋Š” ๊ฒƒ์œผ๋กœ ์ธ์‹๋˜๊ณ  ์žˆ๋‹ค. ๊ทธ ์™ธ์—, ๊ตํ†ต๋Ÿ‰์€ ๋Œ€๊ธฐ ์˜ค์—ผ์˜ ์ฃผ์š” ์›์ธ์ธ ๋„๋กœ์˜ ์ฐจ๋Ÿ‰ ๋ฐ€๋„๋ฅผ ๋ฐ˜์˜ํ•œ๋‹ค. ํ‰๊ท  ์ฃผํ–‰ ์†๋„๋Š” ๋„์‹œ ๋Œ€๊ธฐ ์˜ค์—ผ์— ์˜ํ–ฅ์„ ์ค€๋‹ค๊ณ  ํŒ๋‹จ๋˜๋Š” ๊ตํ†ต ์ฒด์ฆ์„ ๋‚˜ํƒ€๋‚ธ๋‹ค. ๋งˆ์ง€๋ง‰์œผ๋กœ, ์™ธ๋ถ€ ๋Œ€๊ธฐ ์˜ค์—ผ์›์€ ๋„์‹œ ๋Œ€๊ธฐ ์˜ค์—ผ ๋ฌธ์ œ์˜ ๊ทผ์› ์ค‘ ํ•˜๋‚˜๋ผ๊ณ  ์ฃผ์žฅ๋œ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ์„œ์šธ์‹œ์˜ ๋Œ€๊ธฐ ์˜ค์—ผ ๋ฐ์ดํ„ฐ, ๊ธฐ์ƒ ๋ฐ์ดํ„ฐ, ๊ตํ†ต๋Ÿ‰, ํ‰๊ท  ์ฃผํ–‰ ์†๋„์™€ ๊ฐ™์€ ๋งŽ์€ ์‹œ๊ณต๊ฐ„์  ๋ฐ์ดํ„ฐ์™€ ์„œ์šธ์˜ ๋Œ€๊ธฐ ์˜ค์—ผ์— ์˜ํ–ฅ์„ ์ค€๋‹ค๊ณ  ์•Œ๋ ค์ง„ ์ค‘๊ตญ์˜ 3๊ฐœ ์ง€๋ฐฉ(๋ฒ ์ด์ง•, ์ƒํ•˜์ด, ์‚ฐ๋™)์˜ ๋Œ€๊ธฐ ์˜ค์—ผ ๋ฐ์ดํ„ฐ๋ฅผ ์ œ์‹œํ•˜์˜€๋‹ค. ๋Œ€๊ธฐ ์˜ค์—ผ์— ๋Œ€ํ•œ ์ตœ๊ทผ์˜ ์—ฐ๊ตฌ์—์„œ๋Š” ํŠน์ • ์œ„์น˜์™€ ์‹œ๊ฐ„์˜ ๋Œ€๊ธฐ ์˜ค์—ผ ์˜ˆ์ธก ๋ชจ๋ธ์„ ๊ตฌ์ถ•ํ•˜๋ ค๊ณ  ์‹œ๋„ํ•ด์™”๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ๋Œ€๋ถ€๋ถ„ ์—ฐ์†๋˜์ง€ ์•Š์€ ์œ„์น˜์—๋Œ€ํ•œ ๋Œ€๊ธฐ ์˜ค์—ผ์„ ์˜ˆ์ธกํ•˜๊ฑฐ๋‚˜ ์ง์ ‘ ๋งŒ๋“  ๊ณต๊ฐ„ ๋ฐ ์‹œ๊ฐ„์  ํŠน์„ฑ์„ ์‚ฌ์šฉํ•˜๋Š” ๋ฐ ์ค‘์ ์„ ๋‘์—ˆ๋‹ค. ์ตœ๊ทผ CNN (Convolutional Neural Network), RNN (Recurrent Neural Network) ๋ฐ LSTM (Long-Short Term Memory)๊ณผ ๊ฐ™์€ ๋”ฅ๋Ÿฌ๋‹ ๋ชจ๋ธ์ด ๊ณต๊ฐ„ ๋ฐ ์‹œ๊ฐ„ ๊ด€๋ จ ๋ฌธ์ œ์—์„œ ์šฐ์ˆ˜ํ•˜๋‹ค๊ณ  ์•Œ๋ ค์ ธ์žˆ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” CNN๊ณผ LSTM์„ ๊ฒฐํ•ฉํ•œ ConvLSTM (Convolutional Long-Short Term Memory) ๋ชจ๋ธ์„ ์ œ์•ˆํ•˜์˜€์œผ๋ฉฐ, ์ด๋ฅผ ํ†ตํ•ด ๋ฐ์ดํ„ฐ์˜ ๊ณต๊ฐ„ ๋ฐ ์‹œ๊ฐ„์  ํŠน์„ฑ์„ ํšจ์œจ์ ์œผ๋กœ ์ฒ˜๋ฆฌํ•˜๊ณ  ์ตœ๊ทผ์˜ ๋‹ค๋ฅธ ์—ฐ๊ตฌ ๊ฒฐ๊ณผ๋ณด๋‹ค ๋›ฐ์–ด๋‚œ ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ•˜์˜€๋‹ค.Air pollution is one of the most concerns of big cities. Many countries in the world have constructed air quality monitoring stations around major cities to collect air pollutants and make the warning to urban citizens about the air pollution around them. However, air pollution is not uniform in the city, but it is a spatiotemporal problem. It changes by locations (spatial feature) and by time (temporal feature). Consequently, citywide air pollution interpolation and prediction is a requirement of urban people to know the air quality through time and spaces to eliminate the health risks. Moreover, air pollution is affected by many spatiotemporal factors throughout the whole city. Among them, meteorology is recognized to be one the most significant effects to air pollution. Besides that, traffic volume reflects the density of vehicles on roads which is the primary cause of air pollution. Average driving speed indicates the traffic congestion which also reasonably influences air pollution over the city. Finally, external air pollution sources from outside areas are claimed to be the reason contributing to a city's air pollution problem. In this thesis, we present many spatiotemporal datasets collected over Seoul city, Korea such as air pollution data, meteorological data, traffic volume, average driving speed, and air pollution of 3 China areas like Beijing, Shanghai, Shandong, which are known to have the effect to Seoul's air pollution. Recent research in air pollution has tried to build models to predict air pollution by locations and in the future time. Nonetheless, they mostly focused on predicting air pollution in discrete locations or used hand-crafted spatial and temporal features. Recently, Deep learning models such as Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), and Long-Short Term Memory (LSTM) are known to be superior in spatial and temporal relating problems. In this thesis, we propose the usage of Convolutional Long-Short Term Memory (ConvLSTM) model, a combination of CNN and LSTM, which efficiently manipulates the spatial and temporal features of the data and outperforms other recent research.1 INTRODUCTION 1 1.1 Air pollution description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 Citywide Air pollution Interpolation and Prediction . . . . . . . . . . . . . . . . . . . . . . . 2 1.3 Spatiotemporal datasets introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.4 Thesis contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8 2 RELATED WORK 11 2.1 Spatiotemporal Air pollution interpolation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.2 Machine Learning/Neural Networks based Air pollution prediction models . . . .12 2.3 Spatiotemporal Deep Learning models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 3 Spatiotemporal Deep Learning Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 3.1 CNN and LSTM models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 3.2 ConvLSTM model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 3.3 Air Pollution Interpolation and Prediction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 4 EXPERIMENTS AND EVALUATIONS 29 4.1 Baselines description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 4.2 Experiments and Evaluations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 4.2.1 Air pollution Interpolation: experiments and evaluations . . . . . . . . . . . . . . . . . 34 4.2.2 Air pollution Forecasting: experiments and evaluations . . . . . . . . . . . . . . . . . . 41 5 CONCLUSIONS AND FUTURE WORK 45 5.1 Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45 5.2 Future work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46Maste

    The State-of-the-Art in Air Pollution Monitoring and Forecasting Systems using IoT, Big Data, and Machine Learning

    Full text link
    The quality of air is closely linked with the life quality of humans, plantations, and wildlife. It needs to be monitored and preserved continuously. Transportations, industries, construction sites, generators, fireworks, and waste burning have a major percentage in degrading the air quality. These sources are required to be used in a safe and controlled manner. Using traditional laboratory analysis or installing bulk and expensive models every few miles is no longer efficient. Smart devices are needed for collecting and analyzing air data. The quality of air depends on various factors, including location, traffic, and time. Recent researches are using machine learning algorithms, big data technologies, and the Internet of Things to propose a stable and efficient model for the stated purpose. This review paper focuses on studying and compiling recent research in this field and emphasizes the Data sources, Monitoring, and Forecasting models. The main objective of this paper is to provide the astuteness of the researches happening to improve the various aspects of air polluting models. Further, it casts light on the various research issues and challenges also.Comment: 30 pages, 11 figures, Wireless Personal Communications. Wireless Pers Commun (2023

    Urban PM2.5 concentration prediction via attention-based CNNโ€“LSTM.

    Get PDF
    Urban particulate matter forecasting is regarded as an essential issue for early warning and control management of air pollution, especially fine particulate matter (PM2.5). However, existing methods for PM2.5 concentration prediction neglect the effects of featured states at different times in the past on future PM2.5 concentration, and most fail to effectively simulate the temporal and spatial dependencies of PM2.5 concentration at the same time. With this consideration, we propose a deep learning-based method, AC-LSTM, which comprises a one-dimensional convolutional neural network (CNN), long short-term memory (LSTM) network, and attention-based network, for urban PM2.5 concentration prediction. Instead of only using air pollutant concentrations, we also add meteorological data and the PM2.5 concentrations of adjacent air quality monitoring stations as the input to our AC-LSTM. Hence, the spatiotemporal correlation and interdependence of multivariate air quality-related time-series data are learned by the CNN-LSTM network in AC-LSTM. The attention mechanism is applied to capture the importance degrees of the effects of featured states at different times in the past on future PM2.5 concentration. The attention-based layer can automatically weigh the past feature states to improve prediction accuracy. In addition, we predict the PM2.5 concentrations over the next 24 h by using air quality data in Taiyuan city, China, and compare it with six baseline methods. To compare the overall performance of each method, the mean absolute error (MAE), root-mean-square error (RMSE), and coecient of determination (R2) are applied to the experiments in this paper. The experimental results indicate that our method is capable of dealing with PM2.5 concentration prediction with the highest performance

    Joint Air Quality and Weather Prediction Based on Multi-Adversarial Spatiotemporal Networks

    Full text link
    Accurate and timely air quality and weather predictions are of great importance to urban governance and human livelihood. Though many efforts have been made for air quality or weather prediction, most of them simply employ one another as feature input, which ignores the inner-connection between two predictive tasks. On the one hand, the accurate prediction of one task can help improve another task's performance. On the other hand, geospatially distributed air quality and weather monitoring stations provide additional hints for city-wide spatiotemporal dependency modeling. Inspired by the above two insights, in this paper, we propose the Multi-adversarial spatiotemporal recurrent Graph Neural Networks (MasterGNN) for joint air quality and weather predictions. Specifically, we first propose a heterogeneous recurrent graph neural network to model the spatiotemporal autocorrelation among air quality and weather monitoring stations. Then, we develop a multi-adversarial graph learning framework to against observation noise propagation introduced by spatiotemporal modeling. Moreover, we present an adaptive training strategy by formulating multi-adversarial learning as a multi-task learning problem. Finally, extensive experiments on two real-world datasets show that MasterGNN achieves the best performance compared with seven baselines on both air quality and weather prediction tasks.Comment: 9 pages, 6 figure
    • โ€ฆ
    corecore