6 research outputs found
Around View Monitor(AVM) Based Visual SLAM For Autonomous Parking
ํ์๋
ผ๋ฌธ (์์ฌ) -- ์์ธ๋ํ๊ต ๋ํ์ : ์ตํฉ๊ณผํ๊ธฐ์ ๋ํ์ ์ง๋ฅ์ ๋ณด์ตํฉํ๊ณผ, 2021. 2. ๋ฐ์ฌํฅ.์์จ์ฃผ์ฐจ๋ ์ธ์, ๊ณํ, ์ ์ด๋ก ์ด๋ฃจ์ด์ ธ์๋ค.์์จ์ฃผ์ฐจ์ ์ธ์๊ณผ์ ๋์์ ์๋์ฐจ๋ ์์ ์ ์์น๋ฅผ ์์์ผํ๊ณ ์ฃผ๋ณํ๊ฒฝ์ ์ธ์งํ ์์์ด์ผํ๋ค. ์ด๋ฌํ ๊ณผ์ ์ ๋์์ ์์น์ถ์ ๋ฐ์ง๋์์ฑ(SLAM)์ด๋ผ๊ณ ํ๋ค. ๋ง์ SLAM์๊ณ ๋ฆฌ์ฆ๋ค์ ์ฃผ๋ณํ๊ฒฝ์
์ ํํ์ธ์์ ์ํด ์ ์๋์ด์๋ค. ํนํ ๊ฐ์ผ ์นด๋ฉ๋ผ๋ฅผ ์ฃผ๋์ผ์๋ก ์ฌ์ฉํ๋ Visual SLAM์ ์์จ์ฃผํ์๋์ฐจ๋ฅผ ์ํ ์ ๋งํ ์๊ณ ๋ฆฌ์ฆ์ผ๋ก ์ฌ๊ฒจ์ ธ์๋ค. ๋๋ถ๋ถ์ Visual SLAM์ ์ ๋ฐฉ์นด๋ฉ๋ผ๋ฅผ ์ฌ์ฉํ๋ค. ์ด๋ฌํ ์์คํ
ํํ์์, Visual SLAM์๋๋ถ๋ถ์ ํ๊ฒฝ์์ ์ ์๋ํ๋ค. ๊ทธ๋ฌ๋ ์ฃผ๋ณํ๊ฒฝ์ ํน์ง์ ์ด ์ ๊ณ , ๊ฐํ๋น์ด ์๋ํ๊ฒฝ์์๋ Visual SLAM์ ์ฑ๋ฅ์ด ํ๋ฝํ๋ค. ๋ง์์์ ์ฃผ์ฐจ์ฅ๋ค์ ์ผ์ธ์ ์์นํด์๊ณ , ์ฃผ์ฐจ์ ๊ณผ ๊ฐ์ ๋จ์กฐ๋ก์ด ํน์ง์ ๋ค๋ง์ ๊ฐ์ง๊ณ ์๋ค. ์ฃผ์ฐจ์ฅ์์์ ์ด๋ฌํ ๋ฌธ์ ๋ค์ ๋์ฒํ๊ณ Visual SLAM์ ์ฑ๋ฅ์ ๊ฐ์ ํ๊ธฐ ์ํด์ ์ด์ฐ๊ตฌ์์๋ Around View Monitor(AVM)์ ์ฃผ์์ผ์๋ก ํ๋ ์๋ก์ด Visual SLAM ์๊ณ ๋ฆฌ์ฆ์ ์ ์ํ๋ค. AVM ์์คํ
์์๋ Top View ์ด๋ฏธ์ง๊ฐ ์์ฑ๋๊ธฐ ๋๋ฌธ์ ํธ๋ฆฌ์๋ณํ์ AVM์ด๋ฏธ์ง๋ค๋ก๋ถํฐ ๋์์ ๋ณด๋ฅผ ์ถ์ถํ๊ธฐ ์ํด์ ์ฌ์ฉ๋๋ค. ๋์์ ๋ณด๋ฅผ ์ถ์ ํ๊ธฐ์ํด reprojection error๋๋photometric error๋ฑ์ ๋น์ฉํจ์๋ก์จ ์ฌ์ฉํ๋ ๊ธฐ์กด์ Visual SLAM๊ณผ๋ ๋ฌ๋ฆฌ ํธ๋ฆฌ์๋ณํ์ ์ด๋ ํ ํน์ง์ ๋งค์นญ์ด๋ ์ต์ ํ๊ณผ์ ์์ด,์ฐธ์กฐ๋๋ ์ด๋ฏธ์ง๋ก๋ถํฐ ๋์์ด๋๋ ์ด๋ฏธ์ง๋ก์ ๋์์ ๋ณด๋ฅผ ๊ฐ๋จํ ์ถ์ ํ ์์๋ค. ๋ํ ์๋์ฐจ์ ์์น๋ฅผ ์ ํํ๊ฒ ๊ทธ๋ฆฌ๊ณ ๊ฐ๊ฑดํ๊ฒ ์ถ์ ํ๊ธฐ์ํด์ landmark๋ฅผ ์ด์ฉํ ์์น์ถ์ ๋ฐฉ๋ฒ์ด ์ฌ์ฉ๋์๋ค.์ด ์ฐ๊ตฌ์์ landmark๋ผํจ์ ์ฃผ์ฐจ์ ๋ผ๋ฆฌ ๋ง๋๋ Cross point(๊ต์ฐจ์ )์ ๋งํ๋ค.์ด ์ฐ๊ตฌ์์ landmark๋ฅผ ์ด์ฉํ ์์น์ถ์ ์ ์ธ๊ฐ์ง๋จ๊ณ๋ก ๋๋๋ค.์ฒซ๋ฒ์งธ ๋จ๊ณ๋ ๊ต์ฐจ์ ์ ํ์ํ๋๊ฒ์ด๋ค.์ฃผ๋ก ์ด๋ฏธ์ง์์ ํน์ง์ ์ ์ฐพ๊ธฐ์ํด Image Segmentation๋ฐฉ๋ฒ์ ์ฌ์ฉํ๋ ๊ธฐ์กด์AVM๊ธฐ๋ฐ์ SLAM์ฐ๊ตฌ์๋ ๋ฌ๋ฆฌ ์ด ์ฐ๊ตฌ์์๋ Image Segmentation๋ณด๋ค ํ๋ จ์ด ๋์ฝ๊ณ ๊ฐ๋จํ Object Detection๋คํธ์ํฌ์ธYoloV3๋ฅผ ์ฌ์ฉํ์ฌ ๊ต์ฐจ์ ์ ํ์ํ์๋ค.๋๋ฒ์งธ ๋จ๊ณ๋ Data Association์ด๋ค. SLAM์์ Data Association์ ์ง๋์ ๋ฑ๋ก๋์ด ์๋ ํน์ง์ ๊ณผ ํ์ฌ ๊ด์ฐฐ๋ ํน์ง์ ์ ์๋ก ์ฐ๊ด์ํค๋ ์์
์ด๋ค. Deep SORT๊ฐ ํ์ฌ ๊ด์ดฌ๋ ํน์ง์ ์์ถ์ ํ๊ธฐ์ํด ์ฌ์ฉ๋์์ง๋ง, Deep SORT๋ฅผ ์ฌ์ฉํ ๋์๋ ์ถ์ ๋๋ ํน์ง์ ์ ID๊ฐ ๋น๊ต์ ์์ฃผ ๋ฐ๋๋ ํ์์ด ์ผ์ด๋์ ํธ๋ฆฌ์๋ณํ์ผ๋ก๋ถํฐ์ ๋์์ ๋ณด์ ํ์ฌ ๊ด์ฐฐ๋ ํน์ง์ ์ ๋ณด๋ฅผ ์ฌ์ฉํ์ฌ Nearest Neighbor๋ฐฉ๋ฒ์ ํตํด ์ถ๊ฐ์ ์ธ Data Association์ ๊ตฌํํ์๋ค. ํธ๋ฆฌ์๋ณํ์ผ๋ก๋ถํฐ์ ๋์์ ๋ณด๋ ๋น๊ต์ ์ ํํ๊ณ , ๊ต์ฐจ์ ์ฌ์ด์ ๊ฑฐ๋ฆฌ๋ ๋ฉ๊ธฐ๋๋ฌธ์Data Association์ ์ ํ๋๋ Deep SORT๋ง ์ฌ์ฉํ์๋๋ณด๋ค ์ ํํด์ก๋ค.์ดํ์ ๋ง์ง๋ง๋จ๊ณ์์๋ ์ผ์ ๊ฐ์์ด์์ data association์ด ์ด๋ฃจ์ด์ก์๋, Singular Value Decomposition์ ์ด์ฉํ์ฌ ์๋กญ๊ฒ ๋์์ ๋ณด๊ฐ ์ถ์ ๋๋ค. ๊ธฐ์กด์Visual SLAM๊ณผ ์ ์๋ SLAM์๊ณ ๋ฆฌ์ฆ์ ์ฑ๋ฅ์ ๋น๊ตํ๊ธฐ์ํด์ ์ฃผ์ฐจ์ฅ์์ ์คํ์์งํํ์๊ณ , LOAM์ด ์๊ณ ๋ฆฌ์ฆ์ ๋น๊ต๋ฅผ์ํ Groundtruth๋ก์ ์ฌ์ฉ๋์๋ค.Autonomous parking consists of perception, planning, control. During perception procedure in autonomous parking, vehicle should know its location and perceive surrounding environment. This is called Simultaeneous Localization And Mapping (SLAM). Many SLAM algorithms have been proposed for accurate perception of environment. Especially, Visual SLAM, which uses a cheap camera as a main sensor of SLAM algorithm, has been considered as promising algorithm for autonomous vehicle. Most of Visual SLAM use front camera setting. In this camera setting, Visual SLAM works well for most of environments. However, performance of the algorithm gets worse when environment has few features or strong sunlight condition. Most of parking lots are located outdoor and have monotonous features like parking lines, cars. To address these problems and improve accuracy of Visual SLAM for autonomous parking, this paper proposes new Visual SLAM algorithm, which uses Around View Monitor(AVM) as a main sensor. As top-view images are generated in AVM system, fourier transform is used to extract motion information from the AVM images. Compared to traditional visual motion tracking methods which use reprojection error or photometric error as a cost function to estimate motion, fourier transform can simply estimate motion from reference AVM image to target AVM image without any optimization or feature matching. Also, landmark based localization is used to estimate vehicle's motion more robustly and accurately. In this paper, landmark means cross points on parking lines. Landmark based localization in this paper consists of three procedure. First one is cross point detection. Cross points are detected using YoloV3. Compared to other AVM based SLAM methods, which use Image segmentation to detect features in parking lot, training procedure of the neural network is simpler and easier. Second one is data association. Data association means associating procedure among features in map and currently observed features in SLAM literature. Deep SORT is used to track features using currently observed cross points. As re-identification of tracked features frequently occurs when using Deep SORT, additional data association is done using current motion estimation from image registration and currently observed cross points in Nearest Neighbor literature. As motion estimation accuracy from reference image to target image is considerably accurate and distance between cross points is far, data association accuracy is improved compared to the data association without this additional association procedure. After this data association, if the number of associated features is larger than one, motion is newly estimated using Singular Value Decomposition and positions of associated features. To demonstrate improvement of proposed SLAM algorithm compared to other Visual SLAM algorithms, experiments in parking lot are suggested and compared with traditional Visual SLAM algorithms. Also, Lidar Odometry And Mapping(LOAM)is used as a groundtruth for comparing the Visual SLAM algorithms.I. Visual Simultaeneous Localization And Mapping(Visual SLAM) 1
1.1Visual SLAM์ด๋ . . . . . . . . . . . . . . . . . . . . . . 1
1.2ํน์ง์ ํ์. . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.3Data Association . . . . . . . . . . . . . . . . . . . . . . . 3
1.4Tracking . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.5์ฑ๋ฅํ๊ฐ. . . . . . . . . . . . . . . . . . . . . . . . . . . 5
II.์์จ์ฃผ์ฐจ(Autonomous Parking). . . . . . . . . . . . . . . . 7
2.1์์จ์ฃผ์ฐจ๋ . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.2์์จ์ฃผ์ฐจ์๋ฐ์ . . . . . . . . . . . . . . . . . . . . . . . 7
2.3์์ฉ์์จ์ฃผ์ฐจ. . . . . . . . . . . . . . . . . . . . . . . . 8
III.์์จ์ฃผ์ฐจ๋ฅผ์ํAVM๊ธฐ๋ฐVisual SLAM. . . . . . . . . . . 9
3.1์๋ก . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
3.2๋ฐฉ๋ฒ. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
3.2.1์ ์ํ๋SLAMํ์ดํ๋ผ์ธ. . . . . . . . . . . . 13
3.2.2๊ต์ฐจ์ ์ํ์๊ณผ์ถ์ ๊ทธ๋ฆฌ๊ณ ๋ชจ์๋ฆฌ์ถ์ถ. . . . . 16
3.2.3ํธ๋ฆฌ์๋ณํ์์ด์ฉํ์์น์ถ์ . . . . . . . . . . 18
3.2.4Keyframe์์ฑ. . . . . . . . . . . . . . . . . . . . 20
3.2.5Data Association . . . . . . . . . . . . . . . . . . . 22
3.2.6๊ต์ฐจ์ ์์ด์ฉํLandmark๊ธฐ๋ฐ์์์น์ถ์ . . . 24
3.3์คํ. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
3.3.1์คํ์ค๋น. . . . . . . . . . . . . . . . . . . . . . . 25
3.3.2์คํ๊ฒฐ๊ณผ. . . . . . . . . . . . . . . . . . . . . . . 28
3.4๊ณ ์ฐฐ๋ฐ๊ฒฐ๋ก . . . . . . . . . . . . . . . . . . . . . . . . . 33
3.4.1๊ณ ์ฐฐ. . . . . . . . . . . . . . . . . . . . . . . . . . 33
3.4.2๊ฒฐ๋ก . . . . . . . . . . . . . . . . . . . . . . . . . . 34
์ฐธ๊ณ ๋ฌธํ. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Abstract. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42Maste
Recommended from our members
Examination of existing facilities management approaches to climate change and future directions
It is widely accepted that human activities have contributed to changing the worldโs climate and that the pace of this change is ever increasing. Two approaches are being promoted by the international community to address the issue of climate change (1) Mitigation, seeking to reduce the amount of CO2; (2) Adaptation, which seeks to alter the way humankind live and work in response to the changing climate.
Whilst facilities managers and their organisations have prioritised mitigation action, there is less evidence to suggest that they are addressing the implications that a changing climate may have on the demands being placed on their organisationโs hard and soft facilities (adaptation).
This paper reports findings from a case study and questionnaire survey to ascertain the present approach taken by facilities managers to address mitigation and adaptation, their respective drivers, their view on climate change and their environmental inclination.
It concludes that the facilities manager's approach to climate change is derived by a combination of factors; namely a) Organisation approach to climate change b) Legislation and c) the facilities mangers perception of the risks posed by future climate change and of the use of risk assessment methods and climate change projection data. The study concludes that the prevailing measure for addressing climate change impacts is reactive in nature, taking the form of Disaster Recovery and Business Continuity Planning.
The practical implication of the work is in the realization that mitigation, being quantifiable and legislative driven, is viewed as a strategic issue and of importance to an organisations
Corporate Social Responsibility agenda which can be planned over the longer term (10-20 yrs). Adaptation on the other hand is measured through successful survival, increased resilience and adaptive capacity (absence of quantitative performance target), each of which are viewed as short term operational issues and as such adaptation struggles to find strategic importance. If organisations are to adapt to inevitable climate change then this situation needs to change