956 research outputs found

    Generating Optimized Trajectories for Robotic Spray Painting

    Get PDF
    In the manufacturing industry, spray painting is often an important part of the manufacturing process. Especially in the automotive industry, the perceived quality of the final product is closely linked to the exactness and smoothness of the painting process. For complex products or low batch size production, manual spray painting is often used. But in large scale production with a high degree of automation, the painting is usually performed by industrial robots. There is a need to improve and simplify the generation of robot trajectories used in industrial paint booths. A novel method for spray paint optimization is presented, which can be used to smooth out a generated initial trajectory and minimize paint thickness deviations from a target thickness. The smoothed out trajectory is found by solving, using an interior point solver, a continuous non-linear optimization problem. A two-dimensional reference function of the applied paint thickness is selected by fitting a spline function to experimental data. This applicator footprint profile is then projected to the geometry and used as a paint deposition model. After generating an initial trajectory, the position and duration of each trajectory segment are used as optimization variables. The primary goal of the optimization is to obtain a paint applicator trajectory, which would closely match a target paint thickness when executed. The algorithm has been shown to produce satisfactory results on both a simple 2-dimensional test example, and a non-trivial industrial case of painting a tractor fender. The resulting trajectory is also proven feasible to be executed by an industrial robot

    Smooth path planning with Pythagorean-hodoghraph spline curves geometric design and motion control

    Get PDF
    This thesis addresses two significative problems regarding autonomous systems, namely path and trajectory planning. Path planning deals with finding a suitable path from a start to a goal position by exploiting a given representation of the environment. Trajectory planning schemes govern the motion along the path by generating appropriate reference (path) points. We propose a two-step approach for the construction of planar smooth collision-free navigation paths. Obstacle avoidance techniques that rely on classical data structures are initially considered for the identification of piecewise linear paths that do not intersect with the obstacles of a given scenario. In the second step of the scheme we rely on spline interpolation algorithms with tension parameters to provide a smooth planar control strategy. In particular, we consider Pythagorean\u2013hodograph (PH) curves, since they provide an exact computation of fundamental geometric quantities. The vertices of the previously produced piecewise linear paths are interpolated by using a G1 or G2 interpolation scheme with tension based on PH splines. In both cases, a strategy based on the asymptotic analysis of the interpolation scheme is developed in order to get an automatic selection of the tension parameters. To completely describe the motion along the path we present a configurable trajectory planning strategy for the offline definition of time-dependent C2 piece-wise quintic feedrates. When PH spline curves are considered, the corresponding accurate and efficient CNC interpolator algorithms can be exploited

    A Novel Perception and Semantic Mapping Method for Robot Autonomy in Orchards

    Full text link
    In this work, we propose a novel framework for achieving robotic autonomy in orchards. It consists of two key steps: perception and semantic mapping. In the perception step, we introduce a 3D detection method that accurately identifies objects directly on point cloud maps. In the semantic mapping step, we develop a mapping module that constructs a visibility graph map by incorporating object-level information and terrain analysis. By combining these two steps, our framework improves the autonomy of agricultural robots in orchard environments. The accurate detection of objects and the construction of a semantic map enable the robot to navigate autonomously, perform tasks such as fruit harvesting, and acquire actionable information for efficient agricultural production

    Continuous-Time Collision Avoidance for Trajectory Optimization in Dynamic Environments

    Get PDF

    A motion planner for nonholonomic mobile robots

    Get PDF
    This paper considers the problem of motion planning for a car-like robot (i.e., a mobile robot with a nonholonomic constraint whose turning radius is lower-bounded). We present a fast and exact planner for our mobile robot model, based upon recursive subdivision of a collision-free path generated by a lower-level geometric planner that ignores the motion constraints. The resultant trajectory is optimized to give a path that is of near-minimal length in its homotopy class. Our claims of high speed are supported by experimental results for implementations that assume a robot moving amid polygonal obstacles. The completeness and the complexity of the algorithm are proven using an appropriate metric in the configuration space R^2 x S^1 of the robot. This metric is defined by using the length of the shortest paths in the absence of obstacles as the distance between two configurations. We prove that the new induced topology and the classical one are the same. Although we concentrate upon the car-like robot, the generalization of these techniques leads to new theoretical issues involving sub-Riemannian geometry and to practical results for nonholonomic motion planning

    ์ฃผํ–‰๊ณ„ ๋ฐ ์ง€๋„ ์ž‘์„ฑ์„ ์œ„ํ•œ 3์ฐจ์› ํ™•๋ฅ ์  ์ •๊ทœ๋ถ„ํฌ๋ณ€ํ™˜์˜ ์ •ํ•ฉ ๋ฐฉ๋ฒ•

    Get PDF
    ํ•™์œ„๋…ผ๋ฌธ (๋ฐ•์‚ฌ)-- ์„œ์šธ๋Œ€ํ•™๊ต ๋Œ€ํ•™์› : ๊ณต๊ณผ๋Œ€ํ•™ ์ „๊ธฐยท์ปดํ“จํ„ฐ๊ณตํ•™๋ถ€, 2019. 2. ์ด๋ฒ”ํฌ.๋กœ๋ด‡์€ ๊ฑฐ๋ฆฌ์„ผ์„œ๋ฅผ ์ด์šฉํ•˜์—ฌ ์œ„์น˜ํ•œ ํ™˜๊ฒฝ์˜ ๊ณต๊ฐ„ ์ •๋ณด๋ฅผ ์ ๊ตฐ(point set) ํ˜•ํƒœ๋กœ ์ˆ˜์ง‘ํ•  ์ˆ˜ ์žˆ๋Š”๋ฐ, ์ด๋ ‡๊ฒŒ ์ˆ˜์ง‘ํ•œ ์ •๋ณด๋ฅผ ํ™˜๊ฒฝ์˜ ๋ณต์›์— ์ด์šฉํ•  ์ˆ˜ ์žˆ๋‹ค. ๋˜ํ•œ, ๋กœ๋ด‡์€ ์ ๊ตฐ๊ณผ ๋ชจ๋ธ์„ ์ •ํ•ฉํ•˜๋Š” ์œ„์น˜๋ฅผ ์ถ”์ •ํ•  ์ˆ˜ ์žˆ๋‹ค. ๊ฑฐ๋ฆฌ์„ผ์„œ๊ฐ€ ์ˆ˜์ง‘ํ•œ ์ ๊ตฐ์ด 2์ฐจ์›์—์„œ 3์ฐจ์›์œผ๋กœ ํ™•์žฅ๋˜๊ณ  ํ•ด์ƒ๋„๊ฐ€ ๋†’์•„์ง€๋ฉด์„œ ์ ์˜ ๊ฐœ์ˆ˜๊ฐ€ ํฌ๊ฒŒ ์ฆ๊ฐ€ํ•˜๋ฉด์„œ, NDT (normal distributions transform)๋ฅผ ์ด์šฉํ•œ ์ •ํ•ฉ์ด ICP (iterative closest point)์˜ ๋Œ€์•ˆ์œผ๋กœ ๋ถ€์ƒํ•˜์˜€๋‹ค. NDT๋Š” ์ ๊ตฐ์„ ๋ถ„ํฌ๋กœ ๋ณ€ํ™˜ํ•˜์—ฌ ๊ณต๊ฐ„์„ ํ‘œํ˜„ํ•˜๋Š” ์••์ถ•๋œ ๊ณต๊ฐ„ ํ‘œํ˜„ ๋ฐฉ๋ฒ•์ด๋‹ค. ๋ถ„ํฌ์˜ ๊ฐœ์ˆ˜๊ฐ€ ์ ์˜ ๊ฐœ์ˆ˜์— ๋น„ํ•ด ์›”๋“ฑํžˆ ์ž‘๊ธฐ ๋•Œ๋ฌธ์— ICP์— ๋น„ํ•ด ๋น ๋ฅธ ์„ฑ๋Šฅ์„ ๊ฐ€์กŒ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ NDT ์ •ํ•ฉ ๊ธฐ๋ฐ˜ ์œ„์น˜ ์ถ”์ •์˜ ์„ฑ๋Šฅ์„ ์ขŒ์šฐํ•˜๋Š” ์…€์˜ ํฌ๊ธฐ, ์…€์˜ ์ค‘์ฒฉ ์ •๋„, ์…€์˜ ๋ฐฉํ–ฅ, ๋ถ„ํฌ์˜ ์Šค์ผ€์ผ, ๋Œ€์‘์Œ์˜ ๋น„์ค‘ ๋“ฑ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์„ค์ •ํ•˜๊ธฐ๊ฐ€ ๋งค์šฐ ์–ด๋ ต๋‹ค. ๋ณธ ํ•™์œ„ ๋…ผ๋ฌธ์—์„œ๋Š” ์ด๋Ÿฌํ•œ ์–ด๋ ค์›€์— ๋Œ€์‘ํ•˜์—ฌ NDT ์ •ํ•ฉ ๊ธฐ๋ฐ˜ ์œ„์น˜ ์ถ”์ •์˜ ์ •ํ™•๋„๋ฅผ ํ–ฅ์ƒํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ๋ณธ ๋…ผ๋ฌธ์€ ํ‘œํ˜„๋ฒ•๊ณผ ์ •ํ•ฉ๋ฒ• 2๊ฐœ ํŒŒํŠธ๋กœ ๋‚˜๋ˆŒ ์ˆ˜ ์žˆ๋‹ค. ํ‘œํ˜„๋ฒ•์— ์žˆ์–ด ๋ณธ ๋…ผ๋ฌธ์€ ๋‹ค์Œ 3๊ฐœ ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ์ฒซ์งธ, ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ๋ถ„ํฌ์˜ ํ‡ดํ™”๋ฅผ ๋ง‰๊ธฐ ์œ„ํ•ด ๊ฒฝํ—˜์ ์œผ๋กœ ๊ณต๋ถ„์‚ฐ ํ–‰๋ ฌ์˜ ๊ณ ์œ ๊ฐ’์„ ์ˆ˜์ •ํ•˜์—ฌ ๊ณต๊ฐ„์  ํ˜•ํƒœ์˜ ์™œ๊ณก์„ ๊ฐ€์ ธ์˜ค๋Š” ๋ฌธ์ œ์ ๊ณผ ๊ณ ํ•ด์ƒ๋„์˜ NDT๋ฅผ ์ƒ์„ฑํ•  ๋•Œ ์…€๋‹น ์ ์˜ ๊ฐœ์ˆ˜๊ฐ€ ๊ฐ์†Œํ•˜๋ฉฐ ๊ตฌ์กฐ๋ฅผ ๋ฐ˜์˜ํ•˜๋Š” ๋ถ„ํฌ๊ฐ€ ํ˜•์„ฑ๋˜์ง€ ์•Š๋Š” ๋ฌธ์ œ์ ์„ ์ฃผ๋ชฉํ–ˆ๋‹ค. ์ด๋ฅผ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•˜์—ฌ ๊ฐ ์ ์— ๋Œ€ํ•ด ๋ถˆํ™•์‹ค์„ฑ์„ ๋ถ€์—ฌํ•˜๊ณ , ํ‰๊ท ๊ณผ ๋ถ„์‚ฐ์˜ ๊ธฐ๋Œ€๊ฐ’์œผ๋กœ ์ˆ˜์ •ํ•œ ํ™•๋ฅ ์  NDT (PNDT, probabilistic NDT) ํ‘œํ˜„๋ฒ•์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ๊ณต๊ฐ„ ์ •๋ณด์˜ ๋ˆ„๋ฝ ์—†์ด ๋ชจ๋“  ์ ์„ ๋ถ„ํฌ๋กœ ๋ณ€ํ™˜ํ•œ NDT๋ฅผ ํ†ตํ•ด ํ–ฅ์ƒ๋œ ์ •ํ™•๋„๋ฅผ ๋ณด์ธ PNDT๋Š” ์ƒ˜ํ”Œ๋ง์„ ํ†ตํ•œ ๊ฐ€์„์„ ๊ฐ€๋Šฅํ•˜๋„๋ก ํ•˜์˜€๋‹ค. ๋‘˜์งธ, ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ์ •์œก๋ฉด์ฒด๋ฅผ ์…€๋กœ ๋‹ค๋ฃจ๋ฉฐ, ์…€์„ ์ค‘์‹ฌ์ขŒํ‘œ์™€ ๋ณ€์˜ ๊ธธ์ด๋กœ ์ •์˜ํ•œ๋‹ค. ๋˜ํ•œ, ์…€๋“ค๋กœ ์ด๋ค„์ง„ ๊ฒฉ์ž๋ฅผ ๊ฐ ์…€์˜ ์ค‘์‹ฌ์  ์‚ฌ์ด์˜ ๊ฐ„๊ฒฉ๊ณผ ์…€์˜ ํฌ๊ธฐ๋กœ ์ •์˜ํ•œ๋‹ค. ์ด๋Ÿฌํ•œ ์ •์˜๋ฅผ ํ† ๋Œ€๋กœ, ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ์…€์˜ ํ™•๋Œ€๋ฅผ ํ†ตํ•˜์—ฌ ์…€์„ ์ค‘์ฒฉ์‹œํ‚ค๋Š” ๋ฐฉ๋ฒ•๊ณผ ์…€์˜ ๊ฐ„๊ฒฉ ์กฐ์ ˆ์„ ํ†ตํ•˜์—ฌ ์…€์„ ์ค‘์ฒฉ์‹œํ‚ค๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ๋ณธ ๋…ผ๋ฌธ์€ ๊ธฐ์กด 2D NDT์—์„œ ์‚ฌ์šฉํ•œ ์…€์˜ ์‚ฝ์ž…๋ฒ•์„ ์ฃผ๋ชฉํ•˜์˜€๋‹ค. ๋‹จ์ˆœ์ž…๋ฐฉ๊ตฌ์กฐ๋ฅผ ์ด๋ฃจ๋Š” ๊ธฐ์กด ๋ฐฉ๋ฒ• ์™ธ์— ๋ฉด์‹ฌ์ž…๋ฐฉ๊ตฌ์กฐ์™€ ์ฒด์‹ฌ์ž…๋ฐฉ๊ตฌ์กฐ์˜ ์…€๋กœ ์ด๋ค„์ง„ ๊ฒฉ์ž๊ฐ€ ์ƒ์„ฑํ•˜์˜€๋‹ค. ๊ทธ ๋‹ค์Œ ํ•ด๋‹น ๊ฒฉ์ž๋ฅผ ์ด์šฉํ•˜์—ฌ NDT๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ๋˜ํ•œ, ์ด๋ ‡๊ฒŒ ์ƒ์„ฑ๋œ NDT๋ฅผ ์ •ํ•ฉํ•  ๋•Œ ๋งŽ์€ ์‹œ๊ฐ„์„ ์†Œ์š”ํ•˜๊ธฐ ๋•Œ๋ฌธ์— ๋Œ€์‘์Œ ๊ฒ€์ƒ‰ ์˜์—ญ์„ ์ •์˜ํ•˜์—ฌ ์ •ํ•ฉ ์†๋„๋ฅผ ํ–ฅ์ƒํ•˜์˜€๋‹ค. ์…‹์งธ, ์ €์‚ฌ์–‘ ๋กœ๋ด‡๋“ค์€ ์ ๊ตฐ ์ง€๋„๋ฅผ NDT ์ง€๋„๋กœ ์••์ถ•ํ•˜์—ฌ ๋ณด๊ด€ํ•˜๋Š” ๊ฒƒ์ด ํšจ์œจ์ ์ด๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ๋กœ๋ด‡ ํฌ์ฆˆ๊ฐ€ ๊ฐฑ์‹ ๋˜๊ฑฐ๋‚˜, ๋‹ค๊ฐœ์ฒด ๋กœ๋ด‡๊ฐ„ ๋ž‘๋ฐ๋ทฐ๊ฐ€ ์ผ์–ด๋‚˜ ์ง€๋„๋ฅผ ๊ณต์œ  ๋ฐ ๊ฒฐํ•ฉํ•˜๋Š” ๊ฒฝ์šฐ NDT์˜ ๋ถ„ํฌ ํ˜•ํƒœ๊ฐ€ ์™œ๊ณก๋˜๋Š” ๋ฌธ์ œ๊ฐ€ ๋ฐœ์ƒํ•œ๋‹ค. ์ด๋Ÿฌํ•œ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•˜์—ฌ NDT ์žฌ์ƒ์„ฑ ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ์ •ํ•ฉ๋ฒ•์— ์žˆ์–ด ๋ณธ ๋…ผ๋ฌธ์€ ๋‹ค์Œ 4๊ฐœ ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ์ฒซ์งธ, ์ ๊ตฐ์˜ ๊ฐ ์ ์— ๋Œ€ํ•ด ๋Œ€์‘๋˜๋Š” ์ƒ‰์ƒ ์ •๋ณด๊ฐ€ ์ œ๊ณต๋  ๋•Œ ์ƒ‰์ƒ hue๋ฅผ ์ด์šฉํ•œ ํ–ฅ์ƒ๋œ NDT ์ •ํ•ฉ์œผ๋กœ ๊ฐ ๋Œ€์‘์Œ์— ๋Œ€ํ•ด hue์˜ ์œ ์‚ฌ๋„๋ฅผ ๋น„์ค‘์œผ๋กœ ์‚ฌ์šฉํ•˜๋Š” ๋ชฉ์ ํ•จ์ˆ˜๋ฅผ ์ œ์•ˆํ•˜์˜€๋‹ค. ๋‘˜์งธ, ๋ณธ ๋…ผ๋ฌธ์€์€ ๋‹ค์–‘ํ•œ ํฌ๊ธฐ์˜ ์œ„์น˜ ๋ณ€ํ™”๋Ÿ‰์— ๋Œ€์‘ํ•˜๊ธฐ ์œ„ํ•œ ๋‹ค์ค‘ ๋ ˆ์ด์–ด NDT ์ •ํ•ฉ (ML-NDT, multi-layered NDT)์˜ ํ•œ๊ณ„๋ฅผ ๊ทน๋ณตํ•˜๊ธฐ ์œ„ํ•˜์—ฌ ํ‚ค๋ ˆ์ด์–ด NDT ์ •ํ•ฉ (KL-NDT, key-layered NDT)์„ ์ œ์•ˆํ•˜์˜€๋‹ค. KL-NDT๋Š” ๊ฐ ํ•ด์ƒ๋„์˜ ์…€์—์„œ ํ™œ์„ฑํ™”๋œ ์ ์˜ ๊ฐœ์ˆ˜ ๋ณ€ํ™”๋Ÿ‰์„ ์ฒ™๋„๋กœ ํ‚ค๋ ˆ์ด์–ด๋ฅผ ๊ฒฐ์ •ํ•œ๋‹ค. ๋˜ํ•œ ํ‚ค๋ ˆ์ด์–ด์—์„œ ์œ„์น˜์˜ ์ถ”์ •๊ฐ’์ด ์ˆ˜๋ ดํ•  ๋•Œ๊นŒ์ง€ ์ •ํ•ฉ์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๋ฐฉ์‹์„ ์ทจํ•˜์—ฌ ๋‹ค์Œ ํ‚ค๋ ˆ์ด์–ด์— ๋” ์ข‹์€ ์ดˆ๊ธฐ๊ฐ’์„ ์ œ๊ณตํ•œ๋‹ค. ์…‹์งธ, ๋ณธ ๋…ผ๋ฌธ์€ ์ด์‚ฐ์ ์ธ ์…€๋กœ ์ธํ•ด NDT๊ฐ„ ์ •ํ•ฉ ๊ธฐ๋ฒ•์ธ NDT-D2D (distribution-to-distribution NDT)์˜ ๋ชฉ์  ํ•จ์ˆ˜๊ฐ€ ๋น„์„ ํ˜•์ด๋ฉฐ ๊ตญ์†Œ ์ตœ์ €์น˜์˜ ์™„ํ™”๋ฅผ ์œ„ํ•œ ๋ฐฉ๋ฒ•์œผ๋กœ ์‹ ๊ทœ NDT์™€ ๋ชจ๋ธ NDT์— ๋…๋ฆฝ๋œ ์Šค์ผ€์ผ์„ ์ •์˜ํ•˜๊ณ  ์Šค์ผ€์ผ์„ ๋ณ€ํ™”ํ•˜๋ฉฐ ์ •ํ•ฉํ•˜๋Š” ๋™์  ์Šค์ผ€์ผ ๊ธฐ๋ฐ˜ NDT ์ •ํ•ฉ (DSF-NDT-D2D, dynamic scaling factor-based NDT-D2D)์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ๋งˆ์ง€๋ง‰์œผ๋กœ, ๋ณธ ๋…ผ๋ฌธ์€ ์†Œ์Šค NDT์™€ ์ง€๋„๊ฐ„ ์ฆ๋Œ€์  ์ •ํ•ฉ์„ ์ด์šฉํ•œ ์ฃผํ–‰๊ณ„ ์ถ”์ • ๋ฐ ์ง€๋„ ์ž‘์„ฑ ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜์˜€๋‹ค. ์ด ๋ฐฉ๋ฒ•์€ ๋กœ๋ด‡์˜ ํ˜„์žฌ ํฌ์ฆˆ์— ๋Œ€ํ•œ ์ดˆ๊ธฐ๊ฐ’์„ ์†Œ์Šค ์ ๊ตฐ์— ์ ์šฉํ•œ ๋’ค NDT๋กœ ๋ณ€ํ™˜ํ•˜์—ฌ ์ง€๋„ ์ƒ NDT์™€ ๊ฐ€๋Šฅํ•œ ํ•œ ์œ ์‚ฌํ•œ NDT๋ฅผ ์ž‘์„ฑํ•œ๋‹ค. ๊ทธ ๋‹ค์Œ ๋กœ๋ด‡ ํฌ์ฆˆ ๋ฐ ์†Œ์Šค NDT์˜ GC (Gaussian component)๋ฅผ ๊ณ ๋ คํ•˜์—ฌ ๋ถ€๋ถ„์ง€๋„๋ฅผ ์ถ”์ถœํ•œ๋‹ค. ์ด๋ ‡๊ฒŒ ์ถ”์ถœํ•œ ๋ถ€๋ถ„์ง€๋„์™€ ์†Œ์Šค NDT๋Š” ๋‹ค์ค‘ ๋ ˆ์ด์–ด NDT ์ •ํ•ฉ์„ ์ˆ˜ํ–‰ํ•˜์—ฌ ์ •ํ™•ํ•œ ์ฃผํ–‰๊ณ„๋ฅผ ์ถ”์ •ํ•˜๊ณ , ์ถ”์ • ํฌ์ฆˆ๋กœ ์†Œ์Šค ์ ๊ตฐ์„ ํšŒ์ „ ๋ฐ ์ด๋™ ํ›„ ๊ธฐ์กด ์ง€๋„๋ฅผ ๊ฐฑ์‹ ํ•œ๋‹ค. ์ด๋Ÿฌํ•œ ๊ณผ์ •์„ ํ†ตํ•ด ์ด ๋ฐฉ๋ฒ•์€ ํ˜„์žฌ ์ตœ๊ณ  ์„ฑ๋Šฅ์„ ๊ฐ€์ง„ LOAM (lidar odometry and mapping)์— ๋น„ํ•˜์—ฌ ๋” ๋†’์€ ์ •ํ™•๋„์™€ ๋” ๋น ๋ฅธ ์ฒ˜๋ฆฌ์†๋„๋ฅผ ๋ณด์˜€๋‹ค.The robot is a self-operating device using its intelligence, and autonomous navigation is a critical form of intelligence for a robot. This dissertation focuses on localization and mapping using a 3D range sensor for autonomous navigation. The robot can collect spatial information from the environment using a range sensor. This information can be used to reconstruct the environment. Additionally, the robot can estimate pose variations by registering the source point set with the model. Given that the point set collected by the sensor is expanded in three dimensions and becomes dense, registration using the normal distribution transform (NDT) has emerged as an alternative to the most commonly used iterative closest point (ICP) method. NDT is a compact representation which describes using a set of GCs (GC) converted from a point set. Because the number of GCs is much smaller than the number of points, with regard to the computation time, NDT outperforms ICP. However, the NDT has issues to be resolved, such as the discretization of the point set and the objective function. This dissertation is divided into two parts: representation and registration. For the representation part, first we present the probabilistic NDT (PNDT) to deal with the destruction and degeneration problems caused by the small cell size and the sparse point set. PNDT assigns an uncertainty to each point sample to convert a point set with fewer than four points into a distribution. As a result, PNDT allows for more precise registration using small cells. Second, we present lattice adjustment and cell insertion methods to overlap cells to overcome the discreteness problem of the NDT. In the lattice adjustment method, a lattice is expressed as the distance between the cells and the side length of each cell. In the cell insertion method, simple, face-centered-cubic, and body-centered-cubic lattices are compared. Third, we present a means of regenerating the NDT for the target lattice. A single robot updates its poses using simultaneous localization and mapping (SLAM) and fuses the NDT at each pose to update its NDT map. Moreover, multiple robots share NDT maps built with inconsistent lattices and fuse the maps. Because the simple fusion of the NDT maps can change the centers, shapes, and normal vectors of GCs, the regeneration method subdivides the NDT into truncated GCs using the target lattice and regenerates the NDT. For the registration part, first we present a hue-assisted NDT registration if the robot acquires color information corresponding to each point sample from a vision sensor. Each GC of the NDT has a distribution of the hue and uses the similarity of the hue distributions as the weight in the objective function. Second, we present a key-layered NDT registration (KL-NDT) method. The multi-layered NDT registration (ML-NDT) registers points to the NDT in multiple resolutions of lattices. However, the initial cell size and the number of layers are difficult to determine. KL-NDT determines the key layers in which the registration is performed based on the change of the number of activated points. Third, we present a method involving dynamic scaling factors of the covariance. This method scales the source NDT at zero initially to avoid a negative correlation between the likelihood and rotational alignment. It also scales the target NDT from the maximum scale to the minimum scale. Finally, we present a method of incremental registration of PNDTs which outperforms the state-of-the-art lidar odometry and mapping method.1 Introduction 1 1.1 Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 Problem Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.3 Literature Review . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.3.1 Point Set Registration . . . . . . . . . . . . . . . . . . . . . 7 1.3.2 Incremental Registration for Odometry Estimation . . . . . . 16 1.4 Contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 1.5 Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 2 Preliminaries 21 2.1 NDT Representation . . . . . . . . . . . . . . . . . . . . . . . . . . 21 2.2 NDT Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 2.3 NDT Mapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 2.4 Transformation Matrix and The Parameter Vector . . . . . . . . . . . 27 2.5 Cubic Cell and Lattice . . . . . . . . . . . . . . . . . . . . . . . . . 28 2.6 Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 2.7 Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 2.8 Evaluation of Registration . . . . . . . . . . . . . . . . . . . . . . . 31 2.9 Benchmark Dataset . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 3 Probabilistic NDT Representation 34 3.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 3.2 Uncertainty of Point Based on Sensor Model . . . . . . . . . . . . . . 36 3.3 Probabilistic NDT . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 3.4 Generalization of NDT Registration Based on PNDT . . . . . . . . . 40 3.5 Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 3.5.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 3.5.2 Evaluation of Representation . . . . . . . . . . . . . . . . . . 41 3.5.3 Evaluation of Registration . . . . . . . . . . . . . . . . . . . 46 3.6 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 4 Interpolation for NDT Using Overlapped Regular Cells 51 4.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 4.2 Lattice Adjustment . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 4.3 Crystalline NDT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54 4.4 Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 4.4.1 Lattice Adjustment . . . . . . . . . . . . . . . . . . . . . . . 56 4.4.2 Performance of Crystalline NDT . . . . . . . . . . . . . . . . 60 4.5 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63 5 Regeneration of Normal Distributions Transform 65 5.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 5.2 Mathematical Preliminaries . . . . . . . . . . . . . . . . . . . . . . . 67 5.2.1 Trivariate Normal Distribution . . . . . . . . . . . . . . . . . 67 5.2.2 Truncated Trivariate Normal Distribution . . . . . . . . . . . 67 5.3 Regeneration of NDT . . . . . . . . . . . . . . . . . . . . . . . . . . 69 5.3.1 Alignment . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 5.3.2 Subdivision of Gaussian Components . . . . . . . . . . . . . 70 5.3.3 Fusion of Gaussian Components . . . . . . . . . . . . . . . . 72 5.4 Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73 5.4.1 Evaluation Metrics for Representation . . . . . . . . . . . . . 73 5.4.2 Representation Performance of the Regenerated NDT . . . . . 75 5.4.3 Computation Performance of the Regeneration . . . . . . . . 82 5.4.4 Application of Map Fusion . . . . . . . . . . . . . . . . . . . 83 5.5 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89 6 Hue-Assisted Registration 91 6.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 6.2 Preliminary of the HSV Model . . . . . . . . . . . . . . . . . . . . . 92 6.3 Colored Octree for Subdivision . . . . . . . . . . . . . . . . . . . . . 94 6.4 HA-NDT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95 6.5 Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 6.5.1 Evaluation of HA-NDT against nhue . . . . . . . . . . . . . . 97 6.5.2 Evaluation of NDT and HA-NDT . . . . . . . . . . . . . . . 98 6.6 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101 7 Key-Layered NDT Registration 103 7.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103 7.2 Key-layered NDT-P2D . . . . . . . . . . . . . . . . . . . . . . . . . 105 7.3 Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108 7.3.1 Evaluation of KL-NDT-P2D and ML-NDT-P2D . . . . . . . . 108 7.3.2 Evaluation of KL-NDT-D2D and ML-NDT-D2D . . . . . . . 111 7.4 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112 8 Scaled NDT and The Multi-scale Registration 113 8.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 8.2 Scaled NDT representation and L2 distance . . . . . . . . . . . . . . 114 8.3 NDT-D2D with dynamic scaling factors of covariances . . . . . . . . 116 8.4 Range of scaling factors . . . . . . . . . . . . . . . . . . . . . . . . . 120 8.5 Experiment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 8.5.1 Evaluation of the presented method without initial guess . . . 122 8.5.2 Application of odometry estimation . . . . . . . . . . . . . . 125 8.6 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128 9 Scan-to-map Registration 129 9.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129 9.2 Multi-layered PNDT . . . . . . . . . . . . . . . . . . . . . . . . . . 130 9.3 NDT Incremental Registration . . . . . . . . . . . . . . . . . . . . . 132 9.3.1 Initialization of PNDT-Map . . . . . . . . . . . . . . . . . . 133 9.3.2 Generation of Source ML-PNDT . . . . . . . . . . . . . . . . 134 9.3.3 Reconstruction of The Target ML-PNDT . . . . . . . . . . . 134 9.3.4 Pose Estimation Based on Multi-layered Registration . . . . . 135 9.3.5 Update of PNDT-Map . . . . . . . . . . . . . . . . . . . . . 136 9.4 Experiments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137 9.5 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140 10 Conclusions 142 Bibliography 145 ์ดˆ๋ก 159 ๊ฐ์‚ฌ์˜ ๊ธ€ 162Docto

    Detail Enhancing Denoising of Digitized 3D Models from a Mobile Scanning System

    Get PDF
    The acquisition process of digitizing a large-scale environment produces an enormous amount of raw geometry data. This data is corrupted by system noise, which leads to 3D surfaces that are not smooth and details that are distorted. Any scanning system has noise associate with the scanning hardware, both digital quantization errors and measurement inaccuracies, but a mobile scanning system has additional system noise introduced by the pose estimation of the hardware during data acquisition. The combined system noise generates data that is not handled well by existing noise reduction and smoothing techniques. This research is focused on enhancing the 3D models acquired by mobile scanning systems used to digitize large-scale environments. These digitization systems combine a variety of sensors โ€“ including laser range scanners, video cameras, and pose estimation hardware โ€“ on a mobile platform for the quick acquisition of 3D models of real world environments. The data acquired by such systems are extremely noisy, often with significant details being on the same order of magnitude as the system noise. By utilizing a unique 3D signal analysis tool, a denoising algorithm was developed that identifies regions of detail and enhances their geometry, while removing the effects of noise on the overall model. The developed algorithm can be useful for a variety of digitized 3D models, not just those involving mobile scanning systems. The challenges faced in this study were the automatic processing needs of the enhancement algorithm, and the need to fill a hole in the area of 3D model analysis in order to reduce the effect of system noise on the 3D models. In this context, our main contributions are the automation and integration of a data enhancement method not well known to the computer vision community, and the development of a novel 3D signal decomposition and analysis tool. The new technologies featured in this document are intuitive extensions of existing methods to new dimensionality and applications. The totality of the research has been applied towards detail enhancing denoising of scanned data from a mobile range scanning system, and results from both synthetic and real models are presented

    Smooth path planning with Pythagorean-hodoghraph spline curves geometric design and motion control

    Get PDF
    This thesis addresses two significative problems regarding autonomous systems, namely path and trajectory planning. Path planning deals with finding a suitable path from a start to a goal position by exploiting a given representation of the environment. Trajectory planning schemes govern the motion along the path by generating appropriate reference (path) points. We propose a two-step approach for the construction of planar smooth collision-free navigation paths. Obstacle avoidance techniques that rely on classical data structures are initially considered for the identification of piecewise linear paths that do not intersect with the obstacles of a given scenario. In the second step of the scheme we rely on spline interpolation algorithms with tension parameters to provide a smooth planar control strategy. In particular, we consider Pythagoreanโ€“hodograph (PH) curves, since they provide an exact computation of fundamental geometric quantities. The vertices of the previously produced piecewise linear paths are interpolated by using a G1 or G2 interpolation scheme with tension based on PH splines. In both cases, a strategy based on the asymptotic analysis of the interpolation scheme is developed in order to get an automatic selection of the tension parameters. To completely describe the motion along the path we present a configurable trajectory planning strategy for the offline definition of time-dependent C2 piece-wise quintic feedrates. When PH spline curves are considered, the corresponding accurate and efficient CNC interpolator algorithms can be exploited

    Computing fast search heuristics for physics-based mobile robot motion planning

    Get PDF
    Mobile robots are increasingly being employed to assist responders in search and rescue missions. Robots have to navigate in dangerous areas such as collapsed buildings and hazardous sites, which can be inaccessible to humans. Tele-operating the robots can be stressing for the human operators, which are also overloaded with mission tasks and coordination overhead, so it is important to provide the robot with some degree of autonomy, to lighten up the task for the human operator and also to ensure robot safety. Moving robots around requires reasoning, including interpretation of the environment, spatial reasoning, planning of actions (motion), and execution. This is particularly challenging when the environment is unstructured, and the terrain is \textit{harsh}, i.e. not flat and cluttered with obstacles. Approaches reducing the problem to a 2D path planning problem fall short, and many of those who reason about the problem in 3D don't do it in a complete and exhaustive manner. The approach proposed in this thesis is to use rigid body simulation to obtain a more truthful model of the reality, i.e. of the interaction between the robot and the environment. Such a simulation obeys the laws of physics, takes into account the geometry of the environment, the geometry of the robot, and any dynamic constraints that may be in place. The physics-based motion planning approach by itself is also highly intractable due to the computational load required to perform state propagation combined with the exponential blowup of planning; additionally, there are more technical limitations that disallow us to use things such as state sampling or state steering, which are known to be effective in solving the problem in simpler domains. The proposed solution to this problem is to compute heuristics that can bias the search towards the goal, so as to quickly converge towards the solution. With such a model, the search space is a rich space, which can only contain states which are physically reachable by the robot, and also tells us enough information about the safety of the robot itself. The overall result is that by using this framework the robot engineer has a simpler job of encoding the \textit{domain knowledge} which now consists only of providing the robot geometric model plus any constraints
    • โ€ฆ
    corecore