2 research outputs found

    Fast Virtual Keyboard Typing Using Vowel Hand Gesture Recognition

    Get PDF
    ํ•™์œ„๋…ผ๋ฌธ(์„์‚ฌ) -- ์„œ์šธ๋Œ€ํ•™๊ต๋Œ€ํ•™์› : ๊ณต๊ณผ๋Œ€ํ•™ ์ „๊ธฐยท์ •๋ณด๊ณตํ•™๋ถ€, 2023. 2. ์ดํ˜์žฌ.This paper proposes a fast virtual keyboard typing method that improves typing method that improves typing speed using hand gesture recognition. In the proposed method, five frequently used English vowels can be quickly input with five dedicated gestures. The proposed method reduces, not only the layer switching time of the multilayer keyboard layout, but also vowel typing time. To predict the performance of the proposed method, simulations are performed considering four scenarios according to the order of appearance of vowels and consonants. The result shows that the proposed method improves typing speed by 20.72%. Lastly user test with typing 4 sample sentences results that typing speed is improved by 12.45% based on WPM.์ตœ๊ทผ AR(Augmented Reality) ๋ฐ VR(Virtual Reality)๊ธฐ์ˆ ์ด ๋ฐœ์ „ ํ•จ์— ๋”ฐ๋ผ ์‚ฌ์šฉ์ž ์ธํ„ฐํŽ˜์ด์Šค ๊ธฐ์ˆ ์— ๋Œ€ํ•œ ์—ฐ๊ตฌ๊ฐ€ ํ™œ๋ฐœํžˆ ์ง„ํ–‰๋˜๊ณ  ์žˆ๋‹ค. ํ‚ค๋ณด๋“œ, ๋งˆ์šฐ์Šค, ํ„ฐ์น˜์Šคํฌ๋ฆฐ ๋“ฑ ๊ธฐ์กด์˜ ์ž…๋ ฅ ์žฅ์น˜๋ฅผ ๋Œ€์ฒดํ•  ์ˆ˜ ์žˆ๋Š” ๊ฐ€์ƒ ์ž…๋ ฅ ์ธํ„ฐํŽ˜์ด์Šค๋กœ ์†๋™์ž‘ ์ธ์‹์ด ์ฃผ๋ชฉ๋ฐ›๊ณ  ์žˆ์œผ๋ฉฐ, ์ด์— ๋‹ค์–‘ํ•œ ์ ‘๊ทผ ๋ฐฉ์‹์œผ๋กœ ์†๋™์ž‘ ์ธ์‹ ๋ชจ๋ธ์ด ์ œ์•ˆ๋˜์—ˆ๋‹ค. ์ •๊ตํ•œ ์† ์ธ์‹์„ ์œ„ํ•ด ์„ผ์„œ๊ฐ€ ๋‚ด์žฅ๋œ ์žฅ์น˜ํ˜• ์ธํ„ฐํŽ˜์ด์Šค๋ฅผ ์‚ฌ์šฉํ•œ ์†๋™์ž‘ ์ธ์‹ ์—ฐ๊ตฌ๊ฐ€ ์ด๋ค„์ง€๊ณ  ์žˆ๋‹ค. ์ตœ๊ทผ์—๋Š” ๋”ฅ๋Ÿฌ๋‹ ๊ธฐ์ˆ ์˜ ๋ฐœ์ „์— ๋”ฐ๋ผ ๋ณ„๋„์˜ ์žฅ์น˜๊ฐ€ ํ•„์š” ์—†๋Š” ์นด๋ฉ”๋ผ ๊ธฐ๋ฐ˜ ๋น„์ „ ์ธ์‹์„ ์ด์šฉํ•œ ์†๋™์ž‘ ์ธ์‹์ด AR/VR์˜ ํ•ต์‹ฌ ์–ดํ”Œ๋ฆฌ์ผ€์ด์…˜์ธ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ, ๊ฐ€์ƒ ๊ธ€์“ฐ๊ธฐ, ์ˆ˜ํ™” ์ธ์‹ ๋“ฑ์— ์‚ฌ์šฉ๋˜๊ธฐ ์œ„ํ•œ ์ธํ„ฐํŽ˜์ด์Šค๋กœ ํ™œ๋ฐœํ•œ ์—ฐ๊ตฌ๊ฐ€ ์ด๋ค„์ง€๊ณ  ์žˆ์œผ๋ฉฐ, ํŠนํžˆ ๊ฐ์ฒด ์ธ์‹ ๋”ฅ๋Ÿฌ๋‹ ๋„คํŠธ์›Œํฌ์˜ ๊ฒฝ์šฐ ์‹ค์‹œ๊ฐ„์œผ๋กœ ์†๋™์ž‘์„ ์ธ์‹ํ•  ์ˆ˜ ์žˆ๋‹ค๋Š” ์ ์—์„œ ๋งŽ์ด ์‚ฌ์šฉ๋˜๊ณ  ์žˆ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ์•ŒํŒŒ๋ฒณ์˜ ์‚ฌ์šฉ ๋นˆ๋„ ๋ฐ ์—ฐ์†์ ์œผ๋กœ ๋‚˜ํƒ€๋‚˜๋Š” ๋‘ ๋ฌธ์ž ๊ฐ„์˜ ์ƒ๊ด€ ๋นˆ๋„์— ๋Œ€ํ•ด ํ†ต๊ณ„์  ๋ถ„์„์„ ์ง„ํ–‰ ์‹œ, ๋ชจ์Œ์˜ ์‚ฌ์šฉ ๋นˆ๋„์ˆ˜๋Š” ํ‰๊ท  39%์ด๋ฉฐ ์ž์Œ-๋ชจ์Œ ๋˜๋Š” ๋ชจ์Œ-์ž์Œ ์ˆœ์œผ๋กœ ๋ฐฐ์น˜๋˜๋Š” ๊ฒฝ์šฐ๋Š” ์•ฝ 65% ์ •๋„๋กœ ๋ชจ์Œ์˜ ์ž…๋ ฅ์˜ ์†๋„๋ฅผ ํ–ฅ์ƒ์‹œ์ผœ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ ์ž…๋ ฅ ์†๋„๋ฅผ ๊ฐœ์„ ํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•œ๋‹ค. ์ œ์•ˆํ•œ ๋ฐฉ์‹์€ ๊ฐ์ฒด ์ธ์‹ ๋”ฅ๋Ÿฌ๋‹ ๋„คํŠธ์›Œํฌ๋ฅผ ์ด์šฉํ•˜์—ฌ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ ์ž…๋ ฅ์— ํ•„์š”ํ•œ 6๊ฐœ์˜ ์†๋™์ž‘์— 5๊ฐœ์˜ ์•ŒํŒŒ๋ฒณ ๋ชจ์Œ, a, e, i, o, u์— ๋Œ€ํ•ด ํŠน์ •๋œ ์†๋™์ž‘์„ ์ถ”๊ฐ€๋กœ ํ•™์Šต์‹œ์ผœ, ์ž์Œ์˜ ๊ฒฝ์šฐ ๊ธฐ์กด๊ณผ ๋™์ผํ•˜๊ฒŒ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ ๋ฐฐ์—ด ๋‚ด์—์„œ ์„ ํƒ๋˜์–ด ์ž…๋ ฅ๋˜๋„๋ก ํ•˜๋ฉฐ ๋ชจ์Œ์˜ ๊ฒฝ์šฐ ๋ชจ์Œ ์†๋™์ž‘์ด ์ธ์‹๋˜๋ฉด ์ž…๋ ฅ๋˜๋„๋ก ํ•œ๋‹ค. ์ธ์‹์ด ํ•„์š”ํ•œ ์†๋™์ž‘์ด ๋Š˜์–ด๋‚จ์— ๋”ฐ๋ผ ์ž๋™ ๋ผ๋ฒจ๋ง์„ ํ†ตํ•ด ๋‹ค์ˆ˜์˜ ํ•™์Šต ๋ฐ์ดํ„ฐ๋ฅผ ํ™•๋ณดํ•˜์—ฌ 94.39%์˜ ๋น„๊ต์  ๋†’์€ ํ‰๊ท  ์†๋™์ž‘ ์ธ์‹๋ฅ ์„ ํ™•๋ณดํ–ˆ๋‹ค. ์ œ์•ˆํ•œ ๋ฐฉ์‹ ๊ธฐ๋ฐ˜์˜ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ๋ฅผ ๊ตฌํ˜„ํ•˜์—ฌ ์‚ฌ์šฉ์ž ํ…Œ์ŠคํŠธ๋ฅผ ์ง„ํ–‰ํ•œ ๊ฒฐ๊ณผ ๊ธฐ์กด์— ์ œ์•ˆ๋œ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ ์ž…๋ ฅ ๋ฐฉ์‹๋ณด๋‹ค ์ œ์•ˆํ•œ ๋ฐฉ์‹์˜ ์†๋„๊ฐ€ 12.45% ๊ฐœ์„ ๋˜์—ˆ๋‹ค.์ œ 1 ์žฅ ์„œ ๋ก  1 ์ œ 1 ์ ˆ ์—ฐ๊ตฌ ๋ฐฐ๊ฒฝ ๋ฐ ๋‚ด์šฉ 1 ์ œ 2 ์ ˆ ๋…ผ๋ฌธ์˜ ๊ตฌ์„ฑ 3 ์ œ 2 ์žฅ ๊ด€๋ จ ์—ฐ๊ตฌ 4 ์ œ 1 ์ ˆ ์†๋™์ž‘ ์ธ์‹ ๊ด€๋ จ ์—ฐ๊ตฌ 4 ์ œ 2 ์ ˆ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ ๊ด€๋ จ ์—ฐ๊ตฌ 7 ์ œ 3 ์žฅ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ ์†๋„ ํ–ฅ์ƒ ๋ฐฉ์•ˆ ์ œ์•ˆ 9 ์ œ 1 ์ ˆ ๋ชจ์Œ ์†๋™์ž‘ ์ถ”๊ฐ€ ๋ฐฐ๊ฒฝ 9 ์ œ 2 ์ ˆ ์ œ์•ˆํ•œ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ ์ž…๋ ฅ ์‹œ์Šคํ…œ 10 ์ œ 4 ์žฅ ์‹คํ—˜ ๊ฒฐ๊ณผ ๋ฐ ๋ถ„์„ 14 ์ œ 1 ์ ˆ ์ž…๋ ฅ ์‹œ๊ฐ„ ์˜ˆ์ธก ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ๊ฒฐ๊ณผ 14 ์ œ 2 ์ ˆ ๋”ฅ๋Ÿฌ๋‹ ๋„คํŠธ์›Œํฌ์˜ ํ•™์Šต 16 ์ œ 3 ์ ˆ ๊ฐ€์ƒ ํ‚ค๋ณด๋“œ์˜ ์‚ฌ์šฉ์ž ์‹คํ—˜ ๋ฐ ๋ถ„์„ 19 ์ œ 5 ์žฅ ๊ฒฐ๋ก  21 ์ฐธ๊ณ ๋ฌธํ—Œ 22 Abstract 25์„

    A New Virtual Keyboard with Finger Gesture Recognition for AR/VR Devices

    No full text
    This paper proposes a system that types the virtual keyboard by recognizing hand gestures in a single camera based environment. A virtual keyboard is designed in a multi-tab method of 3 x 4 arrays that are widely used in a mobile environment. In order to make it easy to identify the type-in action and consequently, to increase the type-in speed, this paper proposes a new definition of type-in action as the contact between the thumb and the index finger. To further reduce the input time, the keyboard layout is optimized by efficiently arranging alphabet keys according to the frequency of character appearance. Experimental results show that the proposed type-in action is effective to give commands with a virtual keyboard. Furthermore, the proposed keyboard layout achieves the speed-up by an average of 46.16% compared to the most conventional 'ABC' keyboard.N
    corecore