Journal article 103 views 26 downloads
GestureMoRo: an algorithm for autonomous mobile robot teleoperation based on gesture recognition
,
Ashraf Fahmy Abdo ,
Johann Sienz
Scientific Reports, Volume: 14, Issue: 1
Swansea University Authors:
Chunxu Li , Ashraf Fahmy Abdo , Johann Sienz
-
PDF | Version of Record
Distributed under the terms of a Creative Commons Attribution 4.0 CC-BY licence.
Download (4.05MB)
DOI (Published version): 10.1038/s41598-024-54488-w
Abstract
Gestures are a common way people communicate. Gesture-based teleoperation control systems tend to be simple to operate and suitable for most people’s daily use. This paper employed a LeapMotion sensor to develop a mobile robot control system based on gesture recognition, which mainly established con...
| Published in: | Scientific Reports |
|---|---|
| ISSN: | 2045-2322 |
| Published: |
Springer Science and Business Media LLC
2024
|
| Online Access: |
Check full text
|
| URI: | https://cronfa.swan.ac.uk/Record/cronfa66028 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract: |
Gestures are a common way people communicate. Gesture-based teleoperation control systems tend to be simple to operate and suitable for most people’s daily use. This paper employed a LeapMotion sensor to develop a mobile robot control system based on gesture recognition, which mainly established connections through a client/server structure. The principles of gesture recognition in the system were studied and the relevant self-investigated algorithms—GestureMoRo, for the association between gestures and mobile robots were designed. Moreover, in order to avoid the unstably fluctuated movement of the mobile robot caused by palm shaking, the Gaussian filter algorithm was used to smooth and denoise the collected gesture data, which effectively improved the robustness and stability of the mobile robot’s locomotion. Finally, the teleoperation control strategy of the gesture to the WATER2 mobile robot was realized, and the effectiveness and practicability of the designed system were verified through multiple experiments. |
|---|---|
| Keywords: |
GestureMoRo, Gesture recognition, LeapMotion, Mobile robot, Teleoperation, Gaussian filter |
| College: |
Faculty of Science and Engineering |
| Funders: |
Swansea University |
| Issue: |
1 |