• GECO: A Real-Time Computer Vis...

Treffer: GECO: A Real-Time Computer Vision-Assisted Gesture Controller for Advanced IoT Home System.

Title:
GECO: A Real-Time Computer Vision-Assisted Gesture Controller for Advanced IoT Home System.
Authors:
Lopes MC; Inatel Competence Center (ICC), National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil., Silva PA; Critical Telecommunications and IoT Infrastructure Laboratory (CTIoT Lab.) and Cyber Security Center (Centro de Segurança Cibernética do Inatel-CxSC Telecom), Department of Telecommunication, National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil., Marenco L; Devlane, Luis Alberto de Herrera 1248, Montevideo 11300, Uruguay.; Future Technologies Development Center, Rua Doutor Gilberto Studart 55, Fortaleza 60192-105, CE, Brazil., Vilas Boas EC; Critical Telecommunications and IoT Infrastructure Laboratory (CTIoT Lab.) and Cyber Security Center (Centro de Segurança Cibernética do Inatel-CxSC Telecom), Department of Telecommunication, National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil., Carvalho JGA; Critical Telecommunications and IoT Infrastructure Laboratory (CTIoT Lab.) and Cyber Security Center (Centro de Segurança Cibernética do Inatel-CxSC Telecom), Department of Telecommunication, National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil., Ferreira CA; Inatel Competence Center (ICC), National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil., Carvalho ALO; Inatel Competence Center (ICC), National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil., Guimarães CVR; Inatel Competence Center (ICC), National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil., Aquino GP; Critical Telecommunications and IoT Infrastructure Laboratory (CTIoT Lab.) and Cyber Security Center (Centro de Segurança Cibernética do Inatel-CxSC Telecom), Department of Telecommunication, National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil., P de Figueiredo FA; Wireless and Artificial Intelligence Laboratory (WAI Lab.), Departament of Telecommunication, National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil.
Source:
Sensors (Basel, Switzerland) [Sensors (Basel)] 2025 Dec 21; Vol. 26 (1). Date of Electronic Publication: 2025 Dec 21.
Publication Type:
Journal Article
Language:
English
Journal Info:
Publisher: MDPI Country of Publication: Switzerland NLM ID: 101204366 Publication Model: Electronic Cited Medium: Internet ISSN: 1424-8220 (Electronic) Linking ISSN: 14248220 NLM ISO Abbreviation: Sensors (Basel) Subsets: MEDLINE
Imprint Name(s):
Original Publication: Basel, Switzerland : MDPI, c2000-
MeSH Terms:
Gestures* , Internet of Things*, Humans ; Artificial Intelligence ; User-Computer Interface ; Male ; Female ; Computer Systems ; Adult
References:
Sensors (Basel). 2023 Aug 30;23(17):. (PMID: 37687978)
Sensors (Basel). 2024 Nov 10;24(22):. (PMID: 39598974)
IoTDI 2017 (2017). 2017 Apr;2017:47-58. (PMID: 29683151)
Sensors (Basel). 2024 Apr 10;24(8):. (PMID: 38676024)
Sci Rep. 2025 May 1;15(1):15284. (PMID: 40312474)
PLoS One. 2025 Apr 24;20(4):e0319996. (PMID: 40273209)
Sensors (Basel). 2025 Jan 06;25(1):. (PMID: 39797073)
Nat Methods. 2020 Mar;17(3):261-272. (PMID: 32015543)
Grant Information:
APQ-04523-23 Fundação de Amparo à Pesquisa do Estado de Minas Gerais
Contributed Indexing:
Keywords: MediaPipe framework; gesture control; home automation; internet of things; smart home
Entry Date(s):
Date Created: 20260110 Date Completed: 20260110 Latest Revision: 20260113
Update Code:
20260113
PubMed Central ID:
PMC12788043
DOI:
10.3390/s26010061
PMID:
41516496
Database:
MEDLINE

Weitere Informationen

This paper introduces GECO, a real-time, computer vision-assisted gesture controller for IoT-based smart home systems. The platform uses a markerless MediaPipe interface that combines gesture-driven navigation and command execution, enabling intuitive control of multiple domestic devices. The system integrates binary and analog gestures, such as continuous light dimming based on thumb-index angles, while operating on-device through a private MQTT network. Technical evaluations across multiple Android devices have demonstrated ultra-low latency times (<50 ms), enabling real-time responsiveness. A user experience study with seventeen participants reported high intuitiveness (9.5/10), gesture accuracy (9.2/10), and perceived inclusivity, mainly for individuals with speech impairments and low technological literacy. These results position GECO as a lightweight, accessible, and privacy-preserving interaction framework, advancing the integration of artificial intelligence and IoT within smart home environments.