Contagious infection-free medical interaction system with machine vision controlled by remote hand gesture during an operation
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Truong, Van Doi | - |
dc.contributor.author | Lim, Hyun-Kyo | - |
dc.contributor.author | Kim, Seongje | - |
dc.contributor.author | Dat, Than Trong Khanh | - |
dc.contributor.author | Yoon, Jonghun | - |
dc.date.accessioned | 2024-05-31T07:00:28Z | - |
dc.date.available | 2024-05-31T07:00:28Z | - |
dc.date.issued | 2024-12 | - |
dc.identifier.issn | 2001-0370 | - |
dc.identifier.issn | 2001-0370 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/119208 | - |
dc.description.abstract | Background and objective: Medical image visualization is a requirement in many types of surgery such as orthopaedic, spinal, thoracic procedures or tumour resection to eliminate risk such as “wrong level surgery”. However, direct contact with physical devices such as mice or touch screens to control images is a challenge because of the potential risk of infection. To prevent the spread of infection in sterile environments, a contagious infection-free medical interaction system has been developed for manipulating medical images. Methods: We proposed an integrated system with three key modules: hand landmark detection, hand pointing, and hand gesture recognition. A proposed depth enhancement algorithm is combined with a deep learning hand landmark detector to generate hand landmarks. Based on the designed system, a proposed hand-pointing system combined with projection and ray-pointing techniques allows for reducing fatigue during manipulation. A proposed landmark geometry constraint algorithm and deep learning method were applied to detect six gestures including click, open, close, zoom, drag, and rotation. Additionally, a control menu was developed to effectively activate common functions. Results: The proposed hand-pointing system allowed for a large control range of up to 1200 mm in both vertical and horizontal direction. The proposed hand gesture recognition method showed high accuracy of over 97% and real-time response. Conclusion: This paper described the contagious infection-free medical interaction system that enables precise and effective manipulation of medical images within the large control range, while minimizing hand fatigue. © 2024 The Authors | - |
dc.format.extent | 11 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Elsevier B.V. | - |
dc.title | Contagious infection-free medical interaction system with machine vision controlled by remote hand gesture during an operation | - |
dc.type | Article | - |
dc.publisher.location | 네델란드 | - |
dc.identifier.doi | 10.1016/j.csbj.2024.05.006 | - |
dc.identifier.scopusid | 2-s2.0-85193471870 | - |
dc.identifier.bibliographicCitation | Computational and Structural Biotechnology Journal, v.24, pp 393 - 403 | - |
dc.citation.title | Computational and Structural Biotechnology Journal | - |
dc.citation.volume | 24 | - |
dc.citation.startPage | 393 | - |
dc.citation.endPage | 403 | - |
dc.type.docType | Article | - |
dc.description.isOpenAccess | Y | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.subject.keywordAuthor | Contactless | - |
dc.subject.keywordAuthor | Gesture recognition | - |
dc.subject.keywordAuthor | Human-machine interaction | - |
dc.subject.keywordAuthor | Pointing technique | - |
dc.subject.keywordAuthor | Sterile environment | - |
dc.identifier.url | https://www.sciencedirect.com/science/article/pii/S2001037024001521?via%3Dihub | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
55 Hanyangdeahak-ro, Sangnok-gu, Ansan, Gyeonggi-do, 15588, Korea+82-31-400-4269 sweetbrain@hanyang.ac.kr
COPYRIGHT © 2021 HANYANG UNIVERSITY. ALL RIGHTS RESERVED.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.