Naslov
Do We Have “Biomechanics” Of the New Era in Our Personalized Contactless Hand-Gesture Non-Invasive Surgeon-Computer Interaction?

Autori
Klapan, Ivica ; Žagar, Martin ; Majhen, Zlatko ; Klapan, Lea ; Trampuš, Zlatko

Izvornik
Journal of Biomedical Science and Research (2582-077X) 3 (2021), 2; 1-6

Vrsta, podvrsta i kategorija rada
Radovi u časopisima, članak, znanstveni

Ključne riječi
Augmented reality ; Gesture control ; Virtual surgery ; Voice commands ; Navigation surgery ; 3D volume rendering

Sažetak
In this paper, we propose and analyze the novel approach for contactless surgery. The base of contactless surgery is the system for motion tracking. For motion tracking, we use a complex stereo vision depth camera system. Once having the patient data, by using the VR techniques and depth tracking cameras, it is possible to analyze and segment the region of interest in pre-operative preparation. Using a depth tracking camera enables an operation to be simulated, and the outcome is viewed and analyzed before the patient undergoes surgery in the same environment as in the real surgery. This enables medical specialists to optimize their surgical approaches. We think specific VR/AR technologies and approaches should be incorporated, such as analyzing 3D workflow and 3D virtual scene so medical specialists would be able to make the most of the benefits during the surgery. A VR-based application is useful due to avoiding any dangers for the patients. Training applications usually have an elevation part for any step of training. However, the main challenge is to produce a step with adequate fidelity to be simulated like what is performing on the patients. The other ability of training and education simulators is preparing a situation for research surgeons to simply practice what has been suggested by other colleagues and even reading from websites.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo, Interdisciplinarne biotehničke znanosti, Biotehnologija u biomedicini (prirodno područje, biomedicina i zdravstvo, biotehničko područje)

POVEZANOST RADA