As a result of the dramatic improvements in the resolution, wearability, and weight of head-mounted displays (HMDs), they have become increasingly applied in the medical field as personal imaging monitors. The combined use of a multiplexer with an HMD allows the wearer to simultaneously and seamlessly monitor multiple streams of imaging information through the HMD. We developed a multitask imaging monitor for surgical navigation by combining a touchless surgical imaging control system with an HMD. This system is composed of a standard color digital video camera mounted on the HMD and computer software that enables the identification of the number of pictured fingertips from the video camera image. The HMD wearer uses this information as a touchless interface for the operating multiplexer, which can control the arrays and types of imaging information displayed on the HMD. We used this system in an experimental demonstration during a single-port gasless partial nephrectomy. The use of this multitask imaging monitor using a touchless interface would refine the surgical workflow, especially during surgical navigation.

Keywords:
Endoscopes, Signal processing, Data display
1.
Kihara K, Fujii Y, Masuda H, Saito K, Koga F, Matsuoka Y, Numao N, Kojima K: New three-dimensional head-mounted display system, TMDU-S-3D system, for minimally invasive surgery application: procedures for gasless single-port radical nephrectomy. Int J Urol 2012;19:886-889.
2.
Kihara K, Saito K, Komai Y, Fujii Y: Integrated image monitoring system using head-mounted display for gasless single-port clampless partial nephrectomy. Wideochir Inne Tech Malo Inwazyjne 2014;9:634-637.
3.
Fujii Y, Kihara K, Yoshida S, Ishioka J, Matsuoka Y, Numao N, Saito K: A three-dimensional head-mounted display system (RoboSurgeon system) for gasless laparoendoscopic single-port partial cystectomy. Wideochir Inne Tech Malo Inwazyjne 2014;9:638-643.
4.
Yoshida S, Kihara K, Takeshita H, Nakanishi Y, Kijima T, Ishioka J, Matsuoka Y, Numao N, Saito K, Fujii Y: Head-mounted display for a personal integrated image monitoring system: ureteral stent placement. Urol Int 2015;94:117-120.
5.
Yoshida S, Kihara K, Takeshita H, Fujii Y: Instructive head-mounted display system: pointing device using a vision-based finger tracking technique applied to surgical education. Wideochir Inne Tech Malo Inwazyjne 2014;9:449-452.
6.
Kihara K, Koga F, Fujii Y, Masuda M, Tatokoro M, Yokoyama M, Matsuoka Y, Numao N, Ishioka J, Saito K: Gasless laparoendoscopic single-port clampless sutureless partial nephrectomy for peripheral renal tumors: perioperative outcomes. Int J Urol 2015;22:349-355.
7.
Ruppert GC, Reis LO, Amorim PH, de Moraes TF, da Silva JV: Touchless gesture user interface for interactive image visualization in urological surgery. World J Urol 2012;30:687-691.
8.
Hartmann F, Schlaefer A: Feasibility of touch-less control of operating room lights. Int J Comput Assist Radiol Surg 2013;8:259-268.
9.
Anacleto J, Fels S, Silvestre R: Transforming a paper based process to a natural user interfaces process in a Chronic Care Hospital. Procedia Comput Sci 2012;14:173-180.
10.
Liu CC, Chang CH, Su MC, Chu HT, Hung SH, Wong JM, Wang PC: RFID-initiated workflow control to facilitate patient safety and utilization efficiency in operation theater. Comput Methods Programs Biomed 2011;104:435-442.
© 2015 S. Karger AG, Basel
2015
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.