From poup@mic.atr.co.jp Fri Oct 9 06:04:36 1998 Received: from burdell.cc.gatech.edu (root@burdell.cc.gatech.edu [130.207.3.207]) by lennon.cc.gatech.edu (8.9.1/8.9.1) with ESMTP id GAA13563 for ; Fri, 9 Oct 1998 06:04:33 -0400 (EDT) Received: from mailhost.mic.atr.co.jp (mic.atr.co.jp [133.186.20.201]) by burdell.cc.gatech.edu (8.9.1/8.9.1) with ESMTP id GAA26323 for ; Fri, 9 Oct 1998 06:06:53 -0400 (EDT) Received: from pop.mic.atr.co.jp by mailhost.mic.atr.co.jp (8.9.1+3.1W/3.7W) id TAA23641; Fri, 9 Oct 1998 19:06:21 +0900 (JST) Received: from mic.atr.co.jp by pop.mic.atr.co.jp (8.8.8+2.7Wbeta7/3.6W04/07/98) id TAA09435; Fri, 9 Oct 1998 19:06:20 +0900 (JST) Message-ID: <361DDFAE.DBBB375E@mic.atr.co.jp> Date: Fri, 09 Oct 1998 19:04:30 +0900 From: Ivan Poupyrev Organization: ATR International X-Mailer: Mozilla 4.05 [en] (Win95; I) MIME-Version: 1.0 To: Doug Bowman CC: 3D UI List <3d-ui@hitl.washington.edu> Subject: Multidimentional feedback (was: Chat notes) References: <199810061451.KAA10998@lennon.cc.gatech.edu> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Status: RO It seems that a lot of guidlines for 3DUI can be taken/borrowed from the old and new human factors literature, after all it deals with very similar problems we have in VR. For example, in the design of tools and controls there is a notion of the multidimensionality of feedabacks which are classified as reactive feedback (feedback from our visual, auditory, kinesthetic and proprioceptive senses while we perform operation), instrumental feedback (feedback from the instruments such as movement of a pen tip while writing) and operational feedback (result of the operation, progress of the task such as ink coming out from pen when we write). It has been shown that using all 3 types of feedback resulted in maximum of performance. It also has been shown that instrumental feedback was more important then operational feedback for some tasks. A number of principles has been suggested such as: * principle of multidimensionality (use all 3 feedbacks) * principle of spatial/temporoal compliance (for example a control should move at the same time as you feel it moving, which often is not the case in VR) For 3D user interfaces I would also add: * principle of consistency between feedbacks (make sure that when user feels that real hand moves forward (reactive feedback), he/she does not see virtual hand moving backward (instrumental feedback)); * principle of sensory substitution for feedbacks (for example, since we can not have haptic feedback when touching objects in VR, we need to highlight them, i.e. substitute with vision, or give a bipping sound, i.e. substitute with auditory senses, when user "touches" them); * anything else? Many of these came up when we were working on immersive handwriting. For example in the first version of Virtual Notepad the virtual pen was disappearing after user lifted a real pen from the tablet (since we could not read position of real pen). As result it was absolutely impossible to write, because user could not specify the initial position for the new stroke and, since you are in HMD, you can not see the real pen. Though even if you could see it it would not help becasue virtual paper and real tablet had different sizes and shapes and predict where virtual pen would write by looking at the real tablet was impossible. We solved this problem when we realised that Wacom tabelets could read the pen even if it does not touch the tablet but close to it. I wonder if anybody had done any work along these lines in VR or user interfaces? I would be very interested to look at papers. For paper on multidimensional feedback in tool design check Smith, T. Feedback-control mechanisms of human behavior. In Handbook of human factors, G. Salvendy, Editor. 1987 John Wiley and Sons, pp. 251-286 Ivan -- Ivan Poupyrev [poup@mic.atr.co.jp/poup@hitl.washington.edu] Researcher, MIC Labs, ATR International, Japan 0774-951432] Ph. D. Candidate, ISL, Hiroshima University, Japan 0824-212959] Visiting Scientist, HITL, University of Washington, US 206-6161474] http://www.hitl.washington.edu/people/poup]