HoloSketch: a virtual reality sketching/animation tool

by Michael F. Deering
Sun Microsystems Computer Corporation

Holosketch is an attempt at creating a 3D modeling and animation interface that provides a more direct form of control over the 3D models. It uses stereo shutter glasses with a CRT display refreshing at 112.9 Hz. The glasses alternatively block each eye so each eye gets its own display, so to speak. This way, the user perceives the 3D models in 3D. A six-axis mouse is used to try to provide a direct method of manipulation in an attempt to improve upon the 2D mouse and its approximation of 3D manipulation. The head position is also tracked, so that moving around the 3D object, to some degree, gives an alternate view of the object, similar to the real world.

The Holosketch system allows creation of simple 3D primitives and incorporates simple animation gadgets to allow novice users to create models and animations easily. A keyboard is used in conjunction with the 3D mouse, or "wand," as it is referred to. In some modes, the conventional mouse is used in conjunction with the 3D mouse.

The menu system was reworked for the Holosketch project. Since the interface is 3-dimensional, a conventional menu system would be visually intrusive and take away valuable rendering time for the 3D geometry, since it has to be rendered in real time and the computer's processing power was much more limited back in the mid 1990s. The new 3D menu system is similar to a context menu. It is a radial menu containing many options which are selected with the wand.

Instead of a traditional user study involving multiple participants performing specific tasks, an artist was employed to use the system for a month and give feedback. She responded positively, only complaining about a few minor interaction issues. It reportedly took a few days to learn how to use the system well. It was determined that novices would be able to pick up the system quickly.

------------

I like the attempt at a direct 3D manipulation. Using the six-axis mouse looks like it would perform better than the 2D mouse. Sometimes unexpected things happen when manipulating 3D models with a conventional mouse. I also like the head movement to alter the models.

It is really interesting that this work was done so long ago. I would like to see a modern instantiation of this research in combination with some of the other work we have seen. If we could incorporate Holosketch with Vogel's work with the freehand pointing and MIT's BiDi screen that allows are hand gestures, we could have a 3D modeling system in which you can reach out and grab the 3D model with your bare hand and manipulate it (someone please tell me if this exists).

Comments: Kevin, Josh, Franck, Paul

4 comments of glory:

J.M. Peschel said...

Good idea about the combination of the different technologies. Maybe we can do someting with the pen we have?

M Russell said...

Having spent a lot of time drawing CAD models in 2D from some angles shapes particularly frameworks can start turning inside out. I was particularly impressed with the meticulous attention to detail where with head tracking and dynamic interocular calibration the user could hold up a ruler to any side of the object independent of head position.

Kevin said...

I was also surprised that this paper was written over a decade ago. I wonder if they continued their work. and I agree it would be interesting to see how it would interact with some other technology that has been done in recent years.

Sashikanth said...

I really like the idea of using free hand gestures in a VR context, the gloves would obviously be an exciting blend with this technology. It would not only reduce the need for menu items, but also remove the need for having to use keyboard modifiers. The Non-Dominant Hand (NDH) has been shown to be great for framing the context of interaction (think positioning paper while using a pen).

Post a Comment