3D User Interfaces : Theory and Practice

The first book covering the state of the art in 3D Interfaces, providing guidelines and practical examples for both design and evaluation.

Doug A. Bowman is an assistant professor of computer science at Virginia Tech Ernst Kruijff is a researcher at the Fraunhofer Institute for Media Communication in Germany Joseph J. Laviola, Jr., is currently working on obtaining his Ph.D. in computer science at Brown University Ivan Poupyrev is a researcher at the Interaction Laboratory, Sony Computer Science Labs in Tokyo

An architect sits in her home office, putting the final touches on the design of the new entrance to the city park. A three-dimensional virtual model of the park appears in front of her on the desk's surface. She nudges a pathway slightly to the right to avoid a low-lying area, and then makes the model life-size so she can walk along the path to view the effect. "Those dark colors on the sign at the entrance are too foreboding," she thinks, so she quickly changes the color palette to brighter primary colors. She looks up and notices that the clients are arriving for the final design review meeting. They are located in other offices around the city, but they can all view the 3D model and make suggested changes, as well as communicate with one another. "What's the construction plan?" asks one of the clients. The architect starts an animation showing the progress of the project from start to finish. "That first step may not work," says the client. "The excavation is much too close to the existing playground. Let me show you." He looks out his window, which has a view of the park, and overlays the virtual construction plan on it. "You're right," says the architect, "let's plan to move the playground slightlythat will be much cheaper than changing the construction site." After viewing the effects of the change, all agree that this plan will work, and the meeting adjourns. This scenario and others like it illustrate the enormous potential of 3D environments and applications. The technology to realize such a vision is available now, although it will certainly be improved. But the scenario also leaves out a great deal of informationinformation that is crucial to making this dream a reality. How did the architect load the park model, and how does she manipulate her view of it? What technique is used to change the pathway? How can multiple clients all manipulate the model at the same time? How do the participants appear to each other in the virtual space? How is the speed and playback of the animation controlled? How did the client instruct the system to merge the real and virtual scenes? These questions all relate to the design of theuser interface(UI) andinteraction techniquesfor this 3D application, an area that is usually given only a cursory treatment in futuristic films and books. The scenarios usually either assume that all interaction between the user and the system will be "natural"based on techniques like intuitive gestures and speechor "automatic"the system will be so intelligent that it will deduce the user's intentions. But is this type of interaction realistic, or even desirable? This book addresses the critical area of3D UI designa field that seeks to answer detailed questions, like those above, that make the difference between a 3D system that is usable and efficient and one that causes user frustration, errors, and even physical discomfort. We present practical information for developers, the latest research results, easy-to-follow guidelines for the UI designer, and relevant application examples. Although there are quite a few books devoted to UIs in general and to 2D UI design in particular, 3D UIs have received significantly less attention. The results of work in the field are scattered throughout numerous conference proceedings, journal articles, single book chapters, and Web sites. This field deserves a reference and educational text that integrates the best practices and state-of-the-art research, and that's why this book was created. How This Book Came to Be The story of this book begins in April 1998, when Ivan Poupyrev and Doug Bowman were doctoral students at Hiroshima Unive