Share Email Print

Proceedings Paper

Sculpting 3D worlds with music: advanced texturing techniques
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Sound within the virtual environment is often considered to be secondary to the graphics. In a typical scenario, either audio cues are locally associated with specific 3D objects or a general aural ambiance is supplied in order to alleviate the sterility of an artificial experience. This paper discusses a completely different approach, in which cues are extracted from live or recorded music in order to create geometry and control object behaviors within a computer- generated environment. Advanced texturing techniques used to generate complex stereoscopic images are also discussed. By analyzing music for standard audio characteristics such as rhythm and frequency, information is extracted and repackaged for processing. With the Soundsculpt Toolkit, this data is mapped onto individual objects within the virtual environment, along with one or more predetermined behaviors. Mapping decisions are implemented with a user definable schedule and are based on the aesthetic requirements of directors and designers. This provides for visually active, immersive environments in which virtual objects behave in real-time correlation with the music. The resulting music-driven virtual reality opens up several possibilities for new types of artistic and entertainment experiences, such as fully immersive 3D `music videos' and interactive landscapes for live performance.

Paper Details

Date Published: 10 April 1996
PDF: 10 pages
Proc. SPIE 2653, Stereoscopic Displays and Virtual Reality Systems III, (10 April 1996); doi: 10.1117/12.237453
Show Author Affiliations
Christian Greuel, Fakespace, Inc. (United States)
Mark T. Bolas, Fakespace, Inc. (United States)
Niko Bolas, Fakespace, Inc. (United States)
Ian E. McDowall, Fakespace, Inc. (United States)

Published in SPIE Proceedings Vol. 2653:
Stereoscopic Displays and Virtual Reality Systems III
Mark T. Bolas; Mark T. Bolas; Scott S. Fisher; Scott S. Fisher; John O. Merritt, Editor(s)

© SPIE. Terms of Use
Back to Top