Award Abstract # 0321377
Acquisition of Equipment for Distributed Immersive Performance

NSF Org: CNS
Division Of Computer and Network Systems
Recipient: UNIVERSITY OF SOUTHERN CALIFORNIA
Initial Amendment Date: August 13, 2003
Latest Amendment Date: August 29, 2006
Award Number: 0321377
Award Instrument: Standard Grant
Program Manager: Rita Rodriguez
CNS
 Division Of Computer and Network Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: September 1, 2003
End Date: August 31, 2008 (Estimated)
Total Intended Award Amount: $0.00
Total Awarded Amount to Date: $400,000.00
Funds Obligated to Date: FY 2003 = $400,000.00
History of Investigator:
  • Alexander Sawchuk (Principal Investigator)
    sawchuk@sipi.usc.edu
Recipient Sponsored Research Office: University of Southern California
3720 S FLOWER ST FL 3
LOS ANGELES
CA  US  90033
(213)740-7762
Sponsor Congressional District: 34
Primary Place of Performance: University of Southern California
3720 S FLOWER ST FL 3
LOS ANGELES
CA  US  90033
Primary Place of Performance
Congressional District:
34
Unique Entity Identifier (UEI): G88KLJR3KYT5
Parent UEI:
NSF Program(s): Major Research Instrumentation
Primary Program Source: app-0103 
Program Reference Code(s): 1189, 9218, HPCC
Program Element Code(s): 118900
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

This project, developing the technology for Distributed Immersive Performance (DIP), deals with live, interactive musical performances in which participants in different physical locations are interconnected by very high fidelity multichannel audio and video links. DIP, a specialized realization of broader immersive technology, creates the complete aural and visual ambience that places a group in a virtual space to experience events occurring at a remote site or communicate naturally regardless of location. The assembled DIP experimental system will have three sites in different locations on the USC campus. The sites will have different types of equipment to test the effects of video and audio fidelity on the ease of use and functionality of different applications. Two will have high-definition (HD) video or digital video (DV) quality images projected onto wide screen wall displays completely integrated with an immersive audio reproduction system for a seamless, fully 3-dimensional aural environment with the correct spatial sound localization for participants. The system will be capable of storage and playback of the many streams of synchronized audio and video data (immersidata) and will utilize novel protocols for the low-latency, seamless, synchronized real-time delivery of immersidata over local-area and wide-area networks such as Internet. Partners in the project include New World Symphony (NWS) of Miami Beach, University of Maryland, and Georgia Tech. The latter two contribute the Internet2 infrastructure as server sites. The enabled research addresses the following challenges:
Low latency continuous media (CM) stream transmission, synchronization and data loss management
Low latency, real-time video and multichannel immersive audio acquisition and rendering
Real-time continuous media stream recording, storage, playback
Human factor studies: psychophysical, perceptual, artistic, performance evaluation
Robust integration of all these technical areas into seamless presentation to participants
Students participate in the assembly, integration, testing, and research applications using the DIP system via thesis research, directed research projects, and classroom work. Offering an opportunity for students to receive a broad cross-disciplinary education in media systems engineering, undergraduate engineering majors from USC and CSULA are invited to participate.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 25)
A.A. Sawchuk, E. Chew, R. Zimmermann, C. Papadopoulos, and C. Kyriakakis "Distributed Immersive Performance" Proceedings of the Corporation of Education Networks in California (CENIC 2004) Meeting, Marina del Rey, CA , 2004
A.A. Sawchuk, E. Chew, R. Zimmermann, C. Papadopoulos, and C. Kyriakakis "From Remote Media Immersion to Distributed Immersive Performance" Proceedings of the ACM SIGMM 2003 Workshop on Experiential Telepresence (ETP 2003) , 2003
Alpaslan, Z., Yeh, S.C., Rizzo, A., Sawchuk "A Quantitative Comparison of Interaction with Shutter Glasses and Autostereoscopic Displays" Stereoscopic Displays and Virtual Reality Systems XII Symposium, Proc. SPIE , v.5664 , 2005
Alpaslan, Z., Yeh, S.C., Rizzo, A., Sawchuk "Human Performance Engineering: Quantitative Comparison of Interaction with Shutter Glasses and Autostereoscopic Displays" Stereoscopic Displays and Virtual Reality Systems XII Symposium, (San Jose, CA; January 2006 , 2006
D. Cantzos, A. Mouchtaris, and C. Kyriakakis "Enhanced Multichannel Audio Resynthesis through Residual Processing and Features Alignment" Proceedings of the 2007 International Conference on Multimedia and Expo (ICME 07) , 2007
E. Chew, A.A. Sawchuk, C. Tanoue, R. Zimmermann "Segmental Tempo Analysis of Performances in Performer-Centered Experiments in the Distributed Immersive Performance Project" Sound and Music Computing '05 International Conference, Salerno, Italy (SMC'05) , 2005
E. Chew, A.A. Sawchuk, R. Zimmermann "Distributed Immersive Performance: Ameliorating the Psychophysical Effects of Network Latency" Proceedings of the Corporation of Education Networks in California (CENIC 2005) Meeting, Marina del Rey, CA , 2005
E. Chew, A.A. Sawchuk, R. Zimmerman, the Tosheff Piano Duo (V. Stoyanova and I. Tosheff), C. Kyriakakis, C. Papadopoulos, A. R. J. François, A. Volk "Distributed Immersive Performance" Proceedings of the 2004 Annual National Association of the Schools of Music (NASM 2004) Meeting, San Diego , 2004
E. Chew, R. Zimmermann, A.A. Sawchuk, C. Kyriakakis, C. Papadopoulos, A.R.J. François, G. Kim, A. Rizzo, A. and A. Volk "Musical Interaction at a Distance: Distributed Immersive Performance" Proceedings of the 4th Open Workshop of MUSICNETWORK: Integration of Music in Multimedia Applications (MUSICNETWORK 2004 ), Barcelona , 2004
E. Chew, R. Zimmermann, A.A. Sawchuk, C. Papadopoulos, C. Kyriakakis, C. Tanoue, D. Desai, M. Pawar, R. Sinha, W. Meyer "A Second Report on the User Experiments in the Distributed Immersive Performance Project" Proceedings of the 5th Open Workshop of MUSICNETWORK: Integration of Music in Multimedia Applications (MUSICNETWORK 2005) , 2005
J. Peterson and C. Kyriakakis "Analysis of Fast Localization Algorithms for Acoustical Environments" 39th IEEE Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA , 2005
(Showing: 1 - 10 of 25)

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page