Jeremy R. Cooperstock - Director, Shared Reality Lab
Jeremy

My lab is broadly concerned with human-computer interaction technologies, emphasizing multimodal sensory augmentation for communication in both co-present and distributed contexts. Our research tackles the full pipeline of sensory input, analysis, encoding, data distribution, and rendering, as well as interaction capabilities and quality of user experience. Applications of these efforts include distributed training of medical and music students, augmented environmental awareness for the blind community, treatment of lazy eye syndrome, ocean science observation, highly accurate face and affective state recognition, low-latency uncompressed HD videoconferencing and a variety of multimodal immersive simulation experiences. Most of our research takes place within the Shared Reality Environment, a facility that includes two different configurations of multi-projector displays, camera and loudspeaker arrays, and a high-fidelity vibrotactile sensing and actuated floor.

BIO · Jeremy Cooperstock (Ph.D., University of Toronto, 1996) is an associate professor in the department of Electrical and Computer Engineering, a member of the Centre for Intelligent Machines, and a founding member of the Centre for Interdisciplinary Research in Music Media and Technology at McGill University. He directs the Shared Reality Lab, which focuses on computer mediation to facilitate high-fidelity human communication and the synthesis of perceptually engaging, multimodal, immersive environments, and also leads the theme of Enabling Technologies for a new Networks of Centres of Excellence on Graphics, Animation, and New Media (GRAND). Cooperstock's accomplishments include the Intelligent Classroom, the world's first Internet streaming demonstrations of Dolby Digital 5.1, uncompressed 12-channel 96kHz/24bit, multichannel DSD audio, and multiple simultaneous streams of uncompressed high-definition video, and a simulation environment that renders graphic, audio, and vibrotactile effects in response to footsteps. His work on the Ultra-Videoconferencing system was recognized by an award for Most Innovative Use of New Technology from ACM/IEEE Supercomputing and a Distinction Award from the Audio Engineering Society. Cooperstock has worked with IBM at the Haifa Research Center, Israel, and the T.J. Watson Research Center in Yorktown Heights, New York, the Sony Computer Science Laboratory in Tokyo, Japan, and was a visiting professor at Bang & Olufsen, Denmark, where he conducted research on telepresence technologies as part of the World Opera Project. He chaired the Audio Engineering Society (AES) Technical Committee on Network Audio Systems from 2001 to 2009 and is currently an associate editor of the Journal of the AES. (FULL CV AVAILABLE)

selected papers
Blum, J., Bouchard, M., and Cooperstock, J.R. (2011).
What's around me? Spatialized audio augmented reality for blind users with a smartphone
Mobile and Ubiquitous Systems (Mobiquitous)    BEST PAPER AWARD
design of a mobile system to provide environmental awareness to the visually impaired community
Visell, Y., Giordano, B.L., Millet, G., and Cooperstock, J.R. (2011).
Vibration Influences Haptic Perception of Surface Compliance During Walking
PLoS ONE
investigation of how the perception of ground surface compliance is altered by plantar vibration feedback
Cooperstock, J.R. (2011).
Multimodal Telepresence Systems
IEEE Signal Processing Magazine, Special Issue on Immersive Communications
overview of multimodal signal acquisition, processing, transport, and rendering technologies for next generation telepresence systems
To, L., Thompson, B., Blum, J.R., Maehara, G., Hess, R., and Cooperstock, J.R. (2011).
A game platform for treatment of amblyopia
IEEE Transactions on Neural Systems and Rehabilitation Engineering
describes development of a prototype device for take-home use that can be used in the treatment of amblyopia; despite training being relatively intermittent throughout the week, significant improvements were observed
Olmos, A., Lachapelle, K., and Cooperstock, J.R. (2010).
Multiple Angle Viewer for Remote Medical Training
ACM Workshop on Multimedia Technologies for Distance Leaning
design of an interface for a camera array that will enable the mentoring and monitoring of dissections and surgical procedures for medical instructors and students
Ellaway, R., Cooperstock, J.R., and Spencer, B. (2010).
Simulation Integration for Healthcare Education, Training and Assessment
Digital Information Management
the Health Services Virtual Organization (HSVO) Project has developed a network-enabled platform (NEP) that allows web devices to be coordinated, to talk to each other, to control each other, to use services from elsewhere, to use each other as services
Rajalingham, R., Visell, Y. and Cooperstock, J.R. (2010).
Probabilistic Tracking of Pedestrian Movements via In-Floor Force Sensing.
Canadian Conference on Computer and Robot Vision
a probabilistic approach to the tracking and estimation of the lower body posture of users moving on foot over an instrumented floor surface; we use this data to track body posture in 3D space using Bayesian filters with a switching state-space model
Visell, Y. and Cooperstock, J.R. (2010).
Design of a Vibrotactile Display via a Rigid Surface
IEEE Haptics Symposium    BEST PAPER AWARD
analysis, optimized redesign and evaluation of a high fidelity vibrotactile interface integrated in a rigid surface
Visell, Y., Law, A., Ip, J., Smith, S. and Cooperstock, J.R. (2010).
Interaction Capture in Immersive Virtual Environments via an Intelligent Floor Surface
IEEE Virtual Reality
techniques to enable users to interact on foot with simulated natural ground surfaces in immersive virtual environments
Visell, Y., Smith, S., Law, A., Rajalingham, R., and Cooperstock, J.R. (2010).
Contact Sensing and Interaction Techniques for a Distributed, Multimodal Floor Display
IEEE 3D User Interfaces
novel interface and set of techniques enabling users to interact via the feet with augmented floor surfaces
Olmos, A, Brulé, M., Bouillot, N., Benovoy, M., Blum, J., Sun, H., Lund, N.W., and Cooperstock, J.R. (2009)
Exploring the role of latency and orchestra placement on the networked performance of a distributed opera
Presence
Can opera be performed if the singers are standing on different stages in different countries?
Cooperstock, J.R. (2008)
Human-Computer Interaction
Chapter in Wiley Encyclopedia of Computer Science and Engineering, ISBN 978-0-471-38393-2, Benjamin W. Wah, ed., Vol. 3, 1529-1542.
A tutorial overview of the field of HCI, including history, use and context, human characteristics, usability principles, design and evaluation principles, interaction paradigms, related domains, risks of computer technology, and challenges ahead.
FULL PUBLICATIONS LIST
teaching
winter 2011ECSE424 · Human-Computer Interaction
Wednesday & Friday, 16:05 –17:25 · ENGTR 2110
ECSE526 · Artificial Intelligence
Monday & Wednesday, 11:35 – 12:55 ·  ENGTR 2120
EARLIER COURSES
recent media
Regarding Montreal's transit system
Montreal Gazette, September 11, 2010
Montreal Gazette, March 17, 2010
Global National News, January 29, 2010
Montreal Gazette, January 27, 2010
National Post, January 27, 2010
CBC As It Happens, January 27 2010 (audio begins at 21:43)
Regarding research activities
Associated Press, Future tech on show at 36th SIGGRAPH, Aug. 3, 2009
Montreal Gazette, January 19, 2009
FULL MEDIA LIST
videos
videos · EcoTile


expressions

UltraVideo

SoundPark

mosaicing

interpolation

projection