Decoupling of Real and Digital Content in Projection-based Augmented Reality Systems Using Time Multiplexed Image Capture
Projection-based augmented reality systems overlay digital information directly on real objects, while at the same time use cameras to capture the scene information. A common problem with such systems is that cameras see the projected image besides the real objects to some degree. This crosstalk reduces the object detection and digital content registration abilities. The authors propose a novel time sharing-based technique that facilitates the real and digital content decoupling in real time without crosstalk. The proposed technique is based on time sequential operation between a MEMS scanner-based mobile projector and rolling shutter image sensor. A MEMS mirror- based projector scans light beam in raster pattern pixel by pixel and completes full frame projection over a refresh period, while a rolling shutter image sensor sequentially collects scene light row by row. In the proposed technique, the image sensor is synchronized with scanning MEMS mirror and precisely follows the display scanner with a half-period lag to make the displayed content completely invisible for camera. An experimental setup consisting of laser pico projector, an image sensor, and a delay and amplifier circuit is developed. The performance of proposed technique is evaluated by measuring the crosstalk in captured content and sensor exposure limit. The results show 0% crosstalk in captured content up to 8 ms sensor exposure. High capture frame rate (up to 45 fps) is achieved by cyclically triggering a 3.2 MP, 60 fps CMOS sensor and using a 60 Hz pico projector.
Document Type: Research Article
Publication date: 01 January 2017
This article was made available online on 08 December 2016 as a Fast Track article with title: "Decoupling of Real and Digital Content in Projection-based Augmented Reality Systems Using Time Multiplexed Image Capture".
The Journal of Imaging Science and Technology (JIST) is dedicated to the advancement of imaging science knowledge, the practical applications of such knowledge, and how imaging science relates to other fields of study. The pages of this journal are open to reports of new theoretical or experimental results, and to comprehensive reviews. Only original manuscripts that have not been previously published, nor currently submitted for publication elsewhere, should be submitted.
IS&T's JIST-first publication option allows authors wishing to present their work at conferences, but have a journal citation for their paper, to submit a paper to JIST that follows the same rigorous peer-review vetting and publication process as traditional JIST articles, but with the benefit of a condensed time-to-publication time frame and guaranteed conference presentation slot.
Please note: For purposes of its Digital Library content, IS&T defines Open Access as papers that will be downloadable in their entirety for free in perpetuity. Copyright restrictions on papers vary; see individual paper for details.
- Editorial Board
- Information for Authors
- Submit a Paper
- Subscribe to this Title
- Membership Information
- Information for Advertisers
- Terms & Conditions
- Information for JIST-First Authors
- Ingenta Connect is not responsible for the content or availability of external websites