Skip to main content
Log in

Optical design for transfer of camera viewpoint using retrotransmissive optical system

  • Regular Paper
  • Published:
Optical Review Aims and scope Submit manuscript

Abstract

We propose a virtual camera that can pass through a small hole in an obstruction to capture an image on the other side. Recently, free-viewpoint television technology has enabled the generation of video in which viewpoint images are captured from locations where cameras are not actually placed. However, capturing the images of objects concealed behind obstructions or beyond a camera’s field of view is a challenge. We designed an optical transformation system that utilizes a conventional camera, concave lens, and transmissive mirror device (TMD); this system enables the capture of images through small holes in walls or other obstructions. Our experimental prototype demonstrated that it is possible to capture images of the area on the other side of a wall through a 5 mm hole. In this paper, modulation transfer function (MTF) comparison is used to show that a combination of a concave lens and TMD is an effective optical design for a midair camera.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Nayar, S.K.: Computational cameras: redefining the image. Computer 39(8), 30–38 (2006)

    Article  Google Scholar 

  2. O’Toole, M., Lindell, D.B., Wetzstein, G.: Real-time non-line-of-sight imaging. In: ACM SIGGRAPH 2018 Emerging Technologies, SIGGRAPH ’18, vol. 14, pp. 1–14:2, ACM, New York (2018)

  3. Kakeya, H.: P-65: FLOATS V: real-image-based autostereoscopic display with TFT-LC filter. SID Symp. Dig. Tech. Pap. 35(1), 490–493 (2004)

    Article  Google Scholar 

  4. Nii, H., Zhu, K., Yoshikawa, H., Htat, N.L., Aigner, R., Nakatsu, R.: Fuwa-Vision: an auto-stereoscopic floating-image display. In: SIGGRAPH Asia 2012 Emerging Technologies, SA ’12, vol. 13, pp. 1–13:4, ACM, New York (2012)

  5. Yamamoto, H., Tomiyama, Y., Suyama, S.: Floating aerial LED signage based on aerial imaging by retro-reflection (AIRR). Opt. Express 22(22), 26919–26924 (2014)

    Article  ADS  Google Scholar 

  6. Maeda, Y., Miyazaki, D., Maekawa, S.: Volumetric aerial three-dimensional display based on heterogeneous imaging and image plane scanning. Appl. Opt. 54(13), 4109–4115 (2015)

    Article  ADS  Google Scholar 

  7. Koike, T., Onishi, Y.: Aerial 3D imaging by retroreflective mirror array. In: Companion proceedings of the 2018 ACM international conference on interactive surfaces and spaces, ISS ’18 Companion, pp. 25–29, ACM, New York (2018)

  8. Otsubo, M.: Optical imaging apparatus and optical imaging method using the same, US8702252B2 (2014)

  9. Maekawa, S., Nitta, K., Matoba, O.: Transmissive optical imaging device with micromirror array. In: Three-dimensional TV, video, and display V, vol. 6392, pp. 130–137. International Society for Optics and Photonics, SPIE (2006)

  10. Yoshimizu, Y., Iwase, E.: Radially arranged dihedral corner reflector array for wide viewing angle of floating image without virtual image. Opt. Express 27(2), 918–927 (2019)

    Article  ADS  Google Scholar 

  11. Yamamoto, H., Bando, H., Kujime, R., Suyama, S.: Design of crossed-mirror array to form floating 3D LED signs. In: Stereoscopic displays and applications XXIII, vol. 8288, pp. 705–712. International Society for Optics and Photonics, SPIE (2012)

  12. Maeda, Y., Miyazaki, D., Maekawa, S.: Optical design for heterogeneous imaging based on retro reflection using parallel roof mirror arrays. In: JSAP-OSA Joint Symposia 2014 Abstracts, pp. 20a\_C4\_3. Optical Society of America (2014)

Download references

Acknowledgements

This research was supported in part by a Grant in aid for Precursory Research for Embryonic Science and Technology (PRESTO) and CREST from the Japan Science and Technology Agency (JPMJPR16D5).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Naoya Koizumi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Koizumi, N., Niwa, Y., Kajita, H. et al. Optical design for transfer of camera viewpoint using retrotransmissive optical system. Opt Rev 27, 126–135 (2020). https://doi.org/10.1007/s10043-019-00575-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10043-019-00575-7

Keywords

Navigation