Abstract
In this paper, we propose a novel method to generate stereoscopic images from light-field images with the intended depth range and simultaneously perform image super-resolution. Subject to the small baseline of neighboring subaperture views and low spatial resolution of light-field images captured using compact commercial light-field cameras, the disparity range of any two subaperture views is usually very small. We propose a method to control the disparity range of the target stereoscopic images with linear or nonlinear disparity scaling and properly resolve the disocclusion problem with the aid of a smooth energy term previously used for texture synthesis. The left and right views of the target stereoscopic image are simultaneously generated by a unified optimization framework, which preserves content coherence between the left and right views by a coherence energy term. The disparity range of the target stereoscopic image can be larger than that of the input light field image. This benefits many light field image-based applications, e.g., displaying light field images on various stereo display devices and generating stereoscopic panoramic images from a light field image montage. An extensive experimental evaluation demonstrates the effectiveness of our method.
Original language | English |
---|---|
Article number | 8859635 |
Pages (from-to) | 1827-1842 |
Number of pages | 16 |
Journal | IEEE Transactions on Image Processing |
Volume | 29 |
DOIs | |
Publication status | Published - 4 Oct 2019 |
Bibliographical note
Funding Information:Manuscript received April 16, 2018; revised January 31, 2019 and July 3, 2019; accepted September 25, 2019. Date of publication October 4, 2019; date of current version November 27, 2019. This work was supported in part by the Natural Science Foundation of Jiangsu Province under Grant BK20170197 and in part by the National Natural Science Foundation of China under Grant 61902151. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Jingyi Yu. (Corresponding author: Tao Yan.) T. Yan is with the Jiangsu Key Laboratory of Media Design and Software Technology, Jiangnan University, Wuxi 214122, China (e-mail: yantao.ustc@ gmail.com).
Publisher Copyright:
© 1992-2012 IEEE.
Keywords
- disparity scaling
- Light field image processing
- stereoscopic image synthesis
- super-resolution
ASJC Scopus subject areas
- Software
- Computer Graphics and Computer-Aided Design