Deep Homography for Efficient Stereo Image Compression

PubDate: June 2021

Teams: Beihang University;ETH Zurich

Writers: Xin Deng1, Wenzhe Yang2, Ren Yang3, Mai Xu2, * , Enpeng Liu2, Qianhan Feng2, Radu Timofte3

PDF: Deep Homography for Efficient Stereo Image Compression

Abstract

In this paper, we propose HESIC, an end-to-end trainable deep network for stereo image compression (SIC). To fully explore the mutual information across two stereo images, we use a deep regression model to estimate the homography matrix, i.e., H matrix. Then, the left image is spatially transformed by the H matrix, and only the residual information between the left and right images is encoded to save bitrates. A two-branch auto-encoder architecture is adopted in HESIC, corresponding to the left and right images, respectively. For entropy coding, we use two conditional stereo entropy models, i.e., Gaussian mixture model (GMM) based and context based entropy models, to fully explore the correlation between the two images to reduce the coding bit-rates. In decoding, a cross quality enhancement module is proposed to enhance the image quality based on inverse H matrix. Experimental results show that our HESIC outperforms stateof-the-art SIC methods on InStereo2K and KITTI datasets both quantitatively and qualitatively. Code is available at https://github.com/ywz978020607/HESIC.