Algorithm-Aware Neural Network Based Image Compression for High-Speed Imaging

PubDate: December 16, 2020

Teams: Facebook Reality Labs

Writers: Reid Pinkham, Tanner Schmidt, Andrew Berkovich

PDF: Algorithm-Aware Neural Network Based Image Compression for High-Speed Imaging

Abstract

In wearable AR/VR systems, data transmission between cameras and central processors can account for a significant portion of total system power, particularly in high framerate applications. Thus, it becomes necessary to compress video streams to reduce the cost of data transmission. In this paper we present a CNN-based compression scheme for such vision systems. We demonstrate that, unlike conventional compression techniques, our method can be tuned for specific machine vision applications. This enables increased compression for a given application performance target. We present results for Detectron2 Keypoint Detection and compare the performance and computational complexity of our method to existing compression schemes, such as H.264. We created a new high-framerate dataset which represents common scenarios for wearable AR/VR devices.