Design of Tile-Based VR Transcoding and Transmission System for Metaverse
Teams:Beijing Film Academy
PDF:Design of Tile-Based VR Transcoding and Transmission System for Metaverse
Abstract
Watching panoramic videos is the embryonic form of metaverse experience in recent years. In order to reduce the cost of user access to the metaverse services, developers are starting to experiment with ways to watch panoramic videos on mobile devices. Therefore, how to guarantee high bit-rate and low latency when watching panoramic video becomes a very critical issue. This paper develops a complete system for watching panoramic videos, aiming at the problem of watching high bit-rate panoramic videos on mobile devices. The system consists of three main parts: the video processing part, the video watching part, and the data analysis part. The system is based on a web application, and users can use the system by a web browser. In order to guarantee high bit-rate and low latency when watching, the system uses MPEG-DASH for playing tiled panoramic video with the Adaptive Bit-Rate (ABR) algorithm. The video is divided into six tiles corresponding to the six faces of the 3D scene. The player can automatically change the bit-rate of different tiles of the video according to the user watching direction and buffer area. Using A-frame to create a 3D scene on a website allows users to watch the video with or without a VR headset.
