Dynamic adaptive streaming for multi-viewpoint omnidirectional videos

Xavier Corbillon 1 Francesca de Simone 2 Gwendal Simon 3 Pascal Frossard 4 Francesca Simon
1 ADOPNET - Advanced technologies for operated networks
UR1 - Université de Rennes 1, IMT Atlantique - IMT Atlantique Bretagne-Pays de la Loire, IRISA-D2 - RÉSEAUX, TÉLÉCOMMUNICATION ET SERVICES
2 Télécom ParisTech
3 RSM - Département Réseaux, Sécurité et Multimédia
4 EPFL - Ecole Polytechnique Fédérale de Lausanne
Abstract : Full immersion inside a Virtual Reality (VR) scene requires six Degrees of Freedom (6DoF) applications where the user is allowed to perform translational and rotational movements within the virtual space. The implementation of 6DoF applications is however still an open question. In this paper we study a multi-viewpoint (MVP) 360-degree video streaming system, where a scene is simultaneously captured by multiple omnidirectional video cameras. The user can only switch positions to predefined viewpoints (VPs). We focus on the new challenges that are introduced by adaptive MVP 360-degree video streaming. We introduce several options for video encoding with existing technologies, such as High Efficiency Video Coding (HEVC) and for the implementation of VP switching. We model three video-segment download strategies for an adaptive streaming client into Mixed Integer Linear Programming (MILP) problems: an omniscient download scheduler; one where the client proactively downloads all VPs to guarantee fast VP switch; one where the client reacts to the user's navigation pattern. We recorded a one MVP 360-degree video with three VPs, implemented a mobile MVP 360-degree video player, and recorded the viewing patterns of multiple users navigating the content. We solved the adaptive streaming optimization problems on this video considering the collected navigation traces. The results emphasize the gains obtained by using tiles in terms of objective quality of the delivered content. They also emphasize the importance of performing further study on VP switching prediction to reduce the bandwidth consumption and to measure the impact of VP switching delay on the subjective Quality of Experience (QoE).
Document type :
Conference papers
Complete list of metadatas

Cited literature [45 references]  Display  Hide  Download
https://hal-imt-atlantique.archives-ouvertes.fr/hal-01896282
Contributor : Gwendal Simon <>
Submitted on : Saturday, December 8, 2018 - 1:10:46 AM
Last modification on : Thursday, October 17, 2019 - 12:34:53 PM

Links full text

openaccess

Identifiers

Collections

IMT-ATLANTIQUE | CNRS | INSTITUT-TELECOM | UNIV-RENNES1 | CENTRALESUPELEC | IRISA | INRIA | UNIV-RENNES | UR1-UFR-ISTIC | PARISTECH | UNIV-PARIS-SACLAY

Citation

Xavier Corbillon, Francesca de Simone, Gwendal Simon, Pascal Frossard, Francesca Simon. Dynamic adaptive streaming for multi-viewpoint omnidirectional videos. ACM Multimedia Systems (MMSys), Jun 2018, Amsterdam, Netherlands. ⟨10.1145/3204949.3204968⟩. ⟨hal-01896282⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

91

Contact

Informations

CCSD