[en] Slow-motion replays provide a thrilling perspective on pivotal moments within sports games, offering a fresh and captivating visual experience. However, capturing slow-motion footage typically demands high-tech, expensive cameras and infrastructures. Deep learning Video Frame Interpolation (VFI) techniques have emerged as a promising avenue, capable of generating high-speed footage from regular camera feeds. Moreover, the utilization of event-based cameras has recently gathered attention as they provide valuable motion information between frames, further enhancing the VFI performances. In this work, we present a first investigation of event-based VFI models for generating sports slow-motion videos. Particularly, we design and implement a bi-camera recording setup, including an RGB and an event-based camera to capture sports videos, to temporally align and spatially register both cameras. Our experimental validation demonstrates that TimeLens, an off-the-shelf event-based VFI model, can effectively generate slow-motion footage for sports videos. This first investigation underscores the practical utility of event-based cameras in producing sports slow-motion content and lays the groundwork for future research endeavors in this domain.
Research Center/Unit :
Montefiore Institute - Montefiore Institute of Electrical Engineering and Computer Science - ULiège TELIM
Disciplines :
Electrical & electronics engineering
Author, co-author :
Deckyvere, Antoine; University of Liège,Montefiore Institute
Cioppa, Anthony ; Université de Liège - ULiège > Montefiore Institute of Electrical Engineering and Computer Science ; University of Liè,ge,Montefiore Institute
Giancola, Silvio; IVUL,KAUST
Ghanem, Bernard; IVUL,KAUST
Van Droogenbroeck, Marc ; Université de Liège - ULiège > Département d'électricité, électronique et informatique (Institut Montefiore) > Télécommunications ; University of Liè,ge,Montefiore Institute
Language :
English
Title :
Investigating Event-Based Cameras for Video Frame Interpolation in Sports
Publication date :
08 July 2024
Event name :
International Workshop on Sport, Technology and Research (STAR)