VIRD: Immersive Match Video Analysis for High-Performance Badminton Coaching

Tica Lin, Alexandre Aouididi, Zhutian Chen, Johanna Beyer, Hanspeter Pfister, Jui-Hsien Wang

DOI: 10.1109/TVCG.2023.3327161

Room: 106

2023-10-25T03:00:00ZGMT-0600Change your timezone on the schedule page
2023-10-25T03:00:00Z
Exemplar figure, described by caption below
{\rtf1\ansi\ansicpg1252\cocoartf2709 \cocoatextscaling0\cocoaplatform0{\fonttbl\f0\fswiss\fcharset0 ArialMT;\f1\froman\fcharset0 Times-Roman;} {\colortbl;\red255\green255\blue255;\red0\green0\blue0;} {\*\expandedcolortbl;;\cssrgb\c0\c0\c0;} \margl1440\margr1440\vieww24000\viewh16320\viewkind0 \deftab720 \pard\pardeftab720\partightenfactor0 \f0\fs29\fsmilli14667 \cf0 \expnd0\expndtw0\kerning0 \outl0\strokewidth0 \strokec2 VIRD, VR Bird, is a VR video analysis tool for badminton coaches and players to effectively analyze badminton match with multi-modal data. \f1\fs24 \ \f0\fs29\fsmilli14667 Users can experience the dynamic 3D poses and ball trajectories in VR, and analyze game data with situated visualizations.\'a0 \f1\fs24 \ \f0\fs29\fsmilli14667 We contributed to a semi-automatic pipeline, where the coaches only need to provide a game video, and can later analyze the game in VR with all the supporting 3D views and data. \f1\fs24 \ }
Fast forward
Full Video
Keywords

Sports Analytics, Immersive Analytics, Data Visualization

Abstract

Badminton is a fast-paced sport that requires a strategic combination of spatial, temporal, and technical tactics. To gain a competitive edge at high-level competitions, badminton professionals frequently analyze match videos to gain insights and develop game strategies. However, the current process for analyzing matches is time-consuming and relies heavily on manual note-taking, due to the lack of automatic data collection and appropriate visualization tools. As a result, there is a gap in effectively analyzing matches and communicating insights among badminton coaches and players. This work proposes an end-to-end immersive match analysis pipeline designed in close collaboration with badminton professionals, including Olympic and national coaches and players. We present VIRD, a VR Bird (i.e., shuttle) immersive analysis tool, that supports interactive badminton game analysis in an immersive environment based on 3D reconstructed game views of the match video. We propose a top-down analytic workflow that allows users to seamlessly move from a high-level match overview to a detailed game view of individual rallies and shots, using situated 3D visualizations and video. We collect 3D spatial and dynamic shot data and player poses with computer vision models and visualize them in VR. Through immersive visualizations, coaches can interactively analyze situated spatial data (player positions, poses, and shot trajectories) with flexible viewpoints while navigating between shots and rallies effectively with embodied interaction. We evaluated the usefulness of VIRD with Olympic and national-level coaches and players in real matches. Results show that immersive analytics supports effective badminton match analysis with reduced context-switching costs and enhances spatial understanding with a high sense of presence.