Player: Transforming Video Interaction with XR and AI

Immersive participation redefines how audiences engage with video content

Player stands out in the evolving landscape of video platforms by empowering users to interact with content in multidimensional ways. Traditional platforms often limit engagement to simple actions such as "likes" or "comments," but Player invites audiences to step inside the video experience. By leveraging XR (Extended Reality) and advanced AI, users can create personalized avatars, select unique backgrounds, and follow along with 3D motion data embedded in videos. This innovation not only enhances accessibility but also democratizes video participation, making it possible for anyone to join challenges or creative activities without concerns about editing skills or personal appearance.

The technology behind Player is both sophisticated and user-friendly. Videos uploaded to the platform are processed to extract motion and sound data, which are then converted into 3D motion information. This enables participants to accurately mimic movements—whether dancing, building, or reacting—by following detailed cues that are often missed in traditional video formats. The generative AI-powered interface further simplifies the process, allowing users to effortlessly customize their avatars and environments, ensuring a tailored and inclusive experience for all.

Player’s compatibility with leading XR devices, such as Meta Quest and Apple Vision Pro, ensures a seamless augmented reality experience. While current AR smart glasses may face technical limitations, the platform is designed with future advancements in mind, positioning itself at the forefront of immersive video interaction. The focus on AR user experience within XR environments highlights Player’s commitment to accessibility and innovation.

Research conducted during the development of Player reveals a strong demand for more engaging and customizable video participation, especially among Gen-Z users. Insights gathered from in-depth interviews and online surveys indicate that current video platforms are perceived as static, with limited interactive features. Participants expressed enthusiasm for the ability to change their appearance and environment using generative AI, suggesting that such features would significantly increase engagement and enjoyment. The introduction of Player is expected to boost app engagement, session duration, and overall video quality, creating a positive feedback loop for both creators and audiences.

One of the key challenges in developing Player was the extraction and visualization of 3D motion data. Through expert consultation and the adoption of advanced 3D tools, Suryun Hyeon successfully overcame these technical hurdles, resulting in a platform that effectively bridges the gap between passive viewing and active participation.

Player’s innovative approach has been recognized with the Bronze A' Design Award in Interface, Interaction, and User Experience Design for 2025. This accolade celebrates the project’s creative ingenuity, technical excellence, and its potential to enhance quality of life by transforming how people interact with video content. As video consumption continues to evolve, Player sets a new standard for immersive, participatory experiences in the digital age.