PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
July 5, 2026ACM Transactions on Graphics0 citationsOpen Access

BodyReLux: Temporally Consistent Full-Body Video Relighting

View Full Paper
LMLi MaEye CenterMHMingming HeEye CenterXYXueming YuEye Center

Key Points

  • To develop a framework for relighting full-body human performances in a temporally consistent manner.
  • Utilized a hybrid dataset of pixel-aligned video relighting pairs, capturing various lighting and viewpoints.
  • Implemented a novel dynamic performance capture combining One-Light-at-a-Time techniques with interleaved lighting sequences.
  • Introduced a new lighting conditioning method using tokens for each light source to enhance control.
  • Achieved photorealistic and robust video relighting with temporal consistency across different performances.
  • Demonstrated effective lighting control using masked attention in sequences, enhancing the realism of human performances.

Abstract

Being able to relight human performance is a fundamental task for post production and content creation. We present BodyReLux, a subject-specific video diffusion-based framework for relighting full-body human performances in a temporally consistent way. Our model is trained on a hybrid dataset of pixel-aligned video relighting pairs, covering a diverse combination of lighting conditions, performances and viewpoints. To acquire such dataset, we combine traditional static One-Light-at-a-Time (OLAT) capture and a novel dynamic performance capture in which two smoothly varying lighting sequences are rapidly interleaved. Because the lighting operates above the human flicker-fusion threshold, the interleaving does not appears to strobe. We train our video relighting model from a pretrained text-to-video model to fully leverage the generative priors for producing high quality videos. To achieve accurate lighting control, we introduce a new lighting conditioning method that represents each light source as a token. We further condition on sequences of lighting using masked attention to support dynamic lighting control. Together with a carefully designed data augmentation pipeline, we achieve photorealistic, robust, and temporally consistent video relighting of subject-specific human performances.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Ma et al. (2026) studied this question.

synapsesocial.com/papers/6a49f36ff5d1d45b287ff876https://doi.org/10.1145/3811352
Ask AI
Helpful
Bookmark
Share
View Full Paper