Answers are grounded in this paper and cite their sources.
Open-ended visual storytelling poses a significant challenge for text-to-image models, which often fail to maintain narrative coherence and consistent character appearance across a sequence of images. To address this, we introduce StoryCrafter, a multi-character diffusion model that employs a novel instance-level cross-attention module. This module, trained with supervised fine-tuning, ensures precise alignment between text descriptions and characters, enabling consistent multi-character interactions throughout a story. Furthermore, we propose Direct-Diffusion Group Relative Policy Optimization, a novel reinforcement learning stage that uses story-aligned rewards to select optimal frames from a generated group, mitigating accumulated inconsistencies. We show that this group selection capability can be seamlessly integrated into inference time, effectively ensuring multi-frame style and character consistency, outperforming standard static greedy generation. We evaluate our approach through automated metrics, human assessments and vision-language model (VLM) judgment, measuring text-to-image alignment, style and character consistency, and fine-grained detail quality. Experiments on three benchmarks demonstrate that StoryCrafter outperforms existing methods, achieving 5.2% improvements in storytelling consistency on StorySalon dataset and 3.3%-10.8% in character accuracy on Flintstones-SV and Pororo-SV datasets, and also outperforming baselines in both human and VLM evaluations. The TTRL further brings consistent improvements in human evaluation on story visualization and continuation tasks, improving the average rank from 2.79 to 1.80 and from 1.80 to 1.39, respectively.
No takes yet. Share an insight, caveat, or question.
Wu et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: