Answers are grounded in this paper and cite their sources.
Text-to-image synthesis (T2I) is a challenging task because the model requires to create high-quality images that are semantically consistent and realistic.Therefore, the main objective of this paper is to improve the quality of generated images and the similarity level between text descriptions and these images.In this paper, we proposed deepfusion generative adversarial networks (DF-GAN) with multimodal similarity model (MSM) to generate highresolution images with better consistency between text and the generated images.In this work, MSM is pretrained using real images with captions in the dataset.This pretrained model is used to improve the visual-semantic consistency level during training of T2I.This paper investigates the improvement in the image generation process due to applying MSM model to the generator.The investigation is performed on two different datasets with different languages to prove our proposed model outperforms baseline DF-GAN.Firstly, the experiment is done on Caltech-Birds dataset and the evaluative results of the proposed model are compared with state-of-the-art models, StackGAN, StackGAN++, AttnGAN, DMGAN, DAE-GAN, TIME, DF-GAN.According to the comparative results, the proposed model outperforms the baseline state-of-the-art models in terms of Fréchet inception distance (FID) score and inception score.The improvements of the proposed model on synthesizing images over the baseline models are proved in terms of image quality and visual-semantic similarity in this work.Accordingly, the proposed model is applied on Myanmar text-to-image synthesis (Myanmar T2I) with Oxford 102 flowers dataset annotated in Myanmar to prove the effectiveness of the proposed model on different dataset and different language.To the extent of our knowledge, this is the first attempt of implementing generative adversarial networks with multimodal in Myanmar T2I and it got inception score of 3.54 ± 0.03 and FID score of 49.97.In Myanmar T2I, the proposed model also got better performance than the baseline DF-GAN because it achieved higher inception score and lower FID score than the baseline model.Drawing upon the findings derived from the outcomes of the experiments, it is evident that the proposed model demonstrates an enhancement in the quality of generated images within the context of the image generation.
No takes yet. Share an insight, caveat, or question.
Htwe et al. (2024) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: