Enhancing Multimodal Analogical Reasoning with Logic Augmented Generation

• A Logic Augmented Generation-based approach significantly improves multimodal analogical reasoning. • Injecting knowledge base graphs into the prompt boosts every evaluation metric, allowing the proposed method to surpass all baselines on general, domain-specific, and visual metaphor detection and understanding. • Results show that overcoming current limitations in computational metaphor processing will require not only more diverse, fine-grained datasets and ontologies, but also explicit safeguards against cross-modal interference and shortcutting, an under-examined tendency for models to latch onto superficial cues rather than genuine metaphorical structure. Recent advances in Large Language Models (LLMs) have demonstrated their capabilities across a variety of tasks. However, automatically extracting implicit knowledge from natural language remains a significant challenge, as machines lack direct experience with the physical world. Given this scenario, semantic knowledge graphs can guide LLMs to achieve more efficient and explainable results. In this paper, we apply a Logic Augmented Generation framework that leverages the explicit representation of a text through a semantic knowledge graph and applies it in combination with prompt heuristics to elicit implicit analogical connections. This method generates extended knowledge graph triples representing implicit meaning, enabling systems to reason on unlabeled multimodal data regardless of the domain. We validate our work through three metaphor detection and understanding tasks across five datasets, text-based, domain-specific, and visual, as they require deep analogical reasoning capabilities. The results show that the proposed integrated approach surpasses current baselines and performs better than humans in understanding visual metaphors. It also provides justifications for the reasoning processes, yet remains susceptible to shortcut cues and cross-modal interference. The error analysis discusses issues with existing metaphor datasets and current evaluation and annotation methods.