A review of LLMs and their applications in the architecture, engineering and construction industry

Abstract During the past decade, there has been rapid emergence, continuous development and advancements in the field of Artificial Intelligence (AI), and a broad adaptation ofLarge Language Models (LLMs) in a wide variety of application domains transforming and streamlining industry practices. However, the construction industry has yet to fully incorporate these technologies, delaying their wide-scale adaptation. Only a limited number of recent studies have explored the opportunities, capabilities and potential of current LLM implementations in the broad domain of Architecture Engineering and Construction (AEC) industry, leaving a significant gap in this field of research. This study aims to address this gap and provide an extensive review of already established state-of-the-art applications and use case scenarios of LLMs in the AEC industry. Apart from that, by exploring the key contributions and limitations of these applications, and by considering relative reviews on this subject, it was possible to categorize them, to extract the emerging challenges and future directions of the field and propose actionable recommendations for industry stakeholders. This study also includes an introduction to important concepts and recent advancements of LLM technologies, focusing on transformer-based architectures and providing an extensive list of LLM families.