PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
December 13, 2024ACM Transactions on Software Engineering and Methodology28 citationsOpen Access

Large Language Model Supply Chain: A Research Agenda

SWShenao WangYZYanjie ZhaoXHXinyi Hou

Key Points

  • To establish a comprehensive research agenda that systematically characterizes challenges and opportunities across the large language model supply chain.
  • Defined the structural components, layers, and dependencies of the end-to-end large language model development lifecycle.
  • Evaluated systemic challenges across infrastructure, foundation model development, and downstream applications through the dual lenses of software engineering and security and privacy.
  • Identified critical gaps and operational risks across hardware infrastructure, foundation model architectures, and integrated downstream applications.
  • Formulated a structured roadmap of research opportunities to advance robust, reliable, and secure development practices throughout the model ecosystem.

Abstract

The rapid advancement of large language models (LLMs) has revolutionized artificial intelligence, introducing unprecedented capabilities in natural language processing and multimodal content generation. However, the increasing complexity and scale of these models have given rise to a multifaceted supply chain that presents unique challenges across infrastructure, foundation models, and downstream applications. This article provides the first comprehensive research agenda of the LLM supply chain, offering a structured approach to identify critical challenges and opportunities through the dual lenses of software engineering (SE) and security and privacy (S&P). We begin by establishing a clear definition of the LLM supply chain, encompassing its components and dependencies. We then analyze each layer of the supply chain, presenting a vision for robust and secure LLM development, reviewing the current state of practices and technologies, and identifying key challenges and research opportunities. This work aims to bridge the existing research gap in systematically understanding the multifaceted issues within the LLM supply chain, offering valuable insights to guide future efforts in this rapidly evolving domain.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Wang et al. (2024) studied this question.

synapsesocial.com/papers/69fca870a6aa4a4c5afa4118https://doi.org/10.1145/3708531
Ask AI
Helpful
Bookmark
Share
View Full Paper