ABSTRACT This study proposes a federated split learning framework for large language models (FedsLLM) integrated with rate‐splitting multiple access (RSMA), aimed at enhancing the efficiency and privacy of LLM training in wireless communication systems. By leveraging low‐rank adaptation (LoRA) to distribute computational loads and a fluid antenna system to dynamically optimize channel capacity, the framework effectively reduces training latency through joint optimization of learning accuracy and communication resources. Experimental results demonstrate that the proposed framework significantly outperforms traditional time‐division multiple access including time division multiple access, frequency division multiple access (FDMA), enhanced bandwidth FDMA, and fairness‐enhanced FDMA across multiple metrics: at a transmit power of 20 dBm, RSMA reduces task completion time by 8.3%; under 20 MHz bandwidth, it achieves a 25% performance improvement; and even with a data volume of 900 Kbits, it maintains a 12% advantage. The adopted alternating optimization algorithm converges rapidly, reaching 95% of the optimal value within only 5 iterations, substantially outperforming the fixed‐point method. Overall, FedsLLM‐RSMA effectively addresses privacy, computational and communication bottlenecks in distributed LLM training. Compared to TDMA, it reduces total training latency by 28% and improves communication efficiency by 35%, while achieving higher model accuracy and faster convergence. This work provides a viable pathway for efficient and scalable deployment of LLMs in 6G networks.
Dai et al. (Thu,) studied this question.