Proposal of Simulation-based Test and Evaluation Process to Improve the Reliability of Artificial Intelligence Aided Weapon System

Purpose: This study proposes improvements to the U.S. Department of Defense"s simulation test and evaluation procedure (STEP) for efficient and reliable test and evaluation (T&E) of artificial intelligence-aided weapons systems.Methods: The proposed procedure comprises four stages. Firstly, deriving T&E items and categorizing test methods using the COI, KPP, MOE, and MOP concepts. Secondly, it focuses on modeling these test elements. Thirdly, the procedure undergoes the VV&A phase, and lastly, it assesses the results in actual environments and M&S tests.Results: The STEP method aims to enhance the effectiveness, survivability, and suitability of artificial intelligence systems while reducing the cost and time and improving the overall efficiency of T&E.Conclusion: The proposed STEP is expected to play a significant role in enhancing the performance and safety of artificial intelligence-aided weapons systems.