Synapse
⌘+K
Synapse
PulseExploreClubsResearchersJournals
Instagram
HomeClubsExplore
August 28, 2026Journal of Computing and Information Science in EngineeringOpen Access

Tradespace Analysis using GPT: A Comparative Study with Humans

View Full Paper
Ask AI
Bookmark
Share

Authors

MRMozhdeh RahmanpourAKAathira Anil KumarDJDavid Joy

Discussion

Loading...

Member takes

Overview

Comparative study reveals close alignment between GPT-4 and computer science experts in tradespace analysis across 30 participants, suggesting AI can augment complex system design evaluations.

Key Points

  • To evaluate the effectiveness of GPT-4 in analyzing requirement specification documents and populating a tradespace matrix relative to human evaluators.
  • Assessed GPT-4 alongside N=30 human participants categorized into engineering, non-technical, and computer science/artificial intelligence (CS/AI) cohorts.
  • Administered a standardized survey requiring both the language model and human participants to evaluate a complex system design and generate a tradespace matrix.
  • Compared outcomes using within-group, across-group, and human-versus-GPT-4 comparative heatmap evaluations.
  • The CS/AI participant group exhibited the highest degree of response alignment with the tradespace matrix generated by GPT-4.
  • GPT-4 successfully synthesized specification documents to support tradespace exploration, providing a viable alternative when multidisciplinary human teams are unavailable.

Cite This Study

Rahmanpour et al. (2026) studied this question.

synapsesocial.com/papers/6a914613d15324a1df3a970ehttps://doi.org/10.1115/1.4072639
View Full Paper
Ask AI
Bookmark
Share

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1A Technological Construction of Society: Comparing GPT-4 and Human Respondents for Occupational Evaluation in the UK2024 · 2 citations
  2. 2Can large language models replace humans in systematic reviews? Evaluating <scp>GPT</scp>‐4's efficacy in screening and extracting data from peer‐reviewed and grey literature in multiple languages2024 · 232 citations
  3. 3A technological construction of society: Comparing GPT‐4 and human respondents for occupational evaluation in the UK2024 · 2 citations
  4. 4GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levels2024 · 8 citations
  5. 5Evaluating GPT as automated analyzer for detecting students’ erroneous mental models in programming education2026