PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 15, 20260 citationsOpen Access

Capy Cosmos Now Eying at Prompts: Generated Text Detection with Contextual Features

View Full Paper
PDPhilipp DingfelderJHJulia HoffmannFraunhofer Institute for Integrated CircuitsCRChristian Riess

Key Points

  • The aim is to enhance the detection of AI-generated text by utilizing prompt context.
  • Develops a detector-agnostic method using prompt inversion from an auxiliary LLM
  • Filters contextual features to highlight stylistic cues
  • Evaluates on a diverse dataset with various domains and manipulated texts
  • Improves detection performance by 5% in AUC through incorporated prompt context
  • Increases AUC performance by up to 10% against adversarial samples
  • Enhances domain generalization accuracy by 6%

Abstract

Generative LLMs become increasingly powerful. Several detectors have been proposed for distinguishing between AI-generated and human-written text with the goal of protecting text authenticity and integrity. A major challenge in zero-shot Generated Text Detection is the so-called ``capybara problem'', where missing context causes detectors to misclassify unusual but contextually explainable linguistic features as human-written. To alleviate this issue, this paper proposes a detector-agnostic method that provides prompt context through prompt inversion from an auxiliary LLM. By filtering out contextual linguistic features, the approach enables detectors to focus on stylistic cues indicative of generated text. Experiments on a diverse dataset including multiple domains, LLMs, and adversarial manipulations show that incorporating prompt context improves detection performances by up to 5 % in AUC. Further evaluations on attack robustness and domain generalization show that AUC performance increases up to 10 % for adversarially manipulated samples and up to 6 % in domain generalization accuracy, underscoring the effectiveness of prompt context in enhancing generated text detection.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Dingfelder et al. (2026) studied this question.

synapsesocial.com/papers/69b6068883145bc643d1c8eahttps://doi.org/10.18420/sicherheit2026_14
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1The Impact of Prompts on Zero-Shot Detection of AI-Generated Text2024 · 1 citations
  2. 2Uncovering Hidden Intentions: Exploring Prompt Recovery for Deeper Insights into Generated Texts2024 · 1 citations
  3. 3OUTFOX: LLM-Generated Essay Detection Through In-Context Learning with Adversarially Generated Examples2024 · 40 citations
  4. 4Collaborative Multi-Agent Method for Zero-Shot LLM-Generated Text Detection2026 · 1 citations
  5. 5Detection of AI-Generated Text Using Large Language Model2024 · 21 citations