PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
January 17, 20260 citationsOpen Access

A Hybrid Stylometric Transformer Embedding Framework for Robust Authorship Verification Against Generative AI Adversaries

View Full Paper
JTJournal of Theoretical and Applied Information Technology

Key Points

  • The goal is to enhance authorship verification by developing a new hybrid framework that withstands generative AI obfuscations.
  • Developed a hybrid framework combining stylometric descriptors and transformer embeddings.
  • Integrated engineered lexical, orthographic, and syntactic vectors.
  • Utilized a pre-trained transformer encoder fine-tuned with contrastive objectives.
  • Evaluated on the PAN CLEF 2025 Voight-Kampff corpus with both human and AI-authored texts.
  • Tested against classical and hybrid baseline methods for comparative analysis.
  • Achieved an absolute ROC-AUC increase of approximately 0.07 over the hybrid baseline.
  • Realized an absolute F1 increase of about 0.07, enhancing performance metrics.
  • Improved calibration with a Brier score reduction of roughly 47%.
  • Maintained a manageable increase in inference cost suitable for forensic applications.

Abstract

Authorship verification (AV) remains critical to attribute text provenance and to limit misuse of large language models (LLMs). Existing detectors typically used handcrafted stylometric cues or deep transformer embeddings but lacked robustness to model mimicry and targeted obfuscation and often required large labeled corpora. This work proposes Hybrid Stylometric–Transformer Embedding Framework (HSTEF), a hybrid, explainable AV architecture that fuses multi-level stylometric descriptors with cross-attended transformer embeddings to form a compact verification representation. HSTEF integrated engineered lexical, orthographic and syntactic stylometric vectors, a pre-trained transformer encoder fine-tuned with contrastive and calibration objectives, and a cross-modal fusion module that enabled bidirectional style–semantic interaction while preserving interpretability. The method was evaluated on the PAN CLEF 2025 Voight-Kampff corpus containing human and machine authored texts across genres and including deliberate obfuscations. Experiments used one classical baseline (Linear SVM on TF-IDF, SVM) and one hybrid baseline (DistilBERT + stylometric features) under identical preprocessing and metrics (ROC-AUC, F1, Brier, C@1, and computation). HSTEF produced an absolute ROC-AUC increase of ≈0.07 and an absolute F1 increase of ≈0.07 over the hybrid baseline while improving calibration (Brier reduced ≈47%) at a controlled inference cost increase consistent with forensic deployment scenarios. These results indicate that a Hybrid Stylometric–Transformer Embedding Framework offers a tractable accuracy and robustness trade-off for AV against modern generative AI adversaries.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Journal of Theoretical and Applied Information Technology (2026) studied this question.

synapsesocial.com/papers/696b2696d2a12237a9349debhttps://doi.org/10.5281/zenodo.18258309
Ask AI
Helpful
Bookmark
Share
View Full Paper