Answers are grounded in this paper and cite their sources.
Evaluation study demonstrates high precision anomaly detection in imbalanced IoT network traffic, suggesting viable lightweight intrusion detection for edge devices.
Most intrusion detection systems (IDS) research is conducted on artificially balanced datasets. This hides a real problem: precision drops sharply under production-like conditions, where attacks can be outnumbered by benign packets hundreds to one. This paper evaluates an unsupervised detector under exactly that kind of imbalance, on two structurally different datasets: consumer IoT traffic (CIC-IoT 2023, 278.5× attack-to-benign) and multi-architecture malware traffic (IoTMal-2026, 9.6× ). The detector, ST-HAE (Spatio-Temporal Hybrid Autoencoder), is a 1D-CNN-BiLSTM encoder-decoder with 60,151 parameters. It trains only on benign traffic and flags anomalies using a statistically calibrated reconstruction-error threshold, with no access to attack labels at any point. Under five-seed statistical validation, ST-HAE reaches alert precision 0.9999\!± \!0.0000 on CIC-IoT 2023 and 95.85\,%\!± \!0.03\,% accuracy on IoTMal-2026, matching or exceeding Deep SVDD, Deep SAD, and Kitsune under an identical protocol. Deep SVDD is also notably unstable, with accuracy standard deviation up to 10.0 percentage points across seeds; ST-HAE and Kitsune do not share this problem. Separately, we find the model’s bidirectional recurrent component does not reliably improve mean accuracy over a simpler, convolution-only alternative. What it does provide is stability: training-run failure risk drops roughly 31-fold on the more heterogeneous dataset, and we treat that stability, not raw accuracy, as its real contribution. A category-level breakdown tells a more complicated story about precision. Recall on high-volume flood attacks (DDoS, DoS, Mirai) is near-perfect. Recall on slower, quieter attacks (reconnaissance, web exploits, spoofing) is far worse, with reconstruction error running up to 454× smaller for these attacks. Threshold sweeps, using both Gaussian and nonparametric calibration, confirm this is a real separation limit rather than something a different threshold could fix—which matches what the paper’s decision-theoretic threshold model predicts once correctly re-derived in this revision to account for class separation: below a critical separation point, the theoretically optimal threshold simply is not usable in practice. Feature attribution, cross-checked with SHAP and LIME, shows flood detection depends heavily on one or two count-based features that exceed the training data’s normal range. Removing those features does not eliminate detection, but the effect is uneven: Mirai detection is barely affected, while DoS recall drops from near-total to $$59\,%$$ . This rules out both extremes—the features are not the whole story, but they are not irrelevant either. Finally, we report single-sample inference latency measured directly on real AWS Graviton ARM64 hardware: 1.82 ms per sample, 550 samples/s, correcting an earlier estimate that had been extrapolated from GPU numbers rather than measured. ST-HAE is best understood not as a universally strong detector, but as a precision-focused, edge-deployable one whose real capabilities and real limits are both measured here, under realistic and imbalanced conditions.
No takes yet. Share an insight, caveat, or question.
Reddy et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: