Objective: Retrieval-Augmented Generation (RAG) systems operate on a core assumption: the retrieved context should override a model's internal parametric knowledge. This "epistemic discipline" is essential for reducing hallucinations. Recent work has demonstrated that directed meta-cognitive prompting enables Small Language Models (SLMs) to achieve frontier-model performance in factual grounding. Problem: We identify a critical safety vulnerability in this approach, which we term the Compliance Paradox. We hypothesize that strict adherence to context can bypass safety alignment training (RLHF), leading to "blind obedience" when the context contains harmful instructions. Methods: We stress-tested Llama-3.1-8B-Instruct and Mistral-7B on a curated dataset of 150 samples spanning Unanswerable Questions, Benign Factual Conflicts, and Harmful Contexts. We evaluated three prompt conditions: Baseline, Standard Exoskeleton (Forceful Grounding), and Safety Exoskeleton (Conditional Grounding). Results: The Standard Exoskeleton successfully improved RAG compliance on benign facts (0.10 → 0.66), but simultaneously degraded safety, complying with harmful instructions in 80% of cases (Refusal Rate: 0.20 ± 0.11). Integrating a "Safety Override" clause restored refusal rates to 44% (p < 0.001) for Llama-3.1 and 92% for Mistral-7B, without degrading benign compliance. Conclusion: High-adherence prompts act as "soft jailbreaks." We demonstrate that modern SLMs possess latent zero-shot safety reasoning capabilities that can be activated via specific "Exception Clauses," eliminating the need for safety fine-tuning in many edge-RAG applications.
Singh Vishal (Sat,) studied this question.