Answers are grounded in this paper and cite their sources.
Comparative study evaluates DSPy and manual prompting for legal clause extraction, indicating differing efficiencies based on complexity.
This study compares Manual Few-Shot promptingversus DSPy (Declarative Self-improving Python)for legal contract clause extraction. We evaluated both approaches on 50 real SEClegal contracts from the CUAD benchmark datasetacross 4 clause types: Parties, Governing Law,Expiration Date, and Effective Date. Training set: 10 contractsTest set: 20 contractsEvaluation: Claude Haiku as LLM judge (0-3 scale) Results show DSPy outperforms manual few-shotoverall (1.94 vs 1.85 average score, +4.9%). Key finding: DSPy shows largest improvement onGoverning Law (+21%) — the most complex clause.Manual few-shot wins on Effective Date —the simplest formulaic clause. Practical insight: DSPy beats manual promptingon complexity. Human intuition wins on simplicity.
No takes yet. Share an insight, caveat, or question.
Ananth Raghavendra (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: