Clinical supervision research from 1981 to 1993: A methodological critique.

Michael V. Ellis University at Albany, State University of New York Nicholas Ladany Temple University Maxine Krengel Boston Veterans Affairs Medical Center and Boston University School of Medicine Deborah Schult University at Albany, State University of New York The empirical studies in clinical supervision published from 1981 through 1993 were investigated to assess scientific rigor and to test whether the quality of methodology had improved since the review by R. K. Russell, A. M. Crimmings, and R. W. Lent (1984). The 144 studies were evaluated according to 49 threats to validity (T. D. Cook R. K. Russell et al., 1984; B. E. Wampold, B. Davis, Hansen Nicholas Ladany, Department of Counseling Psychology, Temple University; Maxine Krengel, Psychology Section (1168), Boston Veterans Affairs Medical Center and Department of Psychology, Boston University School of Medicine. Earlier versions of this article were presented at the 96th Annual Convention of the American Psychological Association, Atlanta, Georgia, August 1988, and at the meeting of the North Atlantic Regional Association of Counselor Education and Supervision, Albany, New York, October 1991. Maxine Krengel completed some of this research while a doc- toral student in the Department of Counseling Psychology, Uni- versity at Albany, State University of New York. We are grateful to Micki Friedlander, Richard Haase, and Erica Robbins Ellis for their insightful comments on earlier versions of this article. We express our appreciation to Eric Adams, Mafoozal Ali, Elizabeth Bhargava, Virginia Flander, David Hahn, Gohpa Khan, Michelle Mautner, Deborah Melincoff, Michael Remshard, Greg Savage, Heidi Weiss, Donna Wilson, and Bradley Wolgast for their data coding and entry assistance. Correspondence concerning this article should be addressed to Michael V. Ellis, Department of Counseling Psychology, Educa- tion 220, University at Albany, State University of New York, 1400 Washington Avenue, Albany, New York 12222. Electronic mail may be sent via Internet to me464@cnsibm.albany.edu. 35 1971; Holloway Russell, Crimmings, Holloway, 1984, 1992; Holloway Kaplan, 1983; Lambert Leddick Liddle Matarazzo, 1971, 1978; Matarazzo Matarazzo Russell Stoltenberg, McNeill, Yutrzenka, 1995) or did so in a cursory fashion (i.e., Baker Baker, Daniels, Ford, 1979; Hansen, Pound, Robins, Hansen Holloway Holloway Kurtz, Mar- shall, Loganbill, Hardy, Stein Worthington, 1987). Only four reviewers presented details of the methodological flaws encountered in the studies reviewed (Alberts Avis Holloway, 1987; Russell et al., 1984). The result of not systematically evaluating the methodological issues may have erroneously led to (a) equating (or even outweighing) the findings of excellent research with poor research (Hogarty, 1989; Kline, 1983), (b) exacerbating the theoretical ambiguity in the field (Meehl, 1990), and (c) drawing inaccurate inferences and conclusions (Cooper, 1989; Ellis, 1991a). The most recent review of research in individual clinical supervision that