The Modified Delphi Technique - A Rotational Modification

This study describes and illustrates a modification of the Delphi technique that was designed to extend its applicability to large competency data sets. The approach consisted of rotating sub-sets of a larger set of competencies through three sub-panels and then examining the viability of the approach. The context of the study was the identification of competencies needed to update training requirements for 21st century plastering contractors. Based on the outcomes of this study, the rotational approach represents a promising mechanism for extending the usefulness of the Delphi tool to larger data sets. The findings also indicate that the factors that erode the validity and usefulness of traditional modified Delphi studies also negatively affect the rotational approach. An obstacle facing many educators has been identifying an appropriate research methodology for developing curriculum when teaching vocational subjects. This is especially true when a research topic is very broad and when new curricular areas are being developed. In such situations there is often a large number of competencies to be evaluated by recognized experts in the content area. A number of techniques have been used that are generally associated with the competency-based approach to curriculum development. These include such tools as occupational analysis, DACUM (Developing a Curriculum), and the Delphi technique ( Finch Frykland, 1970 ; Miller, 1990 ; Rothwell McCampbell Weaver, 1971 ). Participants were solicited experts in the issues related to national defense such as forecasting probable bombing targets the Russian government might choose in the event of an attack on the United States ( Dalkey & Helmer, 1963 ). The Delphi begins with an open-ended questionnaire that is given to a panel of selected experts to solicit specific information about a subject or content area. In subsequent rounds of the procedure, participants rate the relative importance of individual items and also make changes to the phrasing or substance of the items. Through a series of rounds (typically three) the process is designed to yield consensus. The modified Delphi technique is similar to the full Delphi in terms of procedure (i.e., a series of rounds with selected experts) and intent (i.e., to predict future events and to arrive at consensus). The major modification consists of beginning the process with a set of carefully selected items. These pre-selected items may be drawn from various sources including related competency profiles, synthesized reviews of the literature, and interviews with selected content experts. The primary advantages of this modification to the Delphi is that it (a) typically improves the initial round response rate, and (b) provides a solid grounding in previously developed work. Additional advantages related to the use of the modified Delphi technique include reducing the effects of bias due to group interaction, assuring anonymity, and providing controlled feedback to participants ( Dalkey 1972a, 1972b, & Judd 1972 ). Brooks (1979) noted that three mailings are usually sufficient in order to arrive at consensus.