Skill Standards: Navigating Old Narrative Traps - A Briefing Note for Instructional Designers in New Zealand Vocational Education and Training

This document (Skill_Standards_Briefing-VET.pdf) addresses a structural gap in the professional support available to instructional designers working with skill standards in New Zealand vocational education and training. Skill standards, introduced under the Education and Training Act 2020 and mandatory in qualifications from January 2026, are replacing unit standards across the sector. The guidance materials available to practitioners are written for multiple audiences, contain internal inconsistencies, and do not provide a single, stable method for converting a published skill standard into a moderation-ready assessment package. This document provides that method and situates it within a systematic analysis of the claims the sector transition has generated. The initial draft of the work was the authors own unassisted private research, attempting to reconcile inconsistent and conflicting official messaging about skill standards assessment writing. The goal was to describe a practically useful methodology that was logically consistent. The final work deposited here is a response to requests from a national network of approximately 20 instructional designers across New Zealand working with skill standards. The Decode–Define–Design framework The practical contribution of this document is the Decode–Define–Design (3D) framework: three assessment design dimensions containing five diagnostic steps, each addressing a known failure mode. The three dimensions are Decode (what exactly is being assessed?), Define (what does acceptable look like in real practice?), and Design (what must the learner produce to prove competence?). Within these dimensions, five steps provide the operational sequence: Lock the target; Define accountability; Define acceptability; Isolate learner voice; Build the portfolio. Each step is labelled with a micro-tagline encoding the failure mode it prevents. The framework is accompanied by a 3D Test providing a rapid pre-moderation readiness check. The 3D workflow described in this briefing has been applied by the author across ten consecutive skill standards assessments, all of which passed pre-moderation with no changes required. The framework is original to the author and was refined through systematic cross-referencing of official guidance materials against primary sources. It is calibrated to the actual job description of an instructional designer working with skill standards: interpreting the standard, designing assessment tasks and learning resources, producing assessor guides and judgement statements, and submitting for pre-moderation. Claims analysis The document examines four specific claims in active circulation in the sector and evaluates each against primary sources. Claim 1: Skill standards are holistic; unit standards produce atomised checklist assessment. The analysis finds that holism is a property of assessment design, not of a standard type, and that integrated assessment tasks have always been available under unit standards. Calling a standard holistic does not make the programme holistic. Claim 2: Unit standards assessed skills only; skill standards are the first to require knowledge assessment. The source of this claim — Vaughan and Kear (2024) — uses careful qualifiers including "a significant proportion," "often," and "framed." By the time the claim appears in sectoral guidance, all qualifiers have been removed. The analysis further establishes that "Demonstrate Knowledge Of" was always an ITO authoring choice, not a format requirement — NZQA's own unit standard definitions page demonstrates that skills-based outcomes were available from the beginning. The BCATS Programme Guidance (Waihanga Ara Rau, 2025) then provides evidence that even the new skill standards cannot separate knowledge from skill: Not Achieved indicators for practical skills standards include knowledge failure as the identified cause of performance failure. Claim 3: Unit standards assessed knowledge only (DKO). A parallel narrative in sector workshops and training materials is that unit standards focused too heavily on knowledge, often summarised as “DKO” (Demonstrate Knowledge Of), with guidance to “move away from DKO.” At the same time, examples of published skill standard outcomes continue to integrate knowledge and performance (e.g., “Apply knowledge of…”). This suggests that “DKO” functions as a simplified teaching shorthand rather than a precise description of the unit standard model. The coexistence of these positions indicates instability in how the system is being explained to practitioners, rather than a coherent or consistent diagnosis of the previous model. Claim 4: Assessment criteria represent a conceptual shift from performance criteria, not a terminological relabelling. The analysis establishes that this claim lacks legislative foundation. The Education and Training Act 2020 defines skill standards as including "the levels of performance in those skills" — the same performance-centred language that justifies performance criteria in unit standards. NZQA's own 2022 FAQ states that the only definitional difference between unit standards and skill standards is the explicit inclusion of learning outcomes. NZQA's unit standard definitions page itself labels performance criteria as "evidence requirements" and states they specify "the critical evidence to meet the outcomes." The ConCOVE guidance defines assessment criteria as "what the assessor should look for." These are descriptions of the same documentary function from different grammatical perspectives. The Muka Tangata guidelines complete a circle: having received the ConCOVE guidance that assessment criteria are not performance criteria, they define assessment criteria as "the required performance levels of each skill" — the language of performance criteria. Methodology Systematic document analysis was initially conducted without AI assistance, cross-referencing official guidance materials against primary sources. AI assistance (Claude, Copilot, Gemini) was employed as a multi-agent consensus framework, Sources include the Education and Training Act 2020; NZQA founding documents (1991); the NZQA unit standard definitions page; the NZQA listing guidelines for skill standards; the NZQA skill standards FAQ (2022); the ConCOVE Good Practice Toolkit (Vaughan and Kear, 2024); Muka Tangata WDC provider guidelines (2025); the Muka Tangata pre-moderation outcomes report (June 2025); and BCATS Level 1–3 Programme Guidance (Waihanga Ara Rau, 2025). All primary sources are publicly available and listed with URLs in the document's appendices. All professional judgements, contextual interpretation, and conclusions are the author's own. A companion document containing the full historical analysis of the 1991 NZQA founding documents — including Peddie (1992), Beyond the Norm?, and the pre-NCEA norm-referenced mechanisms — was produced as part of the same analytical exercise and is retained privately. The briefing note draws on that analysis without reproducing it. Significance as practitioner evidence This document is deposited as a primary-source practitioner artefact with scholarly significance in three areas. As evidence of a structural gap in the skill standards transition infrastructure. The document establishes, from primary sources, that the confusion experienced by instructional designers working with skill standards is structural rather than individual. The Education and Training Act 2020 definition of skill standards specifies what a standard IS but not how to assess it. NZQA Rules add assessment criteria and specifications as required components but leave their content to Industry Skills Boards. NZQA guidelines require "less prescriptive detail than unit standards" as a design principle. ISBs produce standards that are definitionally compliant but operationally variable. Instructional designers receive standards at the end of this gap cascade without guidance on how to bridge the distance between a published standard and a moderation-ready assessment package. This document names and documents that gap from primary sources rather than from practitioner impression. As a test of the claim that AI-assisted systematic document analysis can function as a professional development substitute where formal professional development infrastructure is absent. This document was produced in response to the absence of adequate professional development for instructional designers implementing the skill standards transition. The analytical work required to produce it — locating and reading primary sources, cross-referencing claims, confirming contradictions found by the author, tracing qualifier removal across document generations — was conducted collaboratively with an AI assistant. The resulting analysis is more systematically evidenced than what a practitioner could produce from reading alone, and more practically calibrated than what an academic researcher without practitioner experience would produce. The document is deposited as evidence that this collaborative mode of professional knowledge production is viable and produces traceable, defensible outputs. As a point-in-time record of an immature policy implementation. The Muka Tangata pre-moderation outcomes report (June 2025) states that assessment design and practice have "not fundamentally changed" under skill standards. This document, produced in May 2026, captures the state of available guidance and identified gaps at the earliest stage of sector-wide implementation. It will have retrospective value as the implementation matures and subsequent guidance either resolves or compounds the issues identified here. The consistent findings across three independent readings suggest that the interpretive difficulties experienced by experienced instructional designers are real, document-generated, and reproducible. On that basis, this briefing note is not only defensible; it is ne