ISO/IEC 17024 Compliance Roadmap

The Path to Accredited Certification
Kevin Pimentel | Tech Lead | Foundry Investigation

ISO/IEC 17024:2012 is the international standard for personnel certification bodies. It defines the requirements for organizations that certify people — impartiality, competency-based exam development, psychometric validation, and formal governance. This roadmap maps the concrete steps, dependencies, and decision gates from "commit to building" to "ANAB accreditation achieved." It is research — not a project plan.

1

Why ISO 17024 Matters

Employer Trust

Accredited certifications are recognized by government workforce programs, DoD contractors (8570.01-M), and enterprise HR departments that require third-party validated credentials. Without accreditation, SPCE is "SolidProfessor's certification." With it, SPCE is "an accredited industry certification" — the same category as CompTIA A+, CISSP, and PMP.

Institutional Adoption

Schools and CTE programs increasingly prioritize industry-recognized credentials for curriculum alignment and Perkins V accountability reporting. While accreditation requirements vary by state, community colleges building workforce development pipelines need credentials their advisory boards recognize as independently validated. ISO 17024 strengthens adoption potential that CSWA/CSWP — which has no published accreditation — cannot match.

Competitive Moat

CSWA/CSWP has no published psychometric validation, no independent governance, and no ISO 17024 accreditation. It is a vendor self-issued credential. Achieving ISO 17024 accreditation creates a defensible, structural differentiator that cannot be replicated quickly — the process alone takes 18-24 months of documented operating data.

Global recognition through mutual agreement. ANAB is a signatory to the IAF Multilateral Recognition Arrangement (MLA), meaning ISO 17024 certifications accredited through ANAB are recognized internationally across all IAF signatory countries. This eliminates duplicative assessment for multinational employers and enables global workforce mobility. The U.S. Department of Energy specifically selected ISO 17024 for its Weatherization Assistance Program (WAP) and Home Energy Professional (HEP) certifications — a concrete precedent for government adoption of the standard.

2

The Firewall Requirement

Non-Negotiable: Training ≠ Certification

Because SolidProfessor provides both training content AND would issue the certification, ISO 17024 (Clause 5.2.3) requires a documented firewall policy. This is the single most organizationally disruptive requirement — it affects who can do what.

What the Firewall Requires

  • The people who develop SP training courses CANNOT write or review exam questions
  • The people who make certification pass/fail decisions CANNOT be influenced by training revenue targets
  • An independent certification committee must govern exam content, cut-scores, and appeals
  • Training and certification must maintain separate budgets and reporting lines for certification decisions
  • All of the above must be formally documented and auditable

What This Means Practically

  • A certification committee (3-5 members, majority external) governs all exam decisions
  • SMEs who author exam items cannot also author SP course content (or vice versa)
  • The certification program has its own documented quality management system
  • Training staff can inform the JTA (as practitioners) but cannot control exam content
  • ANAB auditors will verify this separation during onsite assessment

This is not optional. It is not a formality. Clause 5.2.3(e) specifies that personnel who have provided training to a candidate are prohibited from serving as an examiner for that candidate for a default period of two years — reducible only if the certification body can demonstrate no compromise to impartiality. No marketing may imply that completing SP training simplifies or guarantees certification. And per Clause 6, the final certification decision — grant, suspend, or revoke — can never be outsourced. ANAB auditors specifically verify all of this during onsite assessment.

Impartiality as Ongoing Risk Management (Clause 4.3)

Beyond the training/certification firewall, ISO 17024 requires a formal, ongoing threat analysis — reviewed annually — covering four categories of impartiality risk:

Self-Interest

Revenue dependency on specific clients or corporations skewing certification decisions in their favor.

Self-Review

An individual evaluating the competence of someone they recently trained or mentored.

Familiarity

Examiners becoming sympathetic to candidates due to long-standing personal or professional relationships.

Intimidation

Examiners or decision-makers coerced — professionally or otherwise — into altering certification outcomes.

An independent impartiality committee, consisting of diverse stakeholders, must review these threats at least annually and document mitigation actions.

3

The Roadmap: From Commitment to Accreditation

Four phases, each with a decision gate. Nothing in Phase N+1 can begin until Phase N's gate is passed. Total timeline: 18-24 months from commitment to ANAB accreditation.

Phase 0
Months 1-3
Build the governance foundation
Form advisory board (5-7 industry experts + academics) Contract psychometric services firm Contract JTA facilitator (may overlap with psychometric firm) Document firewall policy Establish certification committee charter
GATE: Advisory board seated. Firewall policy approved by legal. Psychometric services firm contracted.
Phase 1
Months 3-9
Build a defensible exam
Conduct JTA with statistically significant practitioner sample Develop exam blueprint from JTA domains AI-assisted item authoring (400-500 drafts) SME review panel (~60% item survival rate) Pilot exam with 200+ test-takers Psychometric item analysis Cut-score setting (Angoff Method) Document exam development procedures
Psychometric benchmarks: Item analysis measures difficulty (p-value) and discrimination (point-biserial correlation). Items with negative discrimination — where low-performers answer correctly more often than high-performers — are flagged for removal. Beta items are embedded as unscored experimental questions in live exams to gather performance data. Exam reliability targets Cronbach's alpha (α) ≥ 0.70, the industry benchmark for high-stakes certification. Standard Error of Measurement (SEM) is calculated at the cut score to ensure pass/fail decisions fall within a defensible confidence interval.
GATE: Validated exam blueprint. Calibrated item bank (200-250 production items). Documented cut-scores. All procedures recorded.
Phase 2
Months 9-18
Launch and prove the system works
Launch SPCE Associate (proctored, Bloom's-balanced) Collect 6-12 months of operating data Ongoing item analysis (flag underperforming items) Document scoring, appeals, and security processes Build complete Quality Management System (QMS) Conduct internal audit against ISO 17024 clauses
QMS requirements (Clause 10): Internal audits must occur at minimum every 12 months, following ISO 19011 auditing principles — auditors cannot audit their own work. Top Management Review is mandatory annually with a prescribed agenda: audit results, stakeholder feedback, impartiality threat status, corrective action effectiveness, appeals trends, and resource allocation decisions. Minutes of these reviews are required evidence during ANAB assessment.
GATE: 6+ months operating data. Complete QMS documentation. Pass/fail rate analysis confirms exam validity. Internal audit completed. Management review conducted.
Phase 3
Months 18-24
Earn accreditation
Submit application (ANAB PCAC-FR-504) Prepare documentation package ANAB desk review per PR 7501 Onsite assessment (lead auditor + psychometric SME) Resolve Corrective Action Requests (typically ~60 days) Accreditation granted
ANAB assessment process: After desk review, a multi-day onsite assessment is conducted by a team comprising a lead quality systems auditor and a technical psychometric subject matter expert. They review operational records, interview leadership, inspect data security, and cross-reference documented policies against observed practices. Non-conformities generate formal Corrective Action Requests (CARs) — the certification body typically has ~60 days to conduct root-cause analysis, implement fixes, and submit evidence of resolution. Initial assessments rarely pass without findings.
GATE: All CARs resolved. ANAB accreditation achieved. SPCE becomes an ISO/IEC 17024 accredited certification.
Phase 4
Ongoing
Keep the credential credible
Year 1: Remote surveillance (questionnaire + document review) Year 2-3: Full onsite reassessment Ongoing 2-5 year reassessment cycle Item bank refresh (retire exposed items, author new ones) JTA refresh every 3-5 years Continuing education tracking for certificants Annual internal audit + management review
Note: Accreditation is not permanent. ANAB can escalate to an unscheduled onsite audit if it receives significant complaints or if previous assessments generated severe findings. The certification body must maintain continuous readiness.
4

Critical Path: What Blocks What

Longest Pole
Psychometric Services Contract
Cut-Score Setting
Exam Launch

Vendor selection and contracting compresses the sourcing timeline vs. hiring a niche FTE. Still blocks everything downstream.

Advisory Board Dependency
Advisory Board Formation
JTA Study
Exam Blueprint
Item Authoring

Advisory board must be seated before the JTA can begin.

Operating Data Requirement
Exam Launch
6-12 Months Operating Data
ANAB Application

ANAB requires the program to be fully operational before assessment. Industry guidance suggests 6-12 months of data.

Firewall Blocker
Firewall Policy
ANAB Application

No firewall documentation = automatic denial.

Psychometric services and JTA facilitation are the longest poles. Contracting a specialized firm (e.g., Alpine Testing Solutions, PSI Services, Prometric consulting) compresses the sourcing timeline from months to weeks compared to hiring a niche FTE. ISO 17024 (Clause 6) explicitly permits outsourcing psychometric development and analysis — but requires legally binding agreements, documented confidentiality, and annual vendor evaluations. The one limitation: the final certification decision (grant, suspend, revoke) can never be outsourced.

5

The Cost of Accreditation

Accreditation is a long-term financial commitment across two categories: direct accreditation body fees and internal program development costs. Both must be budgeted before committing.

ANAB Accreditation Fees

Direct fees levied by ANAB for the accreditation lifecycle. Current amounts are published in ANAB PR 7522.

Fee Category Basis
Application fee Per program, includes baseline desk review hours
Additional programs Per additional certification level/specialty
Extended desk review Hourly, beyond baseline allocation
Onsite assessment Per assessor, per day
Assessor travel Per day + actual travel expenses
Annual renewal Recurring annual fee per program

Alternative path: IAS + ICE dual accreditation provides a streamlined option for organizations seeking both NCCA and ISO 17024 recognition.

Internal Program Costs

The larger investment. These are not accreditation fees — they're the cost of building the program itself.

  • Psychometric services firm — Outsourced per ISO 17024 Clause 6. Handles JTA facilitation, item analysis, Angoff studies, reliability reporting, and the technical report for ANAB. A full JTA + standard-setting engagement can range into tens of thousands of dollars. This is the single largest line item.
  • Legal counsel — Firewall policy review, certification committee charter, liability insurance.
  • Advisory board — Honoraria, travel, meeting costs for 5-7 external experts.
  • Technology — Proctoring platform, item banking software, candidate management system.
  • Organizational time — QMS documentation, internal audits, management reviews, staff training.

Accreditation fees are the smaller part. The real investment is the psychometric services contract and the organizational time required to build a compliant quality management system. Budget accordingly.

6

What If Accreditation Fails?

Even if ANAB denies accreditation on the first attempt, the work product is not wasted. Every step in this roadmap produces assessment infrastructure that improves SolidProfessor's products regardless of the accreditation outcome:

The Process Wins

  • JTA — The exam tests what practitioners actually do (not what SP happens to teach)
  • Psychometric validation — Questions actually measure what they claim to measure
  • Bloom's-balanced item bank — Every assessment product improves, not just certification
  • Firewall policy — Governance maturity that builds institutional trust
  • Operating data — Real competency signals instead of engagement metrics

What Changes Without Accreditation

  • SPCE can still launch — accreditation is a credibility multiplier, not a prerequisite
  • Government/DoD procurement channels remain closed
  • Some CTE programs may not adopt without accreditation
  • The credential competes as "SolidProfessor's certification" rather than "an accredited industry certification"
  • Reapplication is possible after addressing nonconformities

Accreditation is the credibility multiplier on top. The foundation underneath it is worth building either way.

7

ISO 17024 Requirements Checklist

A reference overview of key ISO/IEC 17024 clauses and their current status. All items show "Not Started" — this is research documentation, not a project tracker.

Requirement ISO Clause Status Notes
Legal entity & financial liability 4.1 Not Started Cert body must be a distinct legal entity with financial reserves or liability insurance
Certification body impartiality 4.2 Not Started Formal annual threat analysis (self-interest, self-review, familiarity, intimidation)
Firewall: training vs. certification 5.2.3 Not Started Documented separation of personnel and decision-making
Certification committee independence 4.3 Not Started Majority external members required
Personnel competence & examiner qualification 6 Not Started Formal training, NDAs, conflict-of-interest declarations for all personnel; examiner qualification program
Competency definition (JTA) 8.2 Not Started Job Task Analysis with statistically significant practitioner sample
Exam development from JTA 8.3 Not Started Blueprint-driven item development, Bloom's mapping
Cut-score methodology 8.4 Not Started Angoff Method with SME panel; requires psychometric services
Exam security & integrity 9.3 Not Started Proctoring, item exposure controls, cooldown periods
Scoring & decision process 9.4 Not Started Documented, reproducible, auditable
Appeals & complaints process 9.8 Not Started Formal appeals pathway with guaranteed review
Certification renewal/recertification 9.6 Not Started Renewal criteria, CE requirements, recertification exam
Quality Management System 10 Not Started Document control, internal audits, management review
Records & confidentiality 10.2 Not Started Candidate data protection, exam content security

Note: Clause numbers reference ISO/IEC 17024:2012. The full standard text is available for purchase from ISO. Clause groupings above reflect the standard's published table of contents and publicly available summaries from accreditation bodies including ANAB.

Sources

  • ISO/IEC 17024:2012 — Conformity assessment — General requirements for bodies operating certification of persons. iso.org/standard/52993.html
  • ANAB (ANSI National Accreditation Board) — Personnel Certification Accreditation Program. anab.ansi.org/accreditation/personnel-certification
  • DoD 8570.01-M — Information Assurance Workforce Improvement Program, baseline certifications requiring ISO 17024 accreditation for certain roles. public.cyber.mil
  • Perkins V (Strengthening Career and Technical Education for the 21st Century Act) — Federal CTE legislation emphasizing industry-recognized credentials. cte.ed.gov/legislation/perkins-v
  • Angoff Method — Standard-setting methodology for establishing defensible cut-scores. assess.com
  • Anderson & Krathwohl (2001) — A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy. Krathwohl 2002 (PDF)
  • CompTIA — ISO 17024 accredited certification body. comptia.org
  • ISC2 (CISSP) — ISO 17024 accredited since ~2004 via ANAB. isc2.org/certifications/cissp
  • PMI (PMP) — ISO 17024 accredited via ANAB. pmi.org
  • ASME Y14.5-2018 — Dimensioning and Tolerancing (GD&T standard referenced in exam domain mapping). asme.org
  • ANAB PR 7501 — Accreditation Procedure for Credentialing Programs. anabpd.ansi.org (PR 7501)
  • ANAB PR 7522 — Fees — Accreditation of Credentialing Programs. anabpd.ansi.org (PR 7522)
  • IAF Multilateral Recognition Arrangement (MLA) — ANAB recognized as first ISO 17024 program by IAF, APAC, and IAAC. anab.ansi.org
  • U.S. Department of Energy — Guidelines for Home Energy Professionals Credentials (WAP/HEP), developed under ISO 17024. energy.gov
  • IAS + ICE Dual Accreditation — ISO/IEC 17024 accreditation via International Accreditation Service and Institute for Credentialing Excellence. credentialingexcellence.org
  • ISO 19011:2018 — Guidelines for auditing management systems (referenced for internal audit methodology). iso.org/standard/70017.html