Co-authored by: Reed Castle, Ph.D. and Vincent Lima

Certification examination programs often have more than one examination form (set of questions, or items) in use at a time, and they require routine updates. The exam forms represent the same content, but have different items. As new items come into use, they may be easier or harder than the first set of items. As a result, exam forms can have varying degrees of difficulty. These variations need to be taken into account when reporting scores and pass/fail decisions over time and exam forms.

A job/task analysis is (JTA) is a very close look at a job, portion of a job, or concept job in order to identify the tasks and associated knowledge, skills and abilities (KSAs) required to competently perform the job.  A JTA is the foundation for the development of a certification program or a certificate program.  Only after the KSAs have been identified can a certification body or educational program determine how to measure competence of the KSAs or how to teach the KSAs.  There are multiple methods for conducting a JTA including using focus groups, structured interviews, job shadowing and observations, and surveying practitioners.  When conducting a JTA as the basis for a certification program, the method used is not as important as making sure the right subject-matter-experts (SMEs) participate in the process.