Scoring the Examinations

There are two parts involved in scoring the exams, the Post-Test Analysis and Establishing the Passing Score.

Post-Test Analysis

After the administration, the psychometrician (an expert in exam statistics) utilizes statistical analysis to identify any “problem” questions on the exam. Each of these is reviewed by a panel of Subject Matter Experts (SMEs) for both clarity and content. Based on this review, it may be determined that the correct answer should be changed, or credit may be given for more than one answer, or no change in scoring will be made. This process helps ensure that the results are valid and fair.

Establishing the Passing Score

There is no predetermined passing score. This is different from academic tests, where, for example, a 70% might be needed in order to pass. There is also no “grading on a curve,” for instance, where the top 80% will pass. Instead, the Angoff method, an internationally recognized statistical process, is used to determine the passing score. This method is specifically designed for professional licensing exams where the goal is to determine minimal competence. Minimal competence is the term used for professional licensing exams to gauge the knoweledge, skill, and ability necessary to safely pracice as a licensed/registered naturopathic medical doctor. In this method, a panel of SMEs rates each question on the exam, estimating the probability that a minimally competent candidate would be able to answer the question correctly. These ratings are then used to determine the passing score (“cut score”). Exams that are judged to be more difficult will have lower cut scores than less difficult exams (i.e., for a more dificult exam, the examinee will be required to answer fewer questions correctly in order to pass). Because each exam is unique, the cut score will vary somewhat between administrations.

Reporting the Scores

It takes approximately 7 weeks to complete the scoring process. Once the process is complete, the scores are release to NABNE.