Validate and Revise

To validate a structured learning program, assemble a group of 15 to 20 volunteers to review the subject matter. The validation group should represent people who will actually use your program.

Instruct the volunteers

Before you start the validation, thank the group for volunteering and tell them:

• The validation is a very important step in the program development cycle since the program cannot be released without first being tested.  The purpose of the validation is to test the training program, not the people taking the course.

• Don't worry if you don't know the answers to the pretest questions. You haven't been through the course yet.

• Move through the program at your own pace.

• Make sure you answer all the questions on the test and respond to any and all interactive learning frames.

Give a pre-test

Now you are ready to start. The first step in the validation is to give the volunteers a pretest to assess their current knowledge.

Monitor test session

After the pretest, monitor users as they go through the program to ensure they follow the proper sequence. Take note of any participants who don't take the program seriously and discard their results.

Give a post test

At the end of the program, the participants should take a post test to evaluate what they've learned. The post test should be identical to the pre-test so you can make a valid comparison.  The Evaluation Center program generates a final exam.

Give users a questionnaire

The last step in the validation is to give the participants a questionnaire to get their feedback on the effectiveness of each part of the program. Include objective questions with measurable responses. For example, rate the lesson on a scale of 1 to 5. Also provide room for comments and suggestions on the form.

Review

Use the Test Results Detail screen to analyze how learners answered each question. Try to spot questions that were consistently missed. This may indicate that the question is too difficult or the subject matter wasn't thoroughly covered in the program. Likewise, questions that were rarely missed may be too easy and should be restated or eliminated. Overall, you should see a 10-20 percent rise in the post-test scores over the pre-test.

Also, consider feedback on the questionnaire. Did users find mistakes or confusing areas in the program? Did graphics convey the desired message?

Revise

Based on your review of user test scores and questionnaires, make changes to your learning program. Proof it carefully because the next step is final approval by the review board.

Approve

Send the final version of your program to the people whose approval is required before your program can be published. Use Active Learner's Management of Change module to simplify sending your program through the approval process. These people might include an editor, a subject matter expert, and a manager.