CET - Certified Environmental, Safety & Health Trainer Training Program Evaluation Questions and Answers — Questions and Answers
Question 1: A company invested a significant amount in a comprehensive ergonomics training program for its assembly line workers. The EHS Director has now been asked by senior management to justify the expenditure by demonstrating its financial benefit. Which evaluation method is specifically designed to address this request?
- Kirkpatrick's Level 3 (Behavior) Evaluation
- The Phillips ROI Methodology (Correct answer)
- Formative Evaluation
- CIPP (Context, Input, Process, Product) Model
Correct answer: The Phillips ROI Methodology
The Phillips ROI Methodology is an extension of the Kirkpatrick Model that adds a fifth level specifically to calculate the monetary return on investment (ROI) of a training program. This directly answers senior management's request to demonstrate financial benefit. Kirkpatrick's Level 3 focuses on behavior change, Formative Evaluation assesses the program during its development, and the CIPP model is a broader program evaluation framework not specifically focused on financial ROI.
Question 2: During the pilot delivery of a new ladder safety course, the trainer collects feedback from participants at the end of each module regarding the clarity of the instructions and the relevance of the activities. This is an example of which type of program evaluation?
- Summative Evaluation
- ROI Analysis
- Formative Evaluation (Correct answer)
- Impact Evaluation
Correct answer: Formative Evaluation
Formative evaluation is conducted *during* the development or implementation of a training program with the goal of making immediate improvements. Collecting feedback during the pilot session to refine the course is a classic example of formative evaluation. Summative evaluation occurs *after* the program is complete to judge its overall worth.
Question 3: An EHS trainer wants to understand *why* a recent safety training session received mixed reviews on the end-of-course survey. Which of the following evaluation methods would be most effective for gathering rich, detailed, qualitative data about the participants' experiences and suggestions?
- Administering a multiple-choice post-test.
- Reviewing pre- and post-training injury logs.
- Conducting a focus group with a sample of trainees. (Correct answer)
- Analyzing Likert scale ratings from the survey.
Correct answer: Conducting a focus group with a sample of trainees.
A focus group is a qualitative data collection method that allows a facilitator to guide a discussion and probe for deeper insights, opinions, and reasons behind quantitative ratings. This is ideal for understanding the 'why' behind mixed reviews. Post-tests, injury logs, and Likert scales provide quantitative data but lack the detailed, explanatory power of a focus group.
Question 4: A manufacturing company implemented a new machine guarding training program. Evaluation data shows that 95% of employees passed the final knowledge exam (Kirkpatrick Level 2), but workplace observations conducted three months later show only a 20% increase in the correct application of new guarding procedures (Kirkpatrick Level 3). What is the most likely cause of this discrepancy?
- The training content was inaccurate.
- The final knowledge exam was too difficult.
- The evaluation was conducted too soon after training.
- There are organizational barriers preventing behavior change. (Correct answer)
Correct answer: There are organizational barriers preventing behavior change.
The high scores on the knowledge exam indicate that learning occurred (Level 2). The low rate of application (Level 3) suggests that while employees know *what* to do, something in the work environment is preventing them from *doing* it. This often points to organizational or environmental barriers, such as lack of supervisor support, peer pressure to take shortcuts, or lack of necessary tools and time.
Question 5: Which of the following is the primary purpose of conducting a summative evaluation of an established EHS training program?
- To make real-time adjustments to the training materials during a class.
- To determine the overall effectiveness and value of the program to decide on its continuation. (Correct answer)
- To identify the specific training needs of individual employees before they attend the course.
- To provide immediate feedback to learners on their understanding of a single module.
Correct answer: To determine the overall effectiveness and value of the program to decide on its continuation.
Summative evaluation "sums up" the effects of a program after it has been implemented to assess its overall success, value, and impact. The results are often used to make major decisions, such as whether to continue, modify, or terminate the program. The other options describe formative evaluation (A, D) or needs assessment (C).
Question 6: A large distribution center implements a comprehensive safe lifting and ergonomics training program aimed at reducing musculoskeletal disorders (MSDs). To evaluate the program at Kirkpatrick's Level 4 (Results), which of the following metrics would be the MOST relevant?
- Scores on a post-training knowledge test about lifting techniques.
- The number of employees observed using proper lifting techniques one month after training.
- Trainee satisfaction ratings on the end-of-course feedback form.
- A reduction in the company's workers' compensation claims for MSDs. (Correct answer)
Correct answer: A reduction in the company's workers' compensation claims for MSDs.
Kirkpatrick's Level 4 (Results) measures the training's impact on business outcomes. A reduction in workers' compensation claims is a direct, measurable business result tied to the program's goal of reducing MSDs. Satisfaction ratings are Level 1, knowledge test scores are Level 2, and behavioral observations are Level 3.
CET - Certified Environmental, Safety & Health Trainer Training Program Evaluation Questions and Answers
A company invested a significant amount in a comprehensive ergonomics training program for its assembly line workers.
The EHS Director has now been asked by senior management to justify the expenditure by demonstrating its financial benefit.
Which evaluation method is specifically designed to address this request?