CHSE Debriefing and Assessment Methods Questions and Answers 1 — Questions and Answers
Question 1: An educator is using a global rating scale (GRS) instead of a detailed checklist to assess teamwork skills during a complex trauma scenario. What is the primary advantage of using a GRS for this type of assessment?
- It provides a more objective measure of specific, discrete actions performed by the team.
- It is faster to develop and requires less expertise to create than a checklist.
- It better captures nuanced aspects of performance and the integration of skills that are difficult to itemize. (Correct answer)
- It eliminates rater bias by focusing only on whether a task was completed or not.
Correct answer: It better captures nuanced aspects of performance and the integration of skills that are difficult to itemize.
A global rating scale (GRS) is designed to assess broader domains of performance, such as communication, teamwork, or clinical decision-making. Unlike a checklist, which focuses on the completion of specific, individual tasks, a GRS allows an evaluator to make a more holistic judgment about the quality and integration of complex skills. This makes it particularly well-suited for assessing nuanced behaviors that are difficult to break down into a binary (done/not done) format.
Question 2: During a debriefing, a facilitator observes that a learner is visibly upset and quiet after a difficult scenario. The facilitator says, "I noticed you became quiet during the last part of the scenario. I was thinking it might have been a challenging moment. Can you help me understand what was going on for you at that time?" This is a classic example of which debriefing technique?
- Plus-Delta
- Advocacy-Inquiry (Correct answer)
- The 3D Model (Defusing, Discovering, Deepening)
- Rapid Cycle Deliberate Practice
Correct answer: Advocacy-Inquiry
The Advocacy-Inquiry technique involves the facilitator making an observation (advocacy) and then asking a genuine question (inquiry) to explore the learner's underlying thought processes or 'frames'. The statement pairs an observation ("I noticed you became quiet...") with an inquiry ("Can you help me understand...?") to open a safe and curious dialogue, which is the hallmark of this method.
Question 3: Which of the following scenarios best describes a summative assessment in a simulation-based curriculum?
- A facilitator pausing a scenario to provide real-time coaching on communication techniques.
- Learners engaging in a peer-feedback session immediately following a team-based simulation.
- A medical resident performing a simulated central line insertion that must be passed before being allowed to perform the procedure on patients. (Correct answer)
- A nursing student practicing medication administration on a manikin with a faculty member providing tips for improvement.
Correct answer: A medical resident performing a simulated central line insertion that must be passed before being allowed to perform the procedure on patients.
Summative assessment is an 'assessment OF learning' used to evaluate a learner's competence at the end of an instructional period, often with a pass/fail consequence. Requiring a resident to pass a simulated procedure before performing it clinically is a high-stakes evaluation of mastery, which is characteristic of a summative assessment. The other options describe formative assessments, which are 'assessments FOR learning' and focus on providing feedback for improvement.
Question 4: A simulation program is using the Plus-Delta model for debriefing. A novice facilitator notices that during the 'Delta' (Δ) phase, learners are only listing things that went wrong without discussing how to improve. What is the most appropriate action for the facilitator to take?
- End the debriefing to avoid further negative comments and demoralizing the team.
- Refocus the conversation by asking, "Based on what we've identified, what specific actions could we take to change the outcome next time?" (Correct answer)
- Switch to the 'Plus' (+) phase to focus only on the positive aspects of the performance.
- Tell the learners the correct solutions to the problems they identified.
Correct answer: Refocus the conversation by asking, "Based on what we've identified, what specific actions could we take to change the outcome next time?"
The 'Delta' (Δ) in the Plus-Delta model is meant to identify what could be changed or done differently for improvement, not just list errors. The facilitator's role is to guide the learners from simple critique to constructive planning. Refocusing the question towards actionable changes directly addresses the purpose of the 'Delta' phase and promotes reflective learning.
Question 5: A key principle of the "Debriefing with Good Judgment" approach is to uncover the learner's 'frames.' What does the term 'frames' refer to in this context?
- The video playback segments selected for review during the debriefing.
- The established clinical protocols and algorithms relevant to the scenario.
- The learner's underlying assumptions, knowledge, and feelings that drive their actions. (Correct answer)
- The physical and environmental layout of the simulation room.
Correct answer: The learner's underlying assumptions, knowledge, and feelings that drive their actions.
In the "Debriefing with Good Judgment" model, 'frames' are the internal cognitive and emotional structures—such as assumptions, feelings, knowledge, and goals—that shape how a learner perceives a situation and, consequently, how they act. The goal of debriefing is to make these invisible frames visible to help the learner reflect on why they took certain actions.
Question 6: Which of the following assessment methods is designed primarily for learning and skill acquisition DURING the simulation activity itself, rather than after?
- Summative OSCE station
- Global Rating Scale completed post-scenario
- Rapid Cycle Deliberate Practice (RCDP) (Correct answer)
- Post-scenario learner self-assessment survey
Correct answer: Rapid Cycle Deliberate Practice (RCDP)
Rapid Cycle Deliberate Practice (RCDP) is a formative assessment and learning method where the simulation is repeatedly paused to provide immediate, directive feedback and allow the learner to practice and correct their performance in real-time. This 'pause-and-coach' cycle is unique in its focus on skill acquisition during the scenario, as opposed to post-event reflection or evaluation.
CHSE Debriefing and Assessment Methods Questions and Answers 1
An educator is using a global rating scale (GRS) instead of a detailed checklist to assess teamwork skills during a complex trauma scenario.
What is the primary advantage of using a GRS for this type of assessment?