The effects of active (hot-seat) versus observer roles during simulation-based training on stress levels and non-technical performance: a randomized trial

Published on Mar 20, 2017in Advances in Simulation
· DOI :10.1186/S41077-017-0040-7
Choon Looi Bong11
Estimated H-index: 11
(Boston Children's Hospital),
Su Min Lee2
Estimated H-index: 2
(Boston Children's Hospital)
+ 3 AuthorsArpana R. Vidyarthi19
Estimated H-index: 19
(NUS: National University of Singapore)
Active ‘hands-on’ participation in the ‘hot-seat’ during immersive simulation-based training (SBT) induces stress for participants, which is believed to be necessary to improve performance. We hypothesized that observers of SBT can subsequently achieve an equivalent level of non-technical performance as ‘hot-seat’ participants despite experiencing lower stress. We randomized 37 anaesthesia trainees into two groups to undergo three consecutive SBT scenarios. Eighteen ‘hot-seat’ trainees actively participated in all three scenarios, and 19 ‘observer’ trainees were directed to observe the first two scenarios and participated in the ‘hot-seat’ only in scenario 3. Salivary cortisol (SC) was measured at four time points during each scenario. Primary endpoint for stress response was the change in SC (ΔSC) from baseline. Performance was measured using the Anaesthetist’s Non-Technical Skills (ANTS) Score. Mean SC increased in all participants whenever they were in the ‘hot-seat’ role, but not when in the observer role. Hot-seat ΔSC (mcg/dL) for scenarios 1, 2, and 3 were 0.122 (p = 0.001), 0.074 (p = 0.047), and 0.085 (p = 0.023), respectively. Observers ΔSC (mcg/dL) for scenarios 1, 2, and 3 were −0.062 (p = 0.091), 0.010 (p = 0.780), and 0.144 (p = 0.001), respectively. Mean ANTS scores were equivalent between the ‘hot-seat’ (40.0) and ‘observer’ (39.4) groups in scenario 3 (p = 0.733). Observers of SBT achieved an equivalent level of non-technical performance, while experiencing lower stress than trainees repeatedly trained in the ‘hot-seat’. Our findings suggest that directed observers may benefit from immersive SBT even without repeated ‘hands-on’ experience and stress in the hot-seat. The directed observer role may offer a less stressful, practical alternative to the traditional ‘hot-seat’ role, potentially rendering SBT accessible to a wider audience. Identifier NCT02211378 , registered August 5, 2014, retrospectively registered.
📖 Papers frequently viewed together
76 Citations
13 Authors (Florent Sigwalt, ..., Marc Lilot)
1 Citations
2 Citations
#1Stephanie O’Regan (RNSH: Royal North Shore Hospital)H-Index: 2
#2Elizabeth Molloy (Monash University)H-Index: 29
Last. Debra Nestel (Monash University)H-Index: 44
view all 4 authors...
Simulation is widely used in health professional education. The convention that learners are actively involved may limit access to this educational method. The aim of this paper is to review the evidence for learning methods that employ directed observation as an alternative to hands-on participation in scenario-based simulation training. We sought studies that included either direct comparison of the learning outcomes of observers with those of active participants or identified factors importan...
76 CitationsSource
#1B. Valentin (RWTH Aachen University)H-Index: 5
#2Oliver Grottke (RWTH Aachen University)H-Index: 23
Last. Stefan K. Beckers (RWTH Aachen University)H-Index: 21
view all 12 authors...
Background In emergency medicine, the benefits of high-fidelity simulation (SIM) are widely accepted and standardized patients (SP) are known to mimic real patients accurately. However, only limited data are available concerning physicians’ stress markers within these training environments. The aim of this pilot study was to investigate repetitive stress among healthcare professionals in simulated pre-hospital emergency scenarios using either SIM or SPs.
35 CitationsSource
#1Martin Stocker (Boston Children's Hospital)H-Index: 19
#2Margarita BurmesterH-Index: 10
Last. Meredith Allen (Royal Children's Hospital)H-Index: 14
view all 3 authors...
Background As a conceptual review, this paper will debate relevant learning theories to inform the development, design and delivery of an effective educational programme for simulated team training relevant to health professionals.
55 CitationsSource
#1Stanley J. Hamstra (U of O: University of Ottawa)H-Index: 39
#2Ryan Brydges (U of T: University of Toronto)H-Index: 33
Last. David A. CookH-Index: 86
view all 5 authors...
In simulation-based health professions education, the concept of simulator fidelity is usually understood as the degree to which a simulator looks, feels, and acts like a human patient. Although this can be a useful guide in designing simulators, this definition emphasizes technological advances and
236 CitationsSource
#1Djordje Bozovic (University of East Sarajevo)H-Index: 3
#2Maja Račić (University of East Sarajevo)H-Index: 6
Last. Nedeljka Ivković (University of East Sarajevo)H-Index: 6
view all 3 authors...
Aim: To determine the validity and psychobiological significance of salivary cortisol as a biomarker of stress in the experiments. Results: Stress is defined as a state in which homeostasis is jeopardized by the action of various external and internal stressors. The effect of cortisol is made through specific receptors located in the cytoplasm of the target cells. Determining blood cortisol levels, which has been the most widely used method, is characterized by certain shortcomings. The process ...
67 CitationsSource
#1Adam Cheng (Alberta Children's Hospital)H-Index: 30
#1Adam Cheng (Alberta Children's Hospital)H-Index: 24
Last. Walter J. EppichH-Index: 28
view all 4 authors...
Objective:To review the essential elements of crisis resource management and provide a resource for instructors by describing how to use simulation-based training to teach crisis resource management principles in pediatric acute care contexts.Data Source:A MEDLINE-based literature source.Outline of
72 CitationsSource
#1Debra Nestel (Monash University)H-Index: 44
#2Katie WalkerH-Index: 1
Last. Pamela Andreatta (UM: University of Michigan)H-Index: 20
view all 5 authors...
45 CitationsSource
#1Terri Jones (TCU: Texas Christian University)H-Index: 1
#2Sarah Goss (TCU: Texas Christian University)H-Index: 1
Last. Dennis J. Cheek (TCU: Texas Christian University)H-Index: 14
view all 6 authors...
The use of clinical simulation in graduate level nursing education provides the opportunity for students to learn and apply theoretical practices of nursing care in a safe and controlled environment. It was postulated that laboratory simulation would mimic the stress levels of a real clinical situation as measured by the stress hormone cortisol. The purpose of this study was to determine whether high-fidelity simulation approximates the stress experienced by nurse anesthesia students in the oper...
16 CitationsSource
#1Ariane Keitel (HHU: University of Düsseldorf)H-Index: 5
#2Matthias Ringleb (HHU: University of Düsseldorf)H-Index: 1
Last. Renate Deinzer (University of Giessen)H-Index: 21
view all 7 authors...
Summary Background Several studies have assessed the effects of training using patient simulation systems on medical skills. However, endocrine and psychological stress responses in a patient simulation situation and the relationship between stress reactivity and medical performance have been studied rarely, so far. Methods Medical students (18 males and 16 females) who had completed at least two months anaesthesiology training participated in the study. In a counterbalanced cross-over design th...
54 CitationsSource
#1Julia Neily (National Patient Safety Foundation)H-Index: 26
#2Peter D. Mills (Dartmouth College)H-Index: 24
Last. James P. BagianH-Index: 32
view all 9 authors...
Context There is insufficient information about the effectiveness of medical team training on surgical outcomes. The Veterans Health Administration (VHA) implemented a formalized medical team training program for operating room personnel on a national level. Objective To determine whether an association existed between the VHA Medical Team Training program and surgical outcomes. Design, Setting, and Participants A retrospective health services study with a contemporaneous control group was condu...
744 CitationsSource
Cited By13
Abstract null Prebriefing in healthcare simulation is not clearly defined or consistently utilized. The aim of this concept analysis was to update the definition of prebriefing and clarify prebriefing practices in healthcare simulation using Walker and Avant's concept analysis method. Background and uses of the concept were explored. Two defining attributes of prebriefing were found: Activities that prepare participants for the logistics of simulation and activities that help participants unders...
#1Bryan K. Dang (SJSU: San Jose State University)H-Index: 2
#2Brandon Kyle Johnson (TTUHSC: Texas Tech University Health Sciences Center)H-Index: 4
Last. Suzan Kardong-Edgren (MGH Institute of Health Professions)
view all 8 authors...
Abstract Background Many learners are observers and do not directly participate in the care for a simulated patient. Immersive telepresence technology makes it possible to don virtual reality goggles, giving learners their own vantage point, making them feel present in the room. Methods A multisite quasi-experimental design was used to explore differences in perceived levels of presence and knowledge outcomes among three common roles in simulation and an immersive telepresence role. Results Lear...
#1Szymon Bialka (Medical University of Silesia)H-Index: 5
#2Maja Copik (Medical University of Silesia)H-Index: 5
Last. Hanna Misiołek (Medical University of Silesia)H-Index: 11
view all 7 authors...
PURPOSE High-fidelity simulation calls heavily upon cognitive capacities and generates stress and anxiety. The objective of this prospective, observational study was to evaluate the degree of stress in medical students by measuring hormone levels during critical care classes. METHODS Overall, 55 students (senior years of medical faculty) of both sexes were divided into 5-person teams. Demographic data and information on diagnosed diseases, stimulants used, and previous experience in the field of...
#1Christian D G Goodwin (UNC: University of North Carolina at Chapel Hill)H-Index: 1
Last. Alexander A. Hannenberg (Tufts University)H-Index: 8
view all 9 authors...
ABSTRACT The Challenge Effective teamwork and communication skills are essential for safe and reliable health care. These skills require training and practice. Experiential learning is optimal for training adults, and the industry has recognized simulation training as an exemplar of this approach. Yet despite decades of investment, this training is inaccessible and underutilized for most of the more than 12 million health care professionals in the United States. Designing a Solution We describe ...
#1Haewon Yoon (IU: Indiana University)H-Index: 5
#2Irene Scopelliti (City University London)H-Index: 8
Last. Carey K. Morewedge (BU: Boston University)H-Index: 27
view all 3 authors...
Abstract Observational learning can debias judgment and decision making. One-shot observational learning-based training interventions (akin to “hot seating”) can produce reductions in cognitive biases in the laboratory (i.e., anchoring, representativeness, and social projection), and successfully teach a decision rule that increases advice taking in a weight on advice paradigm (i.e., the averaging principle). These interventions improve judgment, rule learning, and advice taking more than practi...
#1Beth A. Rogers (TCU: Texas Christian University)H-Index: 1
#2Kathy A. Baker (TCU: Texas Christian University)H-Index: 5
Last. Ashley E. Franklin (TCU: Texas Christian University)H-Index: 9
view all 3 authors...
Abstract Background Simulation-based learning experiences are utilized more frequently to support nursing education. Some programs use observational, rather than active, role assignments to meet the growing demand for simulation-based learning experiences. Despite support for observer learning, educators disagree about whether observers’ learning outcomes are similar to those who are active participants. Method The scoping review strategy established by the Joanna Briggs Institute was followed t...
1 CitationsSource
#1Megan Delisle (UM: University of Manitoba)H-Index: 10
#2Alexander A. Hannenberg (Tufts University)H-Index: 8
Simulation-based education improves health care professionals' performance in managing critical events. Limitations to widespread uptake of high-fidelity simulation include barriers related to training, technology, and time. Alternatives to high-fidelity simulation that overcome these barriers include in situ simulation, classroom-based simulation, telesimulation, observed simulation, screen-based simulation, and game-based simulation. Some settings have limited access to onsite expert facilitat...
2 CitationsSource
#1Stephanie O’Regan (Monash University)H-Index: 2
#1Stephanie O’Regan (Monash University)
Last. Debra NestelH-Index: 44
view all 4 authors...
Background Simulation is reported as an appropriate replacement for a significant number of clinical hours in pregraduate programmes. To increase access for learners, educators have looked to understanding and improving learning in observer roles. Studies report equivalent learning outcomes and less stress in observer roles. However, reports on the prevalence, use and perceived value of observer roles from the educator’s perspective are lacking. Methods An exploratory survey for Australian and N...
#1Yvonne Ying (U of O: University of Ottawa)H-Index: 1
#2Michael Yacob (Queen's University)H-Index: 1
Last. Laura Gerridzen (U of O: University of Ottawa)
view all 5 authors...
Abstract Background Participation in simulation can improve future performance, but it is unclear if observation of simulation scenarios can produce an equivalent benefit. Methods First-year surgical residents were exposed to various simulation scenarios in groups of 4 or 5, either through active participation or passive observation. Residents were individually assessed on 3 of the scenarios. Scores were categorized based on resident level of exposure to the scenario and analyzed using a multiva...
#2Sandra M. SwobodaH-Index: 29
Last. Nancy SullivanH-Index: 6
view all 3 authors...