ASGE initiative addresses endoscopy simulators for training and skill assessment

The American Society for Gastrointestinal Endoscopy's (ASGE) Preservation and Incorporation of Valuable Endoscopic Innovations (PIVI) initiative addresses the use of endoscopy simulators for training and assessing skills in an article appearing in the September issue of GIE: Gastrointestinal Endoscopy, ASGE's monthly peer-reviewed scientific journal. This PIVI is one in a series of statements defining the diagnostic or therapeutic threshold that must be met for a technique or device to become considered appropriate for incorporation into clinical practice.

Simulator can provide a student with a relaxed opportunity for repetitive practice of skills including those that might not be encountered with sufficient frequency during the course of a standard training program. Improving basic skills before actual could result in reduced patient discomfort. Manpower limitations of available endoscopic educators or cost considerations of the increased time that trainers must spend away from their clinical duties would support the use of that might either shorten the learning curve or allow students to do more of their instruction independently.

"Although the use of simulators has become much more widespread, particularly via the use of ex vivo–based hands-on training courses by the ASGE at its Institute for Training and Technology in Oak Brook, Ill., and at many regional courses throughout the world, there is no consensus to date on just how much of a role they should play in standard training," said PIVI Committee Chair Jonathan Cohen, MD, FASGE. "Ultimately, the decision about whether to incorporate these technologies into a training program must rely on data regarding the of training benefits, any cost savings resulting from accelerated learning, the initial and ongoing expenses associated with the simulator work, and the local needs of the institution."

This PIVI reviews the current literature on simulator use in endoscopy and assesses what data are required to support a wider adoption of their use for endoscopy training and skills assessment. Specifically, the following two questions are considered: How much benefit must be demonstrated from the use of simulators to justify widespread adoption into standard endoscopy training? How reliable do simulator-based assessments need to be as a predictor of patient-based skills to justify their use in credentialing and recredentialing for endoscopy? The document outlines the following:

  • Thresholds recommended for this PIVI
    • Threshold for incorporation of a simulator into training: For an endoscopy simulator to be integrated into the standard instruction for a procedure, it must demonstrate a 25 percent or greater reduction in the median number of clinical cases required for the trainees to achieve the minimal competence parameters for that procedure.
    • Threshold for using a simulator to assess skill: Simulator-based assessment tools must be procedure specific and predictive of independently defined minimal competence parameters from real procedures with a к value (i.e. correlation coefficient with value of 0 meaning that skills on a simulator had no correlation with real procedures and value of 1.0 had perfect correlation of simulator skills with real procedures) of at least 0.70 for high-stakes assessment.
  • Summary of PIVI methodology and literature review
    • A comprehensive review of published trials using ex vivo and computer simulators was performed and circulated to the members of the PIVI committee.
    • Training: Despite their varied capabilities and promising potential, use of the current endoscopic simulators appears to help primarily with early learning curves for endoscopic procedures. However, to date, simulator use has not yet led to an accelerated achievement of competency benchmarks or improved outcomes for patients.
    • Assessing skill: There are only limited data examining the ability of endoscopy simulators to be used as tools to assess endoscopic skill. The limited literature available in this respect has shown these models to lack performance metrics of adequate sensitivity or reliability for use as meaningful assessment tools.
  • Study designs needed to address the questions raised by this PIVI
    • Training: The benefit of using simulators for training can only be validated in an adequately powered, controlled trial that demonstrates that the incorporation of simulators in a training program leads to acquisition of technical and cognitive competency with fewer clinical endoscopic procedures than required by traditional supervised endoscopic instruction without access to the simulator.
    • Assessment: A simulator that is able to assess the actual clinical skills (technical and cognitive) of a clinician performing endoscopy may be a useful tool for credentialing (or recredentialing). A prerequisite for any validation of such a tool would be a previous consensus on how to measure competency for a particular procedure in real patients.
  • Suggested areas for future development
    • The road to reaching the target for simulator-based skills assessments will require both improvement in the way in which actual clinical procedure performance is assessed and advances in the simulators themselves. Specifically, this will require the following:
      • Development of accurate, reliable, and validated clinical patient-based assessment tools for all endoscopic procedures to establish learning curves and benchmark clinical performance abilities.
      • Development of simulated cases of increased difficulty to allow discrimination of differing grades of ability (not just novice/expert).
      • Development of clinically relevant, accurate, and reliable simulator assessment metrics that effectively distinguish the different grades of ability and correlate with clinical performance benchmarks in prospective validation studies.

As professional societies work to better define the constituents and benchmarks for competency in various procedures, investigators and providers of simulators will need to focus their efforts on addressing current unmet needs, determining which trainees get the most benefit from which tools, and reducing the cost of simulation to improve access and use.

The PIVI committee (consisting of a committee of ASGE physician experts) in preparing the document, employed evidence-based methodology, using a MEDLINE and PubMed literature search to identify pertinent clinical studies on the topic. The PIVI is provided solely for educational and informational purposes and to support incorporating these endoscopic technologies into clinical practice. It should not be construed as establishing a legal standard of care. To read the full PIVI document, log on to ASGE's website at www.asge.org.

add to favorites email to friend print save as pdf

Related Stories

New colonoscopy skills assessment tool developed for trainees

Dec 15, 2010

Researchers at the Mayo Clinic in Rochester, Minn., have developed a new skills assessment tool for colonoscopy trainees. A report outlining the development and validation of the Mayo Colonoscopy Skills Assessment Tool (MCSAT), ...

Researchers develop better training for keyhole surgery

Mar 31, 2009

Researcher Sanne Botden has improved the training methods for surgeons who perform keyhole operations. At present, a relatively large number of errors are made during surgery of this kind. She defends her ...

Simulation training improves skills for catheter insertion

May 14, 2009

New technology allows student doctors to practice operations and other procedures on simulators before trying them out on real patients, just as pilots practice for emergencies on aircraft simulators. Medical educators feel ...

Recommended for you

Cold cash just keeps washing in from ALS challenge

Aug 28, 2014

In the couple of hours it took an official from the ALS Association to return a reporter's call for comment, the group's ubiquitous "ice bucket challenge" had brought in a few million more dollars.

Medtronic spends $350M on another European deal

Aug 27, 2014

U.S. medical device maker Medtronic is building stronger ties to Europe, a couple months after announcing a $42.9 billion acquisition that involves moving its main executive offices across the Atlantic, where it can get a ...

Mind over matter for people with disabilities

Aug 26, 2014

People with serious physical disabilities are unable to do the everyday things that most of us take for granted despite having the will – and the brainpower – to do so. This is changing thanks to European ...

Ukraine's former world's tallest man dies

Aug 25, 2014

Ukraine's tallest man, who briefly held the world record but gave it up to live as a recluse, has died due to complications from the condition that saw him never stop growing, local media reported Monday.

User comments