Understanding handling of drug safety alerts: a simulation study
Received 18 August 2009; received in revised form 18 January 2010; accepted 19 January 2010. published online 22 February 2010.
Abstract
Purpose
To study correctness of drug safety alert handling and error type in a computerized physician order entry (CPOE) system in a simulated work environment.
Methods
Disguised observation study of 18 physicians (12 from internal medicine and 6 from surgery) entering 35 orders of predefined patient cases with 13 different drug safety alerts in a CPOE. Structured interviews about how the generated drug safety alerts were handled in the simulation test and resemblance of the test to the normal work environment. Handling and reasons for this were scored for correctness and error type.
Results
Thirty percent of alerts were handled incorrectly, because the action itself and/or the reason for the handling were incorrect. Sixty-three percent of the errors were categorized as rule based and residents in surgery used incorrect justifications twice as often as residents in internal medicine. They often referred to monitoring of incorrect substances or parameters. One alert presented as a second alert in one screen was unconsciously overridden several times. One quarter of residents showed signs of alert fatigue.
Conclusion
Although alerts were mainly handled correctly, underlying rules and reasoning were often incorrect, thereby threatening patient safety. This study gave an insight into the factors playing a role in incorrect drug safety alert handling that should be studied in more detail. The results suggest that better training, improved concise alert texts, and increased specificity might help. Furthermore, the safety of the predefined override reason ‘will monitor’ and double alert presentation in one screen is questioned.
aDepartment of Hospital Pharmacy, Erasmus University Medical Center, Rotterdam, The Netherlands
bDepartment of Internal Medicine, Erasmus University Medical Center, Rotterdam, The Netherlands
cInstitute of Health Policy and Management, Erasmus University Rotterdam, The Netherlands
Corresponding author at: Department of Hospital Pharmacy, Erasmus University Medical Center, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands. Tel.: +31 10 703 3202; fax: +31 10 703 2400.