International Journal of Medical Informatics
Volume 79, Issue 4 , Pages e58-e70 , April 2010

Anatomy of a failure: A sociotechnical evaluation of a laboratory physician order entry system implementation

  • Linda W. Peute

      Affiliations

    • Department of Medical Informatics, Academic Medical Center, University of Amsterdam, The Netherlands
    • Corresponding Author InformationCorresponding authors at: Department of Medical Informatics, Academic Medical Center, University of Amsterdam, P.O. Box 22700, 1100 DE Amsterdam, The Netherlands. Tel.: +31 20 5665178; fax: +31 20 6919840.
    • ,
  • Jos Aarts

      Affiliations

    • Institute of Health Policy and Management, Erasmus MC, Rotterdam, The Netherlands
    • ,
  • Piet J.M. Bakker

      Affiliations

    • Department of Quality and Process Innovation, Academic Medical Center, University of Amsterdam, The Netherlands
    • ,
  • Monique W.M. Jaspers

      Affiliations

    • Department of Medical Informatics, Academic Medical Center, University of Amsterdam, The Netherlands
    • Corresponding Author InformationCorresponding authors at: Department of Medical Informatics, Academic Medical Center, University of Amsterdam, P.O. Box 22700, 1100 DE Amsterdam, The Netherlands. Tel.: +31 20 5665178; fax: +31 20 6919840.

Received 31 January 2008 ,Revised 20 May 2009 ,Accepted 29 June 2009.

References 

  1. Mekhjian HS, Kumar RR, Kuehn L, Bentley TD, Teater P. Immediate benefits realized following implementation of physician order entry at an academic medical center. J. Am. Med. Inform. Assoc. 2002;9(September–October (5)):529–539
  2. Overhage JM, Perkins SA, Tierney WM, McDonald CJ. Research paper—controlled trial of direct physician order entry: effects on physicians time utilization in ambulatory primary care internal medicine practices. J. Am. Med. Inform. Assoc. 2001;8(July–August (4)):361–371
  3. Bates DW, Teich JM, Lee J, Seger D, Kuperman GJ, MaLuf N, et al. The impact of computerized physician order entry on medication error prevention. J. Am. Med. Inform. Assoc. 1999;6(July–August (4)):313–321
  4. Massaro TA. Introducing physician order entry at a major Academic Medical-Center Impact on organizational culture and behavior. Acad. Med. 1993;68(January (1)):20–25
  5. Classen DC, Avery AJ, Bates DW. Evaluation and certification of computerized provider order entry systems. J. Am. Med. Inform. Assoc. 2007;14(January–February (1)):48–55
  6. Aarts J, Ash J, Berg M. Extending the understanding of computerized physician order entry: implications for professional collaboration, workflow and quality of care. Int. J. Med. Inform. 2007;76(June (Suppl. 1)):S4–S13
  7. Aarts J, Berg M. Same systems, different outcomes—comparing the implementation of computerized physician order entry in two Dutch hospitals. Methods Inf. Med. 2006;45(1):53–61
  8. DeLone WH, McLean ER. Measuring e-commerce success: applying the DeLone & McLean Information Systems Success Model. Int. J. Electron. Comm. 2004;9(1):31–47
  9. Seddon PB, Staples S, Patnayakuni R, Bowtell M. Dimensions of information systems success. Commun. AIS. 1999;2(November (3)):
  10. Mirani R, Lederer AL. An instrument for assessing the organizational benefits of IS projects. Decis. Sci. 1998;29(4):803–838
  11. Grover V, Jeong SR, Segars AH. Information systems effectiveness: the construct space and patterns of application. Inform. Manage. 1996;31(4):177–191
  12. Smithson S, Hirscheim RA. Analyzing information systems evaluation: another look at an old problem. EJIS. 1998;7(3):158–174
  13. Dixon DR. The behavioural side of information technology. Int. J. Med. Inf. 1999;56:117–123
  14. Van Der Meijden MJ, Tange HJ, Troost J, Hasman A. Determinants of success of inpatient clinical information systems: a literature review. J. Am. Med. Inform. Assoc. 2003;10(May–June (3)):235–243
  15. Kuperman GJ, Gibson RF. Computer physician order entry: benefits, costs, and issues. Ann. Intern. Med. 2003;139(July (1)):31–39
  16. Ash JS, Fournier L, Stavri PZ, Dykstra R. Principles for a successful computerized physician order entry implementation. AMIA Annu. Symp. Proc. 2003;36–40
  17. Sittig DF, Krall M, Kaalaas-Sittig JA, Ash JS. Emotional aspects of computer-based provider order entry: a qualitative study. J. Am. Med. Inform. Assoc. 2005;12(September–October (5)):561–567
  18. Ash JS, Stavri PZ, Kuperman GJ. A consensus statement on considerations for a successful CPOE implementation. J. Am. Med. Inform. Assoc. 2003;10(May–June (3)):229–234
  19. Ash JS, Stavri PZ, Dykstra R, Fournier L. Implementing computerized physician order entry: the importance of special people. Int. J. Med. Inform. 2003;69(March (2–3)):235–250
  20. Sittig DF, Stead WW. Computer-based physician order entry: the state of the art. J. Am. Med. Inform. Assoc. 1994;1(March–April (2)):108–123(Review)
  21. Sengstack PP, Gugerty B. CPOE systems: success factors and implementation issues. J. Healthcare Inf. Manage. 2004;18(Winter (1)):36–45
  22. Weir C, McCarthy C, Gohlinghorst S, Crockett R. Assessing the implementation process. Proc. AMIA Symp. 2000;908–912
  23. Aarts J, Doorewaard H, Berg M. Understanding implementation: the case of a computerized physician order entry system in a large Dutch university medical center. J. Am. Med. Inform. Assoc. 2004;11(May–June (3)):207–216
  24. White B. Longitudinal field research methods: studying processes of organizational change. Syst. Res. Behav. Sci. 1997;14(4):298–299
  25. Stoop AP, Berg M. Integrating quantitative and qualitative methods in patient care information system evaluation guidance for the organizational decision maker. Methods Inf. Med. 2003;42(4):458–462
  26. Patton MQ. Learning in the field: an introduction to qualitative research. Am. J. Eval. 2002;23(1):115–116
  27. Charmaz K. Qualitative interviewing and Grounded Theory Analysis. In:  Gubrium JF,  Holstein JA editor. Handbook of Interview Research: Context & Method. Thousand Oaks, CA: SAGE Publications; 2002;
  28. Patton MQ. Qualitative Evaluation and Research Methods. 3rd ed.. Thousand Oaks, CA: Sage Publications, Inc.; 2002;
  29. Peute LW, Jaspers MW. The significance of a usability evaluation of an emerging laboratory order entry system. Int. J. Med. Inform. 2007;76(February–March (2–3)):157–168
  30. Geiger G, Derman YD. Methodology for evaluating physician order entry (POE) implementations. J. Eval. Clin. Pract. 2003;9(November (4)):401–408
  31. Oostendorp A, Hoekstra S, Aarts J, Oostendorp A, Hoekstra S, Aarts J. Exploring factors required for successful implementation of healthcare informatics. Stud. Health Technol. Inform. 1998;51:146–151
  32. Sengstack PP, Gugerty B, Davidson EJ, Chismar WG. Planning and managing computerized order entry: a case study of IT-enabled organizational transformation. Top. Health Inf. Manage. 1999;19(May (4)):47–61
  33. Upperman JS, Staley P, Friend K, Benes J, Dailey J, Neches W, et al. The introduction of computerized physician order entry and change management in a tertiary pediatric hospital. Pediatrics. 2005;116(November (5)):e634–e642Kuhn KA, Giuse DA. From hospital information systems to health information systems. Problems, challenges, perspectives. Methods Inf. Med. 2001;40(4):275–287
  34. Brender J, Ammenwerth E, Nykänen P, Talmon J. Factors influencing success and failure of health informatics systems—a pilot Delphi study. Methods Inf. Med. 2006;45(1):125–136
  35. Cheng CH, Goldstein MK, Geller E, Levitt RE. The effects of CPOE on ICU workflow: an observational study. AMIA Annu. Symp. Proc. 2003;150–154
  36. Weir CR, Nebeker JJ, Hicken BL, Campo R, Drews F, Lebar B. A cognitive task analysis of information management strategies in a computerized provider order entry environment. J. Am. Med. Inform. Assoc. 2007;14(January–February (1)):130–131
  37. Pratt W, Reddy MC, McDonald DW, Tarczy-Hornoch P, Gennari JH. Incorporating ideas from computer-supported cooperative work. J. Biomed. Inform. 2004;37(April (2)):128–137
  38. Stablein D, Welebob E, Johnson E, Metzger J, Burgess R, Classen DC. Understanding hospital readiness for computerized physician order entry. Joint Comm. J. Qual. Saf. 2003;29(July (7)):336–344
  39. Snyder RA, Fields WL. Measuring hospital readiness for information technology (IT) innovation: a multisite study of the Organizational Information Technology Innovation Readiness Scale. J. Nurs. Meas. 2006;14(Spring–Summer (1)):45–55
  40. Andrews T, DiFrancesco M, Gilliam M. Putting CPOE to work. Nurs Manage. 2003;34(October (10, Suppl.)):12–14
  41. Ahmad A, Teater P, Bentley TD, Kuehn L, Kumar RR, Thomas A, et al. Key attributes of a successful physician order entry system implementation in a multi-hospital environment. J. Am. Med. Inform. Assoc. 2002;9(January–February (1)):16–24
  42. Friedrich WR, Van der Poll JA. Towards a methodology to elicit tacit domain knowledge from users. IJIKM. 2007;2:179–193
  43. Zuiderent T. Blurring the center: on the politics of ethnography. Scand. J. Inf. Syst. 2002;14(September (2)):59–78
  44. Eisenhardt KM. Building theories from case study research. Acad. Manage. Rev. 1989;14(4):532–550
  45. Karsh BT. Beyond usability: designing effective technology implementation systems to promote patient safety. Qual. Saf. Health Care. 2004;13(October (5)):388–394

PII: S1386-5056(09)00103-8

doi: 10.1016/j.ijmedinf.2009.06.008

International Journal of Medical Informatics
Volume 79, Issue 4 , Pages e58-e70 , April 2010

Article Tools

* Image Usage & Resolution