International Journal of Medical Informatics
Volume 77, Issue 6 , Pages 386-398 , June 2008

An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit)

  • Maryati Mohd. Yusof

      Affiliations

    • Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia
    • Corresponding Author InformationCorresponding author. Tel.: +603 8921 6649.
  • ,
  • Jasna Kuljis

      Affiliations

    • School of Information Systems, Computing and Mathematics, Brunel University, Kingston Lane, Uxbridge, Middlesex UB8 3PH, UK
  • ,
  • Anastasia Papazafeiropoulou

      Affiliations

    • School of Information Systems, Computing and Mathematics, Brunel University, Kingston Lane, Uxbridge, Middlesex UB8 3PH, UK
  • ,
  • Lampros K. Stergioulas

      Affiliations

    • School of Information Systems, Computing and Mathematics, Brunel University, Kingston Lane, Uxbridge, Middlesex UB8 3PH, UK

Received 15 December 2005 ,Revised 12 August 2007 ,Accepted 12 August 2007.

References 

  1. Sittig DF, Hazlehurst BL, Palen T, Hsu J, Jimson H, Hornbrook MC. A clinical information system research agenda for Kaiser Permanente. Permanente J. 2002;6(3):
  2. Kaplan B. Evaluating informatics applications—clinical decision support systems literature review. Int. J. Med. Inf. 2001;64(1):15–37
  3. Kaplan B. Evaluating informatics applications-some alternative approaches: theory, social interactionism, and call for methodological pluralism. Int. J. Med. Inf. 2001;64(1):39–56
  4. Kaplan B, Shaw N. People, organizational and social issues: evaluation as an exemplar. IMIA 2002 Yearbook. 2002;91–102
  5. Kaplan B, Shaw NT. Future directions in evaluation research: people, organizational, and social issues. Methods Inf. Med. 2004;43(3):215–231
  6. Brender J, Nohr C, McNair P. Research needs and priorities in health informatics. Int. J. Med. Inf. 2000;58–59:257–289
  7. Coiera E. Guide to Health Informatics. Hodder Arnold; 2003;
  8. Yusof MM, Paul RJ, Stergioulas L. In: Health Information Systems Evaluation: A focus on Clinical Decision Supports System. Proceedings of the XIX International Congress of the European Federation for Medical Informatics (MIE2005). Geneva, Switzerland. 2005;p. 855–860
  9. Yusof MM, Paul RJ, Stergioulas LK. In: Towards a Framework for Health Information Systems Evaluation. Proceedings of the 39th Hawaii International Conferences on System Sciences. Kauai, Hawaii, USA. 2006;
  10. DeLone WH, McLean ER. Information systems success: the quest for the dependent variable. Inf. Syst. Res. 1992;3(1):60–95
  11. DeLone WH, McLean ER. Measuring e-commerce success: applying the DeLone & McLean Information Systems Success Model. Int. J. Electron. Commerce. 2004;9(1):31–47
  12. Scott Morton MS. The Corporation of the 1990s. New York: Oxford University Press; 1991;
  13. Yusof MM, Papazafeiropoulou A, Paul RJ, Stergioulas LK. Investigating evaluation frameworks for health information systems. Int. J. Med. Inf. 2007;
  14. Van der Meijden MJ, Tange HJ, Troost J, Hasman A. Determinants of success of inpatient clinical information systems: a literature review. J. Am. Med. Inform. Assoc. 2003;10(3):235–243
  15. Willcocks L. Managing technology evaluation—techniques and processes. In:  Galliers RD,  Baker BSH editor. Strategic Information Management: Challenges and Strategies in Managing Information Systems. Oxford; 1994;p. 365–381
  16. Kuhn KA, Giuse DA, Talmon JL. The Heidelberg Conference: setting an agenda for the IMIA working Group on Health Information Systems. Int. J. Med. Inf. 2003;69(2–3):77–82
  17. Anderson JG. Clearing the way for physicians’ use of clinical information systems. Commun. ACM. 1997;40(8):83–90
  18. Bottles K. Critical choices face healthcare in how to use information technology. Medscape Gen. Med. 1999;1(1):
  19. Lorenzi NM, Riley RT. Organizational ISSUES=change. Int. J. Med. Inf. 2003;69(2–3):197–203
  20. Brender J, Ammenwerth E, Nyakanen PN, Talmon J. Factors influencing success and failure of Health Information System -- a pilot delphi study. Methods Inf. Med. 2006;45(1):125–136
  21. Aarts J, Peel V, Wright G. Organizational issues in health informatics: a model approach. Int. J. Med. Inf. 1998;52(1–3):235–242
  22. Berg M. Patient care information systems and health care work: a sociotechnical approach. Int. J. Med. Inf. 1999;55(2):87–101
  23. Southon FCG, Sauer C, Grant CG. Information Technology in Complex Health Services: organizational impediments to successful technology transfer and diffusion. J. Am. Med. Inform. Assoc. 1997;4(2):112–124
  24. Heeks R, Mundy D, Salazar A. Why Health Care Information Systems Succeed or Fail. Institute for Development Policy and Management, University of Manchester; 1999;
  25. Luftman J. Assessing business-IT alignment maturity. Commun. AIS. 2000;4(14):1–50
  26. DeLone WH, McLean ER. Information systems success revisited. In: Proceedings of the 35th Hawaii International Conference on System Sciences (HICCS). Big Island, HI, USA. 2002;
  27. Southon FCG, Sauer C, Dampney K. Lessons from a failed information systems initiative: issues for complex organizations. Int. J. Med. Inf. 1999;55(1):33–46
  28. Roderer NK. Outcome measures in clinical information systems evaluation. In: Medinfo. 2004. San Francisco, CA, USA. 2004;p. 1096–1100
  29. Stoop AP, Berg M. Integrating quantitative and qualitative methods in patient care information systems evaluation: guidance for the organizational decision maker. Methods Inf. Med. 2004;42(4):458–462
  30. J.G. Anderson, C.E. Aydin, Overview: theoretical perspectives and methodologies for the evaluation of health care information systems, in: J.G. Anderson, C.E. Aydin, S.J. Jay (Eds.), Evaluating Health Care Information Systems; Methods and Applications, Sage, Thousand Oaks, CA, 1994, pp. 5–29.
  31. B. Doebbeling, Information Technology and Primary Care at VA: Interdisciplinary Partnership Opportunities for Providers, Managers, and Researchers, Health Service Research & Development Series, 2003.
  32. Smith J. Health Management Information Systems: A Handbook for Decision Makers. Buckingham: Open University Press; 2000;
  33. T. Lippeveld, Routine Health Information Systems: The Glue of a Unified Health System, Workshop on Issues and Innovation in Routine Health Information in Developing Countries, Bolger Centre for Leadership Development Potomac, Maryland, 2001.
  34. Friedman CP, Wyatt JC. Evaluation Methods in Medical Informatics. New York: Springer-Verlag; 1997;
  35. Jiang JJ, Muhanna WA, Klenin G. User resistance and strategies for promoting acceptance across system types. Inf. Manage. 2000;37(1):25–36
  36. B. Kaplan, Organizational evaluation of medical information resources, in: C.P. Friedman, J.C. Wyatt (Eds.), Evaluation Methods in Medical Informatics, Springer-Verlag, New York, 1997, pp. 255–280.
  37. van’t Riet A, Berg M, Hidemma F, Sol K. Meeting patients’ needs with patient information systems: potential benefits of qualitative research methods. Int. J. Med. Inf. 2001;64(1):1–14
  38. Shaw NT. ‘CHEATS’: a generic information communication technology (ICT) evaluation framework. Comput. Biol. Med. 2002;32(3):209–220
  39. The National Screening Committee (NSC), Transfer and Management of Patient Information in Diabetic Retinopathy Screening Programmes Version 2.0, July 2005. Retrieved 2 August, 2005 from: http://www.nscretinopathy.org.uk (2004).
  40. B. Kaplan, J. Maxwell, Qualitative research methods for evaluating computer information systems, in: C.E. Aydin, J.G. Anderson, S.J. Jay, S.J. (Ed.), Evaluating Health Care Information Systems; Methods and Applications, Sage, Thousand Oaks, 1994, pp. 45–67.
  41. Patton MQ. Qualitative Research & Evaluation Methods. Thousand Oaks: Sage Publications; 2002;
  42. Yin RK. Case Study Research: Design and Methods. Thousand Oaks: Sage Publications; 2003;
  43. Rowley J. Using case studies in research. Manage. Res. News. 2002;25(1):16–27

PII: S1386-5056(07)00160-8

doi: 10.1016/j.ijmedinf.2007.08.011

International Journal of Medical Informatics
Volume 77, Issue 6 , Pages 386-398 , June 2008