International Journal of Medical Informatics
Volume 79, Issue 4 , Pages e24-e34 , April 2010

Usability testing of mobile ICT for clinical settings: Methodological and practical challenges

  • Dag Svanæs

      Affiliations

    • Department of Computer and Information Science, Norwegian University of Science and Technology, Trondheim, Norway
    • Corresponding Author InformationCorresponding author at: Department of Computer and Information Science, Norwegian University of Science and Technology, 7491 NTNU Trondheim, Norway. Tel.: +47 91897536.
  • ,
  • Ole Andreas Alsos

      Affiliations

    • Department of Computer and Information Science, Norwegian University of Science and Technology, Trondheim, Norway
  • ,
  • Yngve Dahl

      Affiliations

    • Department of Computer and Information Science, Norwegian University of Science and Technology, Trondheim, Norway
    • Telenor Research & Innovation, Telenor ASA, Trondheim, Norway

Received 11 April 2008 ,Accepted 30 June 2008.

References 

  1. Bardram JE, Bossen C. Moving to get ahead: local mobility and collaboratory work. Proceedings of the 5th European Conference on Computer Supported Cooperative Work (ECSCW 2003). Dordrecht: Kluwer Academic Publishers; 2003;355–374
  2. Coiera E, Tombs V. Communication behaviours in a hospital setting: an observational study. British Medical Journal. 1998;316(7132):673–676
  3. Kjeldskov J, Skov MB. Supporting work activities in healthcare by mobile electronic patient records. In: Computer Human Interaction: 6th Asia Pacific Conference. Apchi 2004, Rotorua, New Zealand, June 29–July 2. 2004;
  4. Fischer S, Stewart TE, Mehta S, Wax R, Lapinsky SE. Handheld computing in medicine. Journal of the American Medical Informatics Association. 2003;10(2):139
  5. Dahl Y, Sørby ID, Nytrø Ø. Context in care-requirements for mobile context-aware patient charts. Proc. MEDINFO. 2004;597–601
  6. Bricon-Souf N, Newman CR. Context awareness in health care: a review. International Journal of Medical Informatics. 2007;76(1):2–12
  7. Munoz MA, Rodriguez M, Favela J, Martinez-Garcia AI, Gonzalez VM. Context-aware mobile communication in hospitals. Computer. 2003;36(9):38–46
  8. W.L. Bewley, T.L. Roberts, D. Schroit, W.L. Verplank, Human factors testing in the design of Xerox's 8010 “Star” office workstation, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1983, 72–77.
  9. ISO. ISO/IEC 25062:2006 Software Engineering-Software Product Quality Requirements and Evaluation (SQuaRE)-Common Industry Format (CIF) for Usability Test Reports, 2006.
  10. Dourish P. Where the Action Is: The Foundations of Embodied Interaction. Cambridge, MA: MIT Press; 2001;
  11. A. Weilenmann, Doing Mobility. PhD dissertation, Department of Informatics, Gothenburg University, 2003.
  12. ISO/IEC. ISO 9241-11 Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs). Part 11. Guidance on Usability, ISO/IEC 9241-11:1998(E), 1998.
  13. D. Svanæs, A. Das, O.A. Alsos, The contextual nature of usability and its relevance to medical informatics, in: Proceedings of MIE 2008, 21th International Congress of the European Federation for Medical Informatics, IOS Press, Amsterdam, 2008.
  14. Weiser M. The computer for the 21st century [J]. Scientific American. 1991;265(3):66–75
  15. Chincholle D, Goldstein M, Nyberg M, Eriksson M. Lost or found? A usability evaluation of a mobile navigation and location-based service. Proceedings of Mobile HCI. 2002;2:211–224
  16. Carter S, Mankoff J. Prototypes in the wild lessons from three ubicomp systems. IEEE Pervasive Computing. 2005;4(4):51–57
  17. J. Kjeldskov, M.B. Skov, B.S. Als, R.T. Høegh, Is it worth the hassle? Exploring the added value of evaluating the usability of context-aware mobile systems in the field, in: Proceedings of Mobile HCI 2004, 2004.
  18. C.M. Nielsen, M. Overgaard, M.B. Pedersen, J. Stage, S. Stenild, It's worth the hassle! The added value of evaluating the usability of mobile systems in the field, in: Proceedings of the 4th Nordic Conference on Human–Computer Interaction: Changing Roles, ACM Press, Oslo, 2006, 272–280.
  19. O.E. Klingen, A usability laboratory for mobile ICT: technical and methodological challenges, Master Thesis, Department of Computer Science, NTNU, Norway, 2005 (in Norwegian).
  20. Dahl Y. “You have a message here”: enhancing interpersonal communication in a hospital ward with location-based virtual notes. Methods of Information in Medicine. 2006;45(6):602–609
  21. Svanaes D, Seland G. Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press: Vienna, Austria; 2004;
  22. Alsos OA, Svanæs D. Interaction techniques for using handhelds and PCs together in a clinical setting. In: Proceedings of NordiCHI 2006. Oslo, Norway: ACM Press; 2006;
  23. Dahl Y, Svanæs D. A comparison of location and token-based interaction techniques for point-of-care access to medical information. Journal of Personal and Ubiquitous Computing. 2008;12(6):459–478
  24. Lisby M, Nielsen LP, Mainz J. Errors in the medication process: frequency, type, and potential clinical consequences. International Journal for Quality in Health Care. 2005;17(1):15–22
  25. Pedersen CA, Schneider PJ, Scheckelhoff DJ. ASHP national survey of pharmacy practice in hospital settings: dispensing and administration-2005. American Journal of Health-System Pharmacy. 2006;63(4):327–345
  26. Barkhuus L, Dey A. Is context-aware computing taking control away from the user? Three levels of interactivity examined. Proceedings of Ubicomp. 2003;159–166
  27. Bellotti V, Edwards K. Intelligibility and accountability: human considerations in context-aware systems. Human-Computer Interaction. 2001;16(2–4):193–212

PII: S1386-5056(08)00110-X

doi: 10.1016/j.ijmedinf.2008.06.014

International Journal of Medical Informatics
Volume 79, Issue 4 , Pages e24-e34 , April 2010