International Journal of Medical Informatics
Volume 73, Issue 1 , Pages 1-23 , February 2004

A review of content-based image retrieval systems in medical applications—clinical benefits and future directions

Received 22 July 2003 ,Accepted 13 November 2003.

References 

  1. Chang S-K, Kunii T. Pictorial data-base applications. IEEE Comput. 1981;14(11):13–21
  2. Enser PGB. Pictorial information retrieval. J. Document. 1995;51(2):126–170
  3. Gupta A, Jain R. Visual information retrieval. Commun. ACM. 1997;40(5):70–79
  4. Y. Rui, T.S. Huang, S.-F. Chang, Image retrieval: past, present and future, in: M. Liao (Ed.), Proceedings of the International Symposium on Multimedia Information Processing, Taipei, Taiwan, 1997.
  5. J.P. Eakins, M.E. Graham, Content-based image retrieval, Tech. Rep. JTAP-039, JISC Technology Application Program, Newcastle upon Tyne, 2000.
  6. C.C. Venters, M. Cooper, Content-based image retrieval, Tech. Rep. JTAP-054, JISC Technology Application Program, 2000.
  7. Smeulders AWM, Worring M, Santini S, Gupta A, Jain R. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Machine Intel. 2000;22(12):1349–1380
  8. H. Müller, User interaction and performance evaluation in content-based visual information retrieval, Ph.D. thesis, Computer Vision and Multimedia Laboratory, University of Geneva, Geneva, Switzerland, June 2002.
  9. J.R. Smith, Integrated spacial and feature image systems: retrieval, compression and analysis, Ph.D. thesis, Graduate School of Arts and Sciences, Columbia University, 2960 Broadway, New York, NY, USA, 1997.
  10. A. del Bimbo, Visual Information Retrieval, Academic Press, New York, 1999.
  11. S.M. Rahman, Design & Management of Multimedia Information Systems: Opportunities & Challenges, Idea Group Publishing, London, 2001.
  12. Tang LHY, Hanka R, Ip HHS. A review of intelligent content-based indexing and browsing of medical images. Health Informatics J. 1999;5:40–49
  13. Chang N-S, Fu K-S. Query-by-pictorial-example. IEEE Trans. Software Eng. SE. 1980;6(6):519–524
  14. Flickner M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, et al. Query by image and video content: the QBIC system. IEEE Comput. 1995;28(9):23–32
  15. W. Niblack, R. Barber, W. Equitz, M.D. Flickner, E.H. Glasman, D. Petkovic, P. Yanker, C. Faloutsos, G. Taubin, QBIC project: querying images by content, using color, texture, and shape, in: W. Niblack (Ed.), Proceedings of the of SPIE Conference on Storage and Retrieval for Image and Video Databases, vol. 1908, 1993, pp. 173–187.
  16. J.R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. Jain, C.-F. Shu, The Virage image search engine: an open framework for image management, in: I.K. Sethi, R.C. Jain (Eds.), Proceedings of the SPIE Conference on Storage & Retrieval for Image and Video Databases IV, vol. 2670, San Jose, CA, USA, 1996, pp. 76–87.
  17. A. Hampapur, A. Gupta, B. Horowitz, C.-F. Shu, C. Fuller, J. Bach, M. Gorkani, R. Jain, Virage video engine, in: I.K. Sethi, R.C. Jain (Eds.), Proceedings of the of SPIE Conference on Storage and Retrieval for Image and Video Databases V, vol. 3022, 1997, pp. 352–360.
  18. P.M. Kelly, M. Cannon, D.R. Hush, Query by image example: the Candid approach, in: W. Niblack, R.C. Jain (Eds.), Proceedings of the of SPIE Conference on Storage and Retrieval for Image and Video Databases III, vol. 2420, 1995, pp. 238–248.
  19. Pentland A, Picard RW, Sclaroff S. Photobook: tools for content-based manipulation of image databases. Int. J. Comput. Vis. 1996;18(3):233–254
  20. W.Y. Ma, Y. Deng, B.S. Manjunath, Tools for texture- and color-based search of images, in: B.E. Rogowitz, T.N. Pappas (Eds.), Proceedings of the of SPIE Conference on Human Vision and Electronic Imaging II, vol. 3016, San Jose, CA, 1997, pp. 496–507.
  21. C. Carson, M. Thomas, S. Belongie, J.M. Hellerstein, J. Malik, Blobworld: a system for region-based image indexing and retrieval, in: D.P. Huijsmans, A.W.M. Smeulders (Eds.), Proceedings of the Third International Conference On Visual Information Systems (VISUAL’99), no. 1614 in Lecture Notes in Computer Science, Springer-Verlag, Amsterdam, The Netherlands, 1999, pp. 509–516.
  22. S. Belongie, C. Carson, H. Greenspan, J. Malik, Color- and texture-based image segmentation using EM and its application to content-based image retrieval, in: Proceedings of the International Conference on Computer Vision (ICCV’98), Bombay, India, 1998, pp. 675–682.
  23. I.J. Cox, M.L. Miller, S.M. Omohundro, P.N. Yianilos, Target testing and the PicHunter Bayesian multimedia retrieval system, in: Advances in Digital Libraries (ADL’96), Library of Congress, Washington, D.C., 1996, pp. 66–75.
  24. D.M. Squire, W. Müller, H. Müller, T. Pun, Content-based query of image databases: in-spirations from text retrieval, Pattern Recognition Letters, vol. 21, 2000, pp. 1193–1198 (Selected papers from the 11th Scandinavian Conference on Image Analysis, SCIA’99).
  25. D.M. Squire, H. Müller, W. Müller, S. Marchand-Maillet, T. Pun, Design and evaluation of a content-based image retrieval system, in: Design & Management of Multimedia Information Systems: Opportunities & Challenges, IDEA Group Publishing, pp. 125–151 (Chapter 7), 2001.
  26. T. Pfund, S. Marchand-Maillet, Dynamic multimedia annotation tool, in: G. Beretta, R. Schettini (Eds.), Proceedings of the SPIE Photonics West Conference on Internet Imaging III, vol. 4672, San Jose, CA, USA, 2002, pp. 216–224.
  27. C. Carson, S. Belongie, H. Greenspan, J. Malik, Region-based image querying, in: Proceedings of the 1997 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’97), IEEE Computer Society, San Juan, Puerto Rico, 1997, pp. 42–51.
  28. J.R. Smith, S.-F. Chang, Visualseek: a fully automated content-based image query system, in: Proceedings of the Fourth ACM International Multimedia Conference and Exhibition, Boston, MA, USA, 1996.
  29. S. Sclaroff, L. Taycher, M. La Cascia, ImageRover: a content-based browser for the world wide web, in: IEEE Workshop on Content-Based Access of Image and Video Libraries, San Juan, Puerto Rico, 1997, pp. 2–9.
  30. T. Gevers, A.W.M. Smeulders, A comparative study of several color models for color image invariants retrieval, in: Proceedings of the First International Workshop ID-MMS’96, Amsterdam, The Netherlands, 1996, pp. 17–26.
  31. Geusebroek J-M, van den Boogaard R, Smeulders AWM, Geerts H. Color invariance. IEEE Trans. Pattern Anal. Machine Intel. 2001;23(12):1338–1350
  32. Ortega M, Rui Y, Chakrabarti K, Porkaew K, Mehrotra S, Huang TS. Supporting ranked boolean similarity queries in MARS. IEEE Trans. Knowledge Data Eng. 1998;10(6):905–925
  33. J. Ze Wang, G. Wiederhold, O. Firschein, S. Xin Wei, Wavelet-based image indexing techniques with partial sketch retrieval capability, in: Proceedings of the Fourth Forum on Research and Technology Advances in Digital Libraries, Washington D.C., 1997, pp. 13–24.
  34. W. Ma, B. Manjunath, Texture features and learning similarity, in: Proceedings of the 1996 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’96), San Francisco, California, 1996, pp. 425–430.
  35. S. Santini, R. Jain, Gabor space and the development of preattentive similarity, in: Proceedings of the 13th International Conference on Pattern Recognition (ICPR’96), IEEE, Vienna, Austria, 1996, pp. 40–44.
  36. Daugman JG. An information theoretic view of analog representation in striate cortex. Computat. Neurosci. 1990;2:9–18
  37. Daugman JG. High confidence visual recognition of persons by a test of statistical independence. IEEE Trans. Pattern Anal. Machine Intel. 1993;15(11):1148–1161
  38. Milanese R, Cherbuliez M. A rotation, translation and scale-invariant approach to content-based image retrieval. J. Visual Commun. Image Represent. 1999;10:186–196
  39. Weszka JS, Dyer CR, Rosenfeld A. A comparative study of texture measures for terrain classification. IEEE Trans. Sys. Man Cybernetics. 1976;6(4):269–285
  40. Shyu C-R, Brodley CE, Kak AC, Kosaka A, Aisen AM, Broderick LS. ASSERT: A physician-in-the-loop content-based retrieval system for HRCT image databases. Comput. Vis. Image Understand. 1999;75(1–2):111–132
  41. Kuo W-J, Chang R-F, Lee CC, Moon WK, Chen D-R. Retrieval technique for the diagnosis of solid breast tumors on sonogram. Ultrasound Med. Biol. 2002;28(7):903–909
  42. C.-S. Lu, P.-C. Chung, Wold features for unsupervised texture segmentation, in: Proceedings of the 14th International Conference on Pattern Recognition (ICPR’98), IEEE, Brisbane, Australia, 1998, pp. 1689–1693.
  43. D. Comaniciu, P. Meer, D. Foran, A. Medl, Bimodal system for interactive indexing and 18 retrieval of pathology images, in: Proceedings of the Fourth IEEE Workshop on Applications of Computer Vision (WACV’98), Princeton, NJ, USA, 1998, pp. 76–81.
  44. S.T. Perry, P.H. Lewis, A novel image viewer providing fast object delineation for content based retrieval and navigation, in: I.K. Sethi, R.C. Jain (Eds.), Proceedings of the of SPIE Conference on Storage and Retrieval for Image and Video Databases VI, vol. 3312, 1997.
  45. A. Winter, C. Nastar, Differential feature distribution maps for image segmentation and region queries in image databases, in: IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL’99), Fort Collins, Colorado, USA, 1999, pp. 9–17.
  46. L. Lucchese, S.K. Mitra, Unsupervised segmentation of color images based on κ-means clustering in the chromaticity plane, in: IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL’99), Fort Collins, CO, USA, 1999, pp. 74–78.
  47. S. Ghebreab, Strings and necklaces—on learning and browsing medical image segmentations, Ph.D. thesis, Faculty of computer science, University of Amsterdam, Amsterdam, The Netherlands, July 2002.
  48. R.J. Lapeer, A.C. Tan, R. Aldridge, A combined approach to 3D medical image segmentation using marker-based watersheds and active contours: The active watershed method, in: T. Dohi, R. Kikin (Eds.), International Conference on Medical Image Computing and Computer-Assisted Interventions (MICCAI 2002), no. 2488 in Lecture Notes in Computer Science, Springer-Verlag, Tokyo, Japan, 2002, pp. 596–603.
  49. Loncaric S. A survey of shape analysis techniques. Pattern Recog. 1998;31(8):983–1001
  50. R.C. Veltkamp, M. Hagedoorn, State-of-the-art in shape matching, in: Principles of Visual Information Retrieval, Springer, Heidelberg, 2000, pp. 87–119.
  51. D. Dori, Cognitive image retrieval, in: A. Sanfeliu, J.J. Villanueva, M. Vanrell, R. Alcézar, J.-O. Eklundh, Y. Aloimonos (Eds.), Proceedings of the 15th International Conference on Pattern Recognition (ICPR 2000), IEEE, Barcelona, Spain, 2000, pp. 42–45.
  52. Wang JZ, Li J, Wiederhold G. Simplicity: semantics-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. Machine Intel. 2001;23(9):1–17
  53. Y. Liu, A. Lazar, W.E. Rothfus, M. Buzoiano, T. Kanade, Classification-driven feature space reduction for semantic-based neuroimage retrieval, in: Proceedings of the International Symposium on Information Retrieval and Exploration in Large Medical Image Collections (VISIM 2001), Utrecht, The Netherlands, 2001.
  54. A. Mojsilovis, J. Gomes, Semantic based image categorization, browsing and retrieval in medical image databases, in: IEEE International Conference on Image Processing (ICIP’2000), Rochester, NY, USA, 2000.
  55. T.P. Minka, R.W. Picard, Interactive learning using a society of models, in: Proceedings of the 1996 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’96), San Francisco, California, 1996, pp. 447–452.
  56. C. Jörgensen, Retrieving the unretrievable in electronic imaging systems: emotions, themes and stories, in: B. Rogowitz, T.N. Pappas (Eds.), Proceedings of the of SPIE Photonics West Conference on Human Vision and Electronic Imaging IV, vol. 3644, San Jose, California, USA, 1999.
  57. K. Koffka, Principles of Gestalt Psychology, Lund Humphries, London, 1935.
  58. Jain AK, Vailaya A. Image retrieval using color and shape. Pattern Recog. 1996;29(8):1233–1244
  59. Tversky A. Features of similarity. Psychol. Rev. 1977;84(4):327–352
  60. Swain MJ, Ballard DH. Color indexing. Int. J. Comput. Vis. 1991;7(1):11–32
  61. C.C. Aggarwal, A. Hinneburg, D.A. Keim, On the surprising behavior of distance metrics in high dimensional space, in: Proceedings of the International Conference on Database Theory (ICDT 2001), no. 1973 in Lecture Notes in Computer Science, Springer-Verlag, London, UK, 2001.
  62. A. Hinneburg, C.C. Aggarwal, D.A. Keim, What is the nearest neighbor in high-dimensional spaces?, in: Proceedings of 26th International Conference on Very Large Databases (VLDB 2000), Cairo, Egypt, 2000, pp. 506–516.
  63. R. Hanka, T.P. Harte, Curse of dimensionality: classifying large multi-dimensional images with neural networks, in: Proceedings of the European Workshop on Computer-Intensive Methods in Control and Signal Processing (CIMCSP 1996), Prague, Czech Republic, 1996.
  64. N. Vasconcelos, A. Lippman, A probabilistic architecture for content-based image retrieval, in: Proceedings of the 2000 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’2000), IEEE Computer Society, Hilton Head Island, South Carolina, USA, 2000, pp. 216–221.
  65. N. Vasconcelos, A. Lippmann, A unifying view of image similarity, in: A. Sanfeliu, J.J. Villanueva, M. Vanrell, R. Alcézar, J.-O. Eklundh, Y. Aloimonos (Eds.), Proceedings of the 15th International Conference on Pattern Recognition (ICPR 2000), IEEE, Barcelona, Spain, 2000, pp. 1–4.
  66. K.-S. Goh, E. Chang, K.-T. Cheng, Support vector machine pairwise classifiers with error reduction for image classification, in: Proceedings of the ACM Multimedia Workshop on Multimedia Information Retrieval (ACM MIR 2001), The Association for Computing Machinery, Ottawa, Canada, 2001, pp. 32–37.
  67. T. Westerveld, Image retrieval: content versus context, in: Recherche d’Informations Assistée par Ordinateur (RIAO’2000) Computer-Assisted Information Retrieval, vol. 1, Paris, France, 2000, pp. 276–284.
  68. L. Zhu, C. Tang, A. Rao, A. Zhang, Using thesaurus to model keyblock-based image retrieval, in: Proceedings of the second International Conference on Multimedia and Exposition (ICME’2001), IEEE Computer Society, IEEE Computer Society, Tokyo, Japan, 2001, pp. 237–240.
  69. Salton G, Buckley C. Term weighting approaches in automatic text retrieval. Inform. Proces. Manage. 1988;24(5):513–523
  70. S. Dominich, Formal foundation of information retrieval, in: Proceedings of the Workshop on Mathematical/Formal Methods in Information Retrieval at the International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, 2000.
  71. A.P. de Vries, M.G.L.M. van Doorn, H.M. Blanken, P.M.G. Apers, The Mirror MMDBMS architecture, in: Proceedings of 24th International Conference on Very Large Databases (VLDB’98), New York, NY, USA, 1998, pp. 758–761.
  72. H. Müller, D.M. Squire, W. Müller, T. Pun, Efficient access methods for content-based image retrieval with inverted files, in: S. Panchanathan, S.-F. Chang, C.-C.J. Kuo (Eds.), Proceedings of the SPIE Conference on Multimedia Storage and Archiving Systems IV (VV02), vol. 3846, Boston, MA, USA, 1999, pp. 461–472.
  73. D.A. White, R. Jain, Algorithms and strategies for similarity retrieval, Tech. Rep. VCL-96-101, Visual Computing Laboratory, University of California, San Diego, 9500 Gilman Drive, Mail Code 0407, La Jolla, CA 92093-0407, July 1996.
  74. Sinha U, Kangarloo H. Principal component analysis for content-based image retrieval. RadioGraphics. 2002;22(5):1271–1289
  75. Schmidt-Saugeon P, Guillod J, Thiran J-P. Towards a computer-aided diagnosis system for pigmented skin lesions. Comput. Med. Imag. Graphics. 2003;27:65–78
  76. T. Kämpfe, T.W. Nattkemper, H. Ritter, Combining independent component analysis and self-organizing maps for cell image classification, in: B. Radig, S. Florczyk (Eds.), Pattern Recognition: DAGM Symposium 2001—Lecture Notes in Computer Science 2191, Munich, Germanny, 2001, pp. 262–268.
  77. J.J. Rocchio, Relevance feedback in information retrieval, in: The SMART Retrieval System, Experiments in Automatic Document Processing, Prentice Hall, Englewood Cliffs, NJ, USA, 1971, pp. 313–323.
  78. H. Müller, W. Müller, D.M. Squire, S. Marchand-Maillet, T. Pun, Strategies for positive and negative relevance feedback in image retrieval, in: A. Sanfeliu, J.J. Villanueva, M. Vanrell, R. Alcézar, J.-O. Eklundh, Y. Aloimonos (Eds.), Proceedings of the 15th International Conference on Pattern Recognition (ICPR 2000), IEEE, Barcelona, Spain, 2000, pp. 1043–1046.
  79. Rui Y, Huang TS, Ortega M, Mehrotra S. Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans.Circuits Sys. Video Technol. 1998;8(5):644–655 (special issue on segmentation, description, and retrieval of video content).
  80. Y. Rui, T.S. Huang, S. Mehrotra, Relevance feedback techniques in interactive content-based image retrieval, in: I.K. Sethi, R.C. Jain (Eds.), Proceedings of the SPIE Conference on Storage and Retrieval for Image and Video Databases VI, vol. 3312, 1997, pp. 25–36.
  81. M. Worring, A.W.M. Smeulders, S. Santini, Interaction in content-based image retrieval: An evaluation of the state of the art, in: R. Laurini (Ed.), Proceedings of the Fourth International Conference On Visual Information Systems (VISUAL’2000), no. 1929 in Lecture Notes in Computer Science, Springer-Verlag, Lyon, France, 2000, pp. 26–36.
  82. H. Müller, D.M. Squire, T. Pun, Learning from user behavior in image retrieval: application of the market basket analysis, Int. J. Comput. Vis. (special issue on content-based image retrieval) vol. 56 (1–2), pp. 65–77, 2004.
  83. M. Nakazato, T.S. Huang, 3D MARS: Immersive virtual reality for content-based image retrieval, in: Proceedings of the Second International Conference on Multimedia and Exposition (ICME’2001), IEEE Computer Society, IEEE Computer Society, Tokyo, Japan, 2001, pp. 45–48.
  84. S. Santini, R. Jain, Direct manipulation of image databases, Tech. rep., Department of Computer Science, University of California San Diego, San Diego, CA, November 1998.
  85. T.M. Lehmann, M.O. Güld, C. Thies, B. Fischer, M. Keysers, D. Kohnen, H. Schubert, B.B. Wein, Content-based image retrieval in medical applications for picture archiving and communication systems, in: Proceedings of the SPIE Conference on Medical Imaging, vol. 5033, San Diego, CA, USA, 2003.
  86. B. Revet, DICOM Cook Book for Implementations in Madalities, Philips Medical Systems, Eindhoven, Netherlands, 1997.
  87. R.A. Greenes, J.F. Brinkley, Imaging systems, in: Medical Informatics: Computer Applications in Healthcare, second ed., Springer, New York, 2000, pp. 485–538 (Chapter 14).
  88. Kulikowski C, Ammenwerth E, Bohne A, Ganser K, Haux R, Knaup P, et al. Medical imaging informatics and medical informatics: opportunities and constraints. Methods Inform. Med. 2002;41:183–189
  89. M.W. Vannier, E.V. Staab, L.C. Clarke, Medical image archives—present and future, in: H.U. Lemke, M.W. Vannier, K. Inamura, A.G. Farman, J.H.C. Reiber (Eds.), Proceedings of the International Conference on Computer-Assited Radiology and Surgery (CARS 2002), Paris, France, 2002.
  90. Sarvazyan AP, Lizzi FL, Wells PNT. A new philosophy of medical imaging. Med. Hypotheses. 1991;36:327–335
  91. Pun T, Gerig G, Ratib O. Image analysis and computer vision in medicine. Comput. Med. Imag. Graphics. 1994;18(2):85–96
  92. Rosset A, Ratib O, Geissbuhler A, Vallée J-P. Integration of a multimedia teaching and reference database in a PACS environment. RadioGraphics. 2002;22(6):1567–1577
  93. Binet E, Trueblood JH, Macura KJ, Macura RT, Morstad BD, Finkbeiner RV. Computer-based radiology information system: from floppy disk to CD-ROM. RadioGraphics. 1995;15:1203–1214
  94. Maloney K, Hamlet CT. The clinical display of radiologic information as an interactive multimedia report. J. Digital Imag. 1999;12(2):119–121
  95. Frankewitsch T, Prokosch U. Navigation in medical internet image databases. Med. Informatics. 2001;26(1):1–15
  96. S. Beretti, A. Del Bimbo, P. Pala, content-based retrieval of 3D cellular structures, in: Proceedings of the Second International Conference on Multimedia and Exposition (ICME’2001), IEEE Computer Society, IEEE Computer Society, Tokyo, Japan, 2001, pp. 1096–1099.
  97. M.R. Ogiela, R. Tadeusiewicz, Semantic-oriented syntactic algorithms for content recognition and understanding of images in medical databases, in: Proceedings of the second International Conference on Multimedia and Exposition (ICME’2001), IEEE Computer Society, IEEE Computer Society, Tokyo, Japan, 2001, pp. 621–624.
  98. Orphanoudakis SC, Chronaki CE, Kostomanolakis S. I2Cnet: a system for the indexing. storage and retrieval of medical images by content. Med. Informatics. 1994;19(2):109–122
  99. Aisen AM, Broderick LS, Winer-Muram H, Brodley CE, Kak AC, Pavlopoulou C, et al. Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. Radiology. 2003;228:265–270
  100. Keysers D, Dahmen J, Ney H, Wein BB, Lehmann TM. A statistical framework for model-based image retrieval in medical applications. J. Electronic Imag. 2003;12(1):59–68
  101. Tagare HD, Jaffe C, Duncan J. Medical image databases: a content-based retrieval approach. J. Am. Med. Informatics Assoc. 1997;4(3):184–198
  102. H.J. Lowe, I. Antipov, W. Hersh, C. Arnott Smith, Towards knowledge-based retrieval of medical images. the role of semantic indexing, image content representation and knowledge-based retrieval, in: Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA), Nashville, TN, USA, 1998, pp. 882–886.
  103. Bidgood WD, Bray B, Brown N, Mori AR, Spackman KA, Golichowsky A, et al. Image acquisition context: procedure description attributes for clinically relevant indexing and selective retrieval of biomedical images. J. Am. Med. Informatics Assoc. 1999;6(1):61–75
  104. Winter A, Haux R. A three-level graph-based model for the management of hospital information systems. Methods Information Med. 1995;34:378–396
  105. M.O. Güld, M. Kohnen, D. Keysers, H. Schubert, B.B. Wein, J. Bredno, T.M. Lehmann, Quality of DICOM header information for image categorization, in: Proceedings of the International Symposium on Medical Imaging, vol. 4685, San Diego, CA, USA, 2002, pp. 280–287.
  106. C. LeBozec, M.-C. Jaulent, E. Zapletal, P. Degoulet, Unified modeling language and design of a case-based retrieval system in medical imaging, in: Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA), Nashville, TN, USA, 1998.
  107. Bui AAT, Taira RK, Dionision JDN, Aberle DR, El-Saden S, Kangarloo H. Evidence-based radiology. Acad. Radiol. 2002;9(6):662–669
  108. J.-P. Boissel, M. Cucherat, E. Amsallem, P. Nony, M. Fardeheb, W. Manzi, M.C. Haugh, Getting evidence to prescribers and patients or how to make EBM a reality, in: Proceedings of the Medical Informatics Europe Conference (MIE 2003), St. Malo, France, 2003.
  109. Kahn CE. Artificial intelligence in radiology: decision support systems. RadioGraphics. 1994;14:849–861
  110. Abe H, MacMahon H, Engelmann R, Li Q, Shiraishi J, Katsuragawa S, et al. Computer-aided diagnosis in chest radiography: Results of large-scale observer tests at the 1996-2001 RSNA scientific assemblies. RadioGraphics. 2003;23(1):255–265
  111. Kaplan B, Lundsgaarde HP. Toward an evaluation of an integrated clinical imaging system: Identifying clinical benefits. Methods Inform. Med. 1996;35:221–229
  112. A. Horsch, R. Thurmayr, How to identify and assess tasks and challenges of medical image processing, in: Proceedings of the Medical Informatics Europe Conference (MIE 2003), St. Malo, France, 2003.
  113. S. Antani, L.R. Long, G.R. Thoma, A biomedical information system for combined content-based retrieval of spine X-ray images and associated text information, in: Proceedings of the Third Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP 2002), Ahamdabad, India, 2002.
  114. Chu WW, Cárdenas AF, Taira RK. KMED: A knowledge-based multimedia distributed database system. Inform. Sys. 1994;19(4):33–54
  115. Orphanoudakis SC, Chronaki CE, Vamvaka D. I2Cnet: content-based similarity search in geographically distributed repositories of medical images. Comput. Med. Imag. Graphics. 1996;20(4):193–207
  116. Petrakis EGM. Content-based retrieval of medical images. Int. J. Comput. Res. 2002;11(2):171–182
  117. Tsiknakis M, Katehakis D, Orphanoudakis C. Stelios, intelligent image management in a distributed PACS and telemedicine environment. IEEE Commun. Magazine. 1996;34(7):36–45
  118. Lowe HJ, Buchanan BG, Cooper GF, Vreis JK. Building a medical multimedia database system to integrate clinical information: an application of high-performance computing and communications technology. Bull. Med. Library Assoc. 1995;83(1):57–64
  119. S.T. Wong, H.K. Huang, Networked multimedia for medical imaging, IEEE Multimedia Magazine April–June (1997) 24–35.
  120. C. Le Bozec, E. Zapletal, M.-C. Jaulent, D. Heudes, P. Degoulet, Towards content-based image retrieval in HIS-integrated PACS, in: Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA), Los Angeles, CA, USA, 2000, pp. 477–481.
  121. El-Kwae E, Xu H, Kabuka MR. Content-based retrieval in picture archiving and communication systems. J. Digital Imag. 2000;13(2):70–81
  122. Qi H, Snyder WE. Content-based image retrieval in PACS. J. Digital Imag. 1999;12(2):81–83
  123. J.M. Bueno, F. Chino, A.J.M. Traina, C.J. Traina, P.M. Azevedo-Marques, How to add content-based image retrieval capacity into a PACS, in: Proceedings of the IEEE Symposium on Computer-Based Medical Systems (CBMS 2002), Maribor, Slovenia, 2002, pp. 321–326.
  124. Bucci G, Cagnoni S, De Domicinis R. Integrating content-based retrieval in a medical image reference database. Comput. Med. Imag. Graphics. 1996;20(4):231–241
  125. C.-T. Liu, P.-L. Tai, A.Y.-J. Chen, C.-H. Peng, J.-S. Wang, A content-based medical teaching file assistant for CT lung image retrieval, in: Proceedings of the IEEE International Conference on Electronics, Circuits, Systems (ICECS 2000), Jouneih-Kaslik, Lebanon, 2000.
  126. C. Traina, Jr., Agma J.M. Traina, R.R. dos Santos, E.Y. Senzako, A support system for content-based medical image retrieval in object oriented databases, J. Med. Sys. 21(6) (1997) 339–352.
  127. Chang S-K. Active index for content-based medical image retrieval. Comput. Med. Imag. Graphics. 1996;20(4):219–229
  128. M.O. Güld, B.B. Wein, D. Keysers, C. Thies, M. Kohnen, H. Schubert, T.M. Lehmann, A distributed architecture for content-based image retrieval in medical applications, in: Proceedings of the International Conference on Enterprise Information Systems (ICEIS 2001), Setúbal, Portugal, 2001, pp. 299–314.
  129. T.M. Lehmann, H. Schubert, D. Keysers, M. Kohnen, B.B. Wein, The irma code for unique classification of medical images, in: Proceedings of the SPIE Conference on Medical Imaging, vol. 5033, San Diego, CA, USA, 2003.
  130. Lemke HU. PACS developments in Europe. Comput. Med. Imag. Graphics. 2002;27:111–120
  131. Zhang J, Sun J, Stahl JN. PACS and web-based image distribution and display. Comput. Med. Imag. Graphics. 2003;27(2/3):197–206
  132. C.-T. Liu, P.-L. Tai, A.Y.-J. Chen, C.-H. Peng, T. Lee, J.-S. Wang, A content-based CT lung retrieval system for assisting differential diagnosis images collection, in: Proceedings of the second International Conference on Multimedia and Exposition (ICME’2001), IEEE Computer Society, IEEE Computer Society, Tokyo, Japan, 2001, pp. 241–244.
  133. L. Zheng, A.W. Wetzel, Y. Yagi, M.J. Becich, A graphical user interface for content-based image retrieval engine that allows remote server access through the Internet, in: Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA), Nashville, TN, USA, 1998.
  134. L.H. Tang, R. Hanka, R. Lan, H.H.S. Ip, Automatic semantic labelling of medical images for content-based retrieval, in: Proceedings of the International Conference on Artificial Intelligence, Expert Systems and Applications (EXPERSYS 1998), Virginia Beach, VA, USA, 1998, pp. 77–82.
  135. S. Tzelepi, D.K. Koukopoulos, G. Pangalos, A exible content and context-based access control model for multimedia medical image database systems, in: Proceedings of the Ninth ACM International Conference on Multimedia (ACM MM 2001), The Association for Computing Machinery, Ottawa, Canada, 2001.
  136. R. Pompl, W. Bunk, A. Horsch, W. Stolz, W. Abmayr, W. Brauer, A. Glässl, G. Morfill, MELDOQ: Ein System zur Unterstützung der Früherkennung des malignen Melanoms durch digitale Bildverarbeitung, in: Proceedings of the Workshop Bildverarbeitung für die Medizin, Munich, Germany, 2000.
  137. Sbober A, Eccher C, Blanzieri E, Bauer P, Cristifolini M, Zumiani G, et al. A multiple classifier system for early melanoma diagnosis. Artificial Intel. Med. 2003;27:29–44
  138. Meyer F. Automatic screening of cytological specimens. Comput. Vis. Graphics Image Proces. 1986;35:356–369
  139. Mattie ME, Staib L, Stratmann E, Tagare HD, Duncan J, Miller PL. PathMaster: Content-based cell image retrieval using automated feature extraction. J. Am. Med Informatics Assoc. 2000;7:404–415
  140. Pathfinder: Region-based searching of Pathology Images using IRM.
  141. K. Veropoulos, C. Campbell, G. Learnmonth, Image processing and neural computing used in the diagnosis of tuberculosis, in: Proceedings of the Colloquium on Intelligent Methods in Healthcare and Medical Applications (IMHMA), York, UK, 1998.
  142. M.-C. Jaulent, C. Le Bozec, Y. Cao, E. Zapletal, P. Degoulet, A property concept frame representation for exible image content retrieval in histopathology databases, in: Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA), Los Angeles, CA, USA, 2000.
  143. L.H. Tang, R. Hanka, H.H.S. Ip, R. Lam, Extraction of semantic features of histological images for content-based retrieval of images, in: Proceedings of the IEEE Symposium on Computer-Based Medical Systems (CBMS 2000), Houston, TX, USA, 2000.
  144. H.Y. Tang, Lilian, R. Hanka, H.H.S. Ip, K.K.T. Cheung, R. Lam, Semantic query processing and annotation generation for content-based retrieval of histological images, in: International Symposium on Medical Imaging, vol. 3976, San Diego, CA, USA, 2000.
  145. Robinson GP, Targare HD, Duncan JS, Jaffe CC. Medical image collection indexing: shape-based retrieval using KD-trees. Comput. Vis. Graphics Image Proces. 1996;20(4):209–217
  146. Constantinidis AS, Fairhurst MC, Rahman AFR. A new multi-expert decision combination algorithm and its application to the detection of circumscribed masses in digital mammograms. Pattern Recog. 2001;34:1527–1537
  147. Korn P, Sidiropoulos N, Faloutsos C, Siegel E, Protopapas Z. Fast and effective retrieval of medical tumor shapes. IEEE Trans. Knowledge Data Eng. 1998;10(6):889–904
  148. Baeg S, Kehtarnavaz N. Classification of breast mass abnormalities using denseness and architectural distorsion. Electronic Lett. Comput. Vis. Image Anal. 2002;1(1):1–20
  149. Schnorrenberg F, Pattichis CS, Schizas CN, Kyriacou K. Content-based retrieval of breast cancer biopsy slides. Technol. Health Care. 2000;8:291–297
  150. Kwak D-M, Kim B-S, Yoon O-K, Park C-H, Won J-U, Park K-H. Content-based ultrasound image retrieval using a coarse to fine approach. Annals New York Acad. Sci. 2002;980:212–224
  151. C. Brodley, A. Kak, C. Shyu, J. Dy, L. Broderick, A.M. Aisen, Content-based retrieval from medical image databases: A synergy of human interaction, machine learning and computer vision, in: Proceedings of the 10th National Conference on Artificial Intelligence, Orlando, FL, USA, 1999, pp. 760–767.
  152. C.-R. Shyu, A. Kak, C. Brodley, L.S. Broderick, Testing for human perceptual categories in a physician-in-the-loop CBIR system for medical imagery, in: Proceedings of the IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL’99), Fort Collins, CO, USA, 1999, pp. 102–108.
  153. Schaefer-Prokop C, Prokop M, Fleischmann D, Herold C. High-resolution CT of diffuse interstitial lung disease: key findings in common disorders. Europe. Radiol. 2001;11:373–392
  154. Hansell DM. High-resolution CT of diffuse lung disease. Radiol. Clin. North Am. 2001;39(6):1091–1113
  155. C.Y. Han, H. Chen, L. He, W.G. Wee, A web-based distributed image processing system, in: S. Santini, R. Schettini (Eds.), Proceedings of the SPIE Photonics West Conference on Internet Imaging IV, vol. 5018, San Jose, CA, USA, 2003, pp. 111–122.
  156. S. Sclaroff, A.P. Pentland, On modal modeling for medical images: Underconstrained shape description and data compression, in: Proceedings of the IEEE Workshop on Biomedical Image Analysis (BIA’1994), Seattle, WA, USA, 1994, pp. 70–79.
  157. Y. Liu, F. Dellaert, Classification-driven medical image retrieval, in: Proceedings of the ARPA Image Understanding Workshop, 1997.
  158. Cai W, Feng DD, Fulton R. Content-based retrieval of dynamic PET functional images. IEEE Trans. Information Technol. Biomed. 2000;4(2):152–158
  159. L.R. Long, G.R. Thoma, L.E. Berman, A prototype client/server application for biomedical text/image retrieval on the internet, in: I.K. Sethi, R.C. Jain (Eds.), Proceedings of the Conference on Storage and Retrieval for Image and Video Databases VI, vol. 3312, 1997, pp. 362–372.
  160. S. Santini, A. Gupta, The role of internet images in the biomedical informatics research network, in: S. Santini, R. Schettini (Eds.), Proceedings of the Conference on Internet Imaging IV, vol. 5018, San Jose, CA, USA, 2003, pp. 99–110.
  161. Carazo JM, Stelter HK. The BioImage database project: organizing multidemensional biological images in an object-relational database. J. Struct. Biol. 1999;125:97–102
  162. Z. Geradts, H. Hardy, A. Poortmann, J. Bijhold, Evaluation of contents based image retrieval methods for a database of logos on drug tablets, in: E.M. Carapezza (Ed.), Proceedings of the Conference on Technologies for Law Enforcement, vol. 4232, Boston, MA, USA, 2000.
  163. Laitinen N, Antikainen O, Mannermaa J-P, Yliruusi J. Content-based image retrieval: a new promising technique in powder technology. Pharma. Dev. Technol. 2000;5(2):171–179
  164. G.D. Magoulas, A. Prentza, Machine learning in medical applications, in: G. Paliouras, V. Karkaletsis, C.D. Spyrpoulos (Eds.), Machine Learning and its Applications, Lecture Notes in Computer Science, Springer-Verlag, Berlin, 2001, pp. 300–307.
  165. M.J. Egenhofer, Spatial-query-by-sketch, in: Proceedings of the IEEE Symposium on Visual Languages (VL 1996), Boulder, CO, USA, 1996, pp. 6–67.
  166. Ikeda T, Hagiwara M. Content-based image retrieval system using neural networks. Int. J. Neural Sys. 2000;10(5):417–424
  167. Hersh W, Mailhot M, Arnott-Smith C, Lowe H. Selective automated indexing of findings and diagnoses in radiology reports. J. Biomed. Informatics. 2001;34:262–273
  168. Wagner MM, Cooper GF. Evaluation of a meta-1-based automatic indexing methods for medical documents. Comput. Biomed Res. 1992;25:336–350
  169. R. Chbeir, Y. Amghar, A. Flory, MIMS: A prototype for medical image retrieval, in: Recherche d’Informations Assistée par Ordinateur (RIAO’2000) Computer-Assisted Information Retrieval, vol. 1, Paris, France, 2000.
  170. H. Müller, A. Rosset, J.-P. Vallée, A. Geissbuhler, Integrating content-based visual access methods into a medical case database, in: Proceedings of the Medical Informatics Europe Conference (MIE 2003), St. Malo, France, 2003, pp. 480–485.
  171. T. Würinger, J. Stockhausen, D. Meyer-Ebrecht, A. Böcking, Automatic coregistration, segmentation and classification for multimodal cytopathology, in: Proceedings of the Medical Informatics Europe Conference (MIE 2003), St. Malo, France, 2003.
  172. A.W. Toga, P. Thompson, An introduction to brain warping, in: Brain Warping, Academic Press, New York, 1998, pp. 1–28 (Chapter 1).
  173. Patrakis EGM, Faloutsos C. Similarity searching in medical image databases. IEEE Trans. Knowledge Data Eng. 1997;9(3):435–447
  174. Khan JI, Yun DYY. Holographic image archive. Comput. Med. Imag. Graphics. 1996;20(4):243–257
  175. L. Yu, Kaia nd Ji, X. Zhang, Kernel nearest-neighbor algorithm, Neural Proces. Lett. 15(2) (2002) 147–156.
  176. T. Saracevis, Relevance: a review of and a framework for the thinking on the notion in information science, J. Am. Soc. Inform. Sci., November–December (1975) 321–343.
  177. Schamber L, Eisenberg MB, Nilan MS. A re-examination of relevance: toward a dynamic, situational definition. Inform. Proces. Manage. 1990;26(6):755–775
  178. Bürkle T, Ammenwerth E, Prokosch H-U, Dudeck J. Evaluation of clinical information systems. what can be evaluated and what cannot. J. Evaluat. Clin. Practice. 2001;7(4):373–385
  179. Müller H, Müller W, Squire DM, Marchand-Maillet S, Pun T. Performance evaluation in content-based image retrieval: Overview and proposals. Pattern Recog. Lett. 2001;22(5):593–601
  180. G. Salton, The evaluation of computer-based information retrieval systems, in: Proceedings of the 1965 Congress International Federation for Documentation (IFD 1965), Spartan Books Washington, Washington DC, USA, 1965, pp. 125–133.
  181. J. Nielsen, Usability Engineering, Academic Press, Boston, MA, 1993.
  182. T.M. Lehmann, B.B. Wein, H. Greenspan, Integration of content-based image retrieval to picture archiving and communication systems, in: Proceedings of the Medical Informatics Europe Conference (MIE 2003), St. Malo, France, 2003.
  183. P. Franz, A. Zaiss, U. Schulz, Stefana nd Hahn, R. Klar, Automated coding of diagnoses—three methods compared, in: Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA), Los Angeles, CA, USA, 2000.
  184. A. Geissbuhler, C. Lovis, A. Lamb, S. Spahni, Experience with an XML/HTTP-based federative approach to develop a hospital-wide clinical information system, in: R. Rogers, R. Haux, V. Patel (Eds.), Proceedings of the International Medical Informatics Conference (Medinfo 2001), London, UK, 2001, pp. 735–739.
  185. J.R. Smith, VideoZoom: A spatial-temporal video browser for the internet, in: C.-C.J. Kuo, S.-F. Chang, S. Panchanathan (Eds.), Proceedings of the Conference on Multimedia Storage and Archiving Systems III (VV02), vol. 3527, Boston, MA, USA, 1998, pp. 212–222.
  186. D. Schonfeld, D. Lelescu, VORTEX: Video retrieval and tracking from compressed multimedia databases—template matching from MPEG2 video compression standard, in: C.-C.J. Kuo, S.-F. Chang, S. Panchanathan (Eds.), Proceedings of the Conference on Multimedia Storage and Archiving Systems III (VV02), vol. 3527, Boston, MA, USA, 1998, pp. 233–244.
  187. Anil K. Jain, Robert P.W. Dvin, Jianchang Mao, Statistical Pattern Recognition: A Review, IEEE Transaction on Pattern Analysis and Machin Intelligence, vol. 22 (1), pp. 4–37, 2000.

PII: S1386-5056(03)00211-9

doi: 10.1016/j.ijmedinf.2003.11.024

International Journal of Medical Informatics
Volume 73, Issue 1 , Pages 1-23 , February 2004