Introduction

Image collection visualization

Proposed system
Experimental evaluation
Conclusion and future work

Visualization of Large Collections of Medical Images

Jorge Camargo, Fabio González, Rodolfo Torres

Bioingenium Research Group

National University of Colombia

April 24, 2009

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization
Proposed system
Experimental evaluation
Conclusion and future work

Outline

1 Introduction

2 Image collection visualization

3 Proposed system

4 Experimental evaluation

5 Conclusion and future work

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization
Proposed system
Experimental evaluation
Conclusion and future work

Motivation

The amount of images produced is growing exponentially

Medical images are not the exception:
The Radiology Department of the University Hospital of
Geneva generated more than 12,000 images per day in 2002,
which requires Terabytes of storage per year [6]

Current search engines oer a basic visualization of the results

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization
Proposed system
Experimental evaluation
Conclusion and future work

Main problem

.
How to visualize to physicians a large collection of medical images
that faithfully represents the entire collection and the relationships
among images.

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization
Proposed system
Experimental evaluation
Conclusion and future work

Visualization

2D grid layout xcavator.net [5]. 2D Projection [3]. Tornado of planes [7]. Hyperbolic tree [1]

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
System Overview
Image collection visualization
Features extraction
Proposed system
Similarity measure
Experimental evaluation
Projection
Conclusion and future work

System overview

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
System Overview
Image collection visualization
Features extraction
Proposed system
Similarity measure
Experimental evaluation
Projection
Conclusion and future work

Features extraction

.
Histogram representation: gray, RGB, edges and textures

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
System Overview
Image collection visualization
Features extraction
Proposed system
Similarity measure
Experimental evaluation
Projection
Conclusion and future work

Similarity measure

Euclidean distance, histogram intersection, Jensen-Shannon

divergence, relative bin deviation and Chi-square distance
Distance transformation D (x , x )2 = hx , x i − 2 hx , x i + hx , x i
i j i i i j j j

where hx , x iis the similarity between x and x .

i j i j

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
System Overview
Image collection visualization
Features extraction
Proposed system
Similarity measure
Experimental evaluation
Projection
Conclusion and future work

Image distance

Figure: What is a good measure that represents the distance?

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
System Overview
Image collection visualization
Features extraction
Proposed system
Similarity measure
Experimental evaluation
Projection
Conclusion and future work

Multidimensional scaling (MDS)

MDS focuses on nding the subspace that best preserves the

interpoint distances.
Calculation of Eigenvalues and Eigenvectors of a scalar
product matrix and proximity matrix.
Input: object (images) distances in a high-dimensional space
Output: coordinates that represent the images in a low
dimensional space

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
System Overview
Image collection visualization
Features extraction
Proposed system
Similarity measure
Experimental evaluation
Projection
Conclusion and future work

MDS example

Figure: Faces projected with MDS

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
System Overview
Image collection visualization
Features extraction
Proposed system
Similarity measure
Experimental evaluation
Projection
Conclusion and future work

Isomap

Neighborhood graph construction using k-nearest neighbors,

shortest paths nding (geodesic distance) for each object pair, and
MDS is applied to the new distance matrix.

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
System Overview
Image collection visualization
Features extraction
Proposed system
Similarity measure
Experimental evaluation
Projection
Conclusion and future work

Isomap example

Figure: Faces projected with Isomap

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization Experimental setup
Proposed system Results
Experimental evaluation Results
Conclusion and future work

Experimental setup

Datasets
ImageCLEF (195 images) [4]
Basal-cell Carcinoma (1502) [2]

Matlab prototype implementation with MDS and Isomap

Performance evaluation
Projection time execution
Correlation

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization Experimental setup
Proposed system Results
Experimental evaluation Results
Conclusion and future work

Time

Table: Time in seconds consumed in each projection method in each

dataset

Dataset Size (imgs) MDS ISOMAP (k=7)

Carcinoma 1502 22.3 160.3
Clef 195 0.08 0.68

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization Experimental setup
Proposed system Results
Experimental evaluation Results
Conclusion and future work

Correlation

Figure: Similarity in the original space versus distance in the resulting

visualization space for MDS (left) and ImageCLEF (right) dataset

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization Experimental setup
Proposed system Results
Experimental evaluation Results
Conclusion and future work

Visualization with MDS

Figure: Visualization using RGB feature of ImageCLEF dataset with MDS

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization Experimental setup
Proposed system Results
Experimental evaluation Results
Conclusion and future work

Visualization with Isomap

Figure: Visualization using RGB feature of ImageCLEF dataset with

Isomap

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization
Proposed system
Experimental evaluation
Conclusion and future work

Conclusions

Information visualization is an interesting area for mining large

collections of images
Visualization is an useful mechanism that allows the user to
express the his/her needs
MDS is faster but it does not preserve the non-linear structure
Conventional medical tools like PACs do not oer intuitive
visualization mechanisms

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization
Proposed system
Experimental evaluation
Conclusion and future work

Future work

Other mechanisms from information visualization area (or a

new)
Summarization, exploration and indexing
Overtting and Occlusion
Physicians evaluation
Other medical datasets
Domain knowledge involvement (pathologist annotations)

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization
Proposed system
Experimental evaluation
Conclusion and future work

Acknowledgments

This work was partially funded by the project Sistema para la

Recuperación por Contenido en un Banco de Imágenes Médicas

number 1101393199 of Ministerio de Educación Nacional de

Colombia through Red Nacional Académica de Tecnología
Avanzada RENATA in the Convocatoria 393 de 2006: Apoyo a

Proyectos de investigación, desarrollo tecnológico e innovación .

Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images
 Introduction
Image collection visualization
Proposed system
Experimental evaluation
Conclusion and future work

References

Andrews, K., Putz, W., and Nussbaumer, A.

The hierarchical visualisation system (hvs).
In Information Visualization, 2007. IV '07. 11th International

Conference (2007), pp. 257262.

Caicedo Juan C, Gonzalez Fabio A, R. E.

Evaluacion de caracteristicas de bajo nivel para recuperacion de
imagenes de histologia por contenido.
In II Congreso Colombiano de Computacion (2007).
Camargo, J., and Gonzalez, F.
Visualization of large collections of medical images.
In VI Congreso Colombiano de Computacion (2009).
Henning MÃ×ller, Thomas Deselaers, E. K. J. K. T. M. D.
W. H.
Jorge Camargo, Fabio González, Rodolfo Torres Visualization of Large Collections of Medical Images