MODEL-BASED ILLUMINATION CORRECTION IN RETINAL IMAGES E. Grisan, A. Giani, E. Ceseracciu, A. Ruggeri...

1
MODEL-BASED ILLUMINATION CORRECTION MODEL-BASED ILLUMINATION CORRECTION IN RETINAL IMAGES IN RETINAL IMAGES E. Grisan, A. Giani, E. Ceseracciu, A. Ruggeri E. Grisan, A. Giani, E. Ceseracciu, A. Ruggeri Abstract Abstract Retinal images are routinely acquired and assessed to provide diagnostic evidence for many important diseases. Because of the acquisition process, very often these images are non-uniformly illuminated and exhibit local luminosity and contrast variability. This problem may seriously affect the diagnostic process and its outcome, especially if an automatic computer-based procedure is used. We propose here a new method to estimate and correct luminosity variation in retinal images. The method uses the hue, saturation, value (HSV) colour space to better decouple the luminance and chromatic information. Then, it fits an illumination model on a proper subregion (the retinal background) of the saturation and value channels. This solves many of the drawbacks of previously proposed methods, as filter-based correction which fails when large lesions or retinal features are present. Introduction Introduction Retinal images are acquired with a fundus camera, which records, on film or digital sensors such as CCD, the illumination light reflected by the retinal surface. Very often these images are unevenly or non-uniformly illuminated and thus local luminosity and contrast variability is present: affect the diagnostic process and its outcome, since lesions in some areas may become hardly visible to a human observer. images with large luminosity and contrast variability, both intra- and inter-image, are very difficult to analyze with such automatic systems and the obtained results may be of poor quality. Fig. 1 Retinal images with varying illumination and different lesions Fig. 2 Different regions of the same retinal image showing the same type of lesion (haemorrhage) Normalization Procedure High pass filtering Locally adaptive contrast enhancement Locally adaptive non-linear filters Median filter to extract slow variations of luminosity Non-linear point transformation for brightness adjustment Exploitation of vessel pixels luminosity Background pixel estimation for luminosity and contrast estimation Optic disc or Lesions visibility has to be preserved and hopefully improved by the normalization process, approaches that estimate the correction locally fail in discriminating luminosity variations due to the presence of these features, from variations due to changes in illumination. BUT Acknowledgements Acknowledgements This work was partly supported by a research grant from Nidek Technologies, Italy Bibliography Bibliography [1] B. M. Ege, O. K. Hejlesen, O. V. Larsen, K. Møller,B. Jennings, D. Kerr, and D. A. Cavan, “Screening for diabetic retinopathy using computer based image analysis and statistical classification,” Computer Methods and Programs in Biomedicine, vol. 62, pp. 165–175, 2000. [2] R. C. Gonzalez and R. E.Woods, Digital Image Processing, Addison Wesley Publishing Company, 1992. [3] R. Wallis, “An approach to the space variant restoration and enhancement of images,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Naval Postgraduate School, Monterey (CA), USA, 1976. [4] G. E. Øien and P. Osnes, “Diabetic retinopathy: Automatic detection of early symptoms from retinal images,” in Proceedings NORSIG-95 Norwegian Signal Processing Symposium, September 1995. [5] H. Wang, W. Hsu, K. G. Goh, and M. L. Lee, “An effective approach to detect lesions in color retinal images,” in IEEE Conference on Computer Vision and Pattern Recognition. 2000, June. [6] Y. Wang, W. Tsu, and S. Lee, “Illumination normalization of retinal images using sampling and interpolation,” in Proceedings of SPIE, Medical Imaging 2001: Image Processing, M. Sonka and H. Hanson, Eds., 2001, pp. 500–507. [7] C. Sinthanayothin, Image Analysis for Automatic Diagnosis of Diabetic Retinopathy, Ph.D. thesis, King’s College London, September 1999. [8] M. Foracchia, E. Grisan, and A. Ruggeri, “Luminosity and contrast normalization in retinal images,” Medical Image Methods Methods L(x,y) (x,y) I C(x,y) I(x,y) o Aquired image Contrast distortion factor Luminosity drift ) , ( ˆ ) , ( ˆ ) , ( ) , ( ˆ y x C y x L y x I y x I o Double Paraboloid Model Fig 3. Paraboloid model for theiInternal region Fig 4. Paraboloid model for theiperipheral region Fig 5. Sigmoidal function to ensure smoothness on the combination of the paraboloids representing illumination in the interiorl and in the periphery of the image Fig 6. Complete illumination model Fig 7. From left to right, the original image, the estimated background pixels, end the estimated luminosity moddel on for the value channel In retianl images two effects are usually present: a decrease of luminosity from the centre toward the periphery aluminosity glare in the periphery We describe these effects by means of two elliptic paraboloid, whose parameters are estimated on different region of the fundus: the luminosity decrease in the interior part of the image, and the glare in the periphery. For physical reasons, we want the combination of the two models to be continuous and to have a smooth transition between the regions influenced by the two different illumination phenomena. Interior region Peripheral region Fig 8. Retinal images with the luminosity corrected with the proposd method, and with mean and standard deviation imposed to be equal to those of the original images. Results and discussion Results and discussion A new and effective algorithm to model the luminosity variation in fundus Images is proposed. This is based on the information contained in the retinal background pixels, on which a luminosity model is fit. This allows to cope with the presence of large lesions, that can be misinterpreted as luminosity variation by techniques relying only on local information. At variance with the methods available in the literature, the images with the proposed luminosity variability correction retain their chromatic appearance in every region of the image, and the large features and lesions present in the images are not affected by the correction: their borders remain well defined, and the difference between lesion and the surrounding retinal background is statistically conserved. By using a luminosity model, a physical motivated regularity is imposed on the shape of the luminosity, using information that global on the image. By this means, the methods is much more robust on the size of the blocks, or on the size of the kernels, used to estimate the retinal background or the luminosity variation, at the same time providing an accurate description of the luminosity variation. Estimated background pixels (as in [8])

Transcript of MODEL-BASED ILLUMINATION CORRECTION IN RETINAL IMAGES E. Grisan, A. Giani, E. Ceseracciu, A. Ruggeri...

Page 1: MODEL-BASED ILLUMINATION CORRECTION IN RETINAL IMAGES E. Grisan, A. Giani, E. Ceseracciu, A. Ruggeri E. Grisan, A. Giani, E. Ceseracciu, A. Ruggeri Abstract.

MODEL-BASED ILLUMINATION CORRECTION MODEL-BASED ILLUMINATION CORRECTION IN RETINAL IMAGESIN RETINAL IMAGES E. Grisan, A. Giani, E. Ceseracciu, A. RuggeriE. Grisan, A. Giani, E. Ceseracciu, A. Ruggeri

AbstractAbstract Retinal images are routinely acquired and assessed to provide diagnostic evidence for many important diseases. Because of the acquisition process, very often these images are non-uniformly illuminated and exhibit local luminosity and contrast variability. This problem may seriously affect the diagnostic process and its outcome, especially if an automatic computer-based procedure isused. We propose here a new method to estimate and correct luminosity variation in retinal images. The method uses the hue, saturation, value (HSV) colour space to better decouple the luminance and chromatic information. Then, it fits an illumination model on a proper subregion (the retinal background) of the saturation and value channels. This solves many of the drawbacks of previously proposed methods, as filter-based correction which fails when large lesions or retinal features are present.

IntroductionIntroductionRetinal images are acquired with a fundus camera, which records, on film or digital sensors such as CCD, the illumination light reflected by the retinal surface. Very often these images are unevenly or non-uniformly illuminated and thus local luminosity and contrast variability is present:

affect the diagnostic process and its outcome, since lesions in some areas may become hardly visible to a human observer.

images with large luminosity and contrast variability, both intra- and inter-image, are very difficult to analyze with such automatic systems and the obtained results may be of poor quality.

Fig. 1 Retinal images with varying illumination and different lesions

Fig. 2 Different regions of the same retinal image showing the same type of lesion (haemorrhage)

Normalization Procedure

High pass filteringLocally adaptive contrast enhancementLocally adaptive non-linear filtersMedian filter to extract slow variations of luminosity Non-linear point transformation for brightness adjustmentExploitation of vessel pixels luminosityBackground pixel estimation for luminosity and contrast estimation

Optic disc or Lesions visibility has to be preserved and hopefully improved by the normalization process,

approaches that estimate the correction locally fail in discriminating luminosity variations due to the presence of these features, from variations due to changes in illumination.

BUT

AcknowledgementsAcknowledgementsThis work was partly supported by a research grant from Nidek Technologies, Italy

BibliographyBibliography

[1] B. M. Ege, O. K. Hejlesen, O. V. Larsen, K. Møller,B. Jennings, D. Kerr, and D. A. Cavan, “Screening for diabetic retinopathy using computer based image analysis and statistical classification,” Computer Methods and Programs in Biomedicine, vol. 62, pp. 165–175, 2000.

[2] R. C. Gonzalez and R. E.Woods, Digital Image Processing, Addison Wesley Publishing Company, 1992.

[3] R. Wallis, “An approach to the space variant restoration and enhancement of images,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Naval Postgraduate School, Monterey (CA), USA, 1976.

[4] G. E. Øien and P. Osnes, “Diabetic retinopathy: Automatic detection of early symptoms from retinal images,” in Proceedings NORSIG-95 Norwegian Signal Processing Symposium, September 1995.

[5] H. Wang, W. Hsu, K. G. Goh, and M. L. Lee, “An effective approach to detect lesions in color retinal images,” in IEEE Conference on Computer Vision and Pattern Recognition. 2000, June.

[6] Y. Wang, W. Tsu, and S. Lee, “Illumination normalization of retinal images using sampling and interpolation,” in Proceedings of SPIE, Medical Imaging 2001: Image Processing, M. Sonka and H. Hanson, Eds., 2001, pp. 500–507.

[7] C. Sinthanayothin, Image Analysis for Automatic Diagnosis of Diabetic Retinopathy, Ph.D. thesis, King’s College London, September 1999.

[8] M. Foracchia, E. Grisan, and A. Ruggeri, “Luminosity and contrast normalization in retinal images,” Medical Image Analysis, vol. 3, no. 9, pp. 179–190, 2005.

MethodsMethods

L(x,y)(x,y)IC(x,y)I(x,y) o

Aquired imageContrast distortion

factorLuminosity drift

),(ˆ),(ˆ),(

),(ˆyxC

yxLyxIyxIo

Double Paraboloid Model

Fig 3. Paraboloid model for theiInternal region

Fig 4. Paraboloid model

for theiperipheral region

Fig 5. Sigmoidal function to ensure smoothness on the combination of the paraboloids representing illumination in the interiorl and in the periphery of the image

Fig 6. Complete illumination model

Fig 7. From left to right, the original image, the estimated background pixels, end the estimated luminosity moddel on for the value channel

In retianl images two effects are usually present:a decrease of luminosity from the centre toward the peripheryaluminosity glare in the peripheryWe describe these effects by means of two elliptic paraboloid, whose parameters are estimated on different region of the fundus:the luminosity decrease in the interior part of the image, and the glare in the periphery. For physical reasons, we want the combination of the two models tobe continuous and to have a smooth transition between the regionsinfluenced by the two different illumination phenomena.

Interior regionPeripheral region

Fig 8. Retinal images with the luminosity corrected with the proposd method, and with mean and standard deviation imposed to be equal to those of the original images.

Results and discussionResults and discussionA new and effective algorithm to model the luminosity variation in fundus Images is proposed. This is based on the information contained in the retinal background pixels, on which a luminosity model is fit. This allows to cope with the presence of large lesions, that can be misinterpreted as luminosity variation by techniques relying onlyon local information. At variance with the methods available in the literature, the images with the proposed luminosity variability correction retain their chromatic appearance in every region of the image, and the large features and lesions present in the images are not affected by the correction: their borders remain well defined, and the difference between lesion and the surrounding retinal background is statistically conserved.By using a luminosity model, a physical motivated regularity is imposed on the shape of the luminosity, using information that global on the image. By this means, the methods is much more robust on the size of the blocks, or on the size of the kernels, used to estimate the retinal background or the luminosity variation, at the same time providing an accurate description of the luminosity variation.

Estimated background pixels (as in [8])