Comprehensive review of retinal blood vessel segmentation ...

33
Vol.:(0123456789) 1 3 Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20 https://doi.org/10.1007/s13721-021-00294-7 REVIEW ARTICLE Comprehensive review of retinal blood vessel segmentation and classification techniques: intelligent solutions for green computing in medical images, current challenges, open issues, and knowledge gaps in fundus medical images Aws A. Abdulsahib 1  · Moamin A. Mahmoud 1  · Mazin Abed Mohammed 2  · Hind Hameed Rasheed 1,3  · Salama A. Mostafa 4  · Mashael S. Maashi 5 Received: 19 August 2020 / Revised: 4 February 2021 / Accepted: 13 February 2021 © The Author(s), under exclusive licence to Springer-Verlag GmbH, AT part of Springer Nature 2021 Abstract Recently, there has been an advancement in the development of innovative computer-aided techniques for the segmenta- tion and classification of retinal vessels, the application of which is predominant in clinical applications. Consequently, this study aims to provide a detailed overview of the techniques available for segmentation and classification of retinal vessels. Initially, retinal fundus photography and retinal image patterns are briefly introduced. Then, an introduction to the pre-processing operations and advanced methods of identifying retinal vessels is deliberated. In addition, a discussion on the validation stage and assessment of the outcomes of retinal vessels segmentation is presented. In this paper, the proposed methods of classifying arteries and veins in fundus images are extensively reviewed, which are categorized into automatic and semi-automatic categories. There are some challenges associated with the classification of vessels in images of the retinal fundus, which include the low contrast accompanying the fundus image and the inhomogeneity of the background lighting. The inhomogeneity occurs as a result of the process of imaging, whereas the low contrast which accompanies the image is caused by the variation between the background and the contrast of the various blood vessels. This means that the contrast of thicker vessels is higher than those that are thinner. Another challenge is related to the color changes that occur in the retina from different subjects, which are rooted in biological features. Most of the techniques used for the classification of the retinal vessels are based on geometric and visual characteristics that set the veins apart from the arteries. In this study, different major contributions are summarized as review studies that adopted deep learning approaches and machine learning techniques to address each of the limitations and problems in retinal blood vessel segmentation and classification techniques. We also review the current challenges, knowledge gaps and open issues, limitations and problems in retinal blood vessel segmentation and classification techniques. Keywords Retinal blood · Retinal blood vessel segmentation and retinal blood vessels classification · Fundus images · Deep learning · Machine learning techniques * Mazin Abed Mohammed [email protected] Aws A. Abdulsahib [email protected] Moamin A. Mahmoud [email protected] Hind Hameed Rasheed [email protected] Salama A. Mostafa [email protected] Mashael S. Maashi [email protected] 1 College of Computing and Informatics, Universiti Tenaga Nasional, 43000 Kajang, Selangor, Malaysia 2 College of Computer Science and Information Technology, University of Anbar, Anbar 31001, Iraq 3 Department of Computer Engineering, Al-Esraa University College, Baghdad, Iraq 4 Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, 86400 Johor, Malaysia 5 Software Engineering Department, College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Transcript of Comprehensive review of retinal blood vessel segmentation ...

Page 1: Comprehensive review of retinal blood vessel segmentation ...

Vol.:(0123456789)1 3

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20 https://doi.org/10.1007/s13721-021-00294-7

REVIEW ARTICLE

Comprehensive review of retinal blood vessel segmentation and classification techniques: intelligent solutions for green computing in medical images, current challenges, open issues, and knowledge gaps in fundus medical images

Aws A. Abdulsahib1 · Moamin A. Mahmoud1 · Mazin Abed Mohammed2  · Hind Hameed Rasheed1,3 · Salama A. Mostafa4 · Mashael S. Maashi5

Received: 19 August 2020 / Revised: 4 February 2021 / Accepted: 13 February 2021 © The Author(s), under exclusive licence to Springer-Verlag GmbH, AT part of Springer Nature 2021

AbstractRecently, there has been an advancement in the development of innovative computer-aided techniques for the segmenta-tion and classification of retinal vessels, the application of which is predominant in clinical applications. Consequently, this study aims to provide a detailed overview of the techniques available for segmentation and classification of retinal vessels. Initially, retinal fundus photography and retinal image patterns are briefly introduced. Then, an introduction to the pre-processing operations and advanced methods of identifying retinal vessels is deliberated. In addition, a discussion on the validation stage and assessment of the outcomes of retinal vessels segmentation is presented. In this paper, the proposed methods of classifying arteries and veins in fundus images are extensively reviewed, which are categorized into automatic and semi-automatic categories. There are some challenges associated with the classification of vessels in images of the retinal fundus, which include the low contrast accompanying the fundus image and the inhomogeneity of the background lighting. The inhomogeneity occurs as a result of the process of imaging, whereas the low contrast which accompanies the image is caused by the variation between the background and the contrast of the various blood vessels. This means that the contrast of thicker vessels is higher than those that are thinner. Another challenge is related to the color changes that occur in the retina from different subjects, which are rooted in biological features. Most of the techniques used for the classification of the retinal vessels are based on geometric and visual characteristics that set the veins apart from the arteries. In this study, different major contributions are summarized as review studies that adopted deep learning approaches and machine learning techniques to address each of the limitations and problems in retinal blood vessel segmentation and classification techniques. We also review the current challenges, knowledge gaps and open issues, limitations and problems in retinal blood vessel segmentation and classification techniques.

Keywords Retinal blood · Retinal blood vessel segmentation and retinal blood vessels classification · Fundus images · Deep learning · Machine learning techniques

* Mazin Abed Mohammed [email protected]

Aws A. Abdulsahib [email protected]

Moamin A. Mahmoud [email protected]

Hind Hameed Rasheed [email protected]

Salama A. Mostafa [email protected]

Mashael S. Maashi [email protected]

1 College of Computing and Informatics, Universiti Tenaga Nasional, 43000 Kajang, Selangor, Malaysia

2 College of Computer Science and Information Technology, University of Anbar, Anbar 31001, Iraq

3 Department of Computer Engineering, Al-Esraa University College, Baghdad, Iraq

4 Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, 86400 Johor, Malaysia

5 Software Engineering Department, College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 2: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 2 of 32

1 Introduction

Several techniques are used in the area of medical imag-ing for collecting quantitative data regarding the internal organs of humans. These techniques allow either nonin-vasive or in vivo gathering of quantitative information (Al-Fahdawi 2016, 2018; Abdulhay 2018). It is for this reason that these techniques are preferred in the research and diagnosis of pathologies in living tissues. The dif-ferent properties of the tissues in the human body can be visualized using a wide range of modalities, but the com-monly used modalities include photography with visible spectrum, ultrasound-based imaging, and multi-spectral imaging, which have the capability of improving the spec-tral resolution using wavelengths that are invisible to the human’s eyes, as well as providing relevant information regarding the composition of the photographed image. Other techniques used to visually examine the internal parts of a body include advanced mathematical principles such as MRI and tomographic approaches (Mohammed 2018; Mostafa 2019). The aforementioned techniques are just a subset of the many suggested imaging patterns employed in the collection of quantitative information on organs. Despite a wide range of imaging techniques, the number of approaches proposed for image processing is more than that of the imaging techniques. In this regard, the structural segmentation and characterization of medi-cal images is a very relevant and broad field, which is aimed at outlining the regions of interest. Within the con-text of medicine, this implies the segmentation of ana-tomical structures such as blood vessels and organs. The characterization procedure is aimed at providing a group of measurements that can be utilized in highlighting the properties present in the object under investigation. Sub-sequently, tissues, pathological and healthy features, etc. are distinguished using these measures (Arunkumar et al. 2018; Nayak 2008).

Ophthalmologic and cardiovascular diseases like glau-coma, diabetic retinopathy, macular degeneration, vein occlusion, arteriosclerosis, hypertension, and choroidal neovascularization can be rapidly diagnosed, screened and assessed by quantitatively analyzing the retinal fundus images, which is widely used. Of all the aforementioned diseases, diabetic retinopathy and macular degeneration are the two common causes of vision loss. A crucial step in the quantitative analysis of retinal fundus images is the segmentation of blood vessels, which involves the extrac-tion of clinically relevant features like length, tortuosity, blood vessel density, etc. from the segmented vascular tree. In addition, several applications have used the seg-mented vascular tree, some of which include the synthe-sis of retinal mosaic image, biometric identification, optic

disc identification temporal or multimodal image registra-tion, and fovea localization (Couper et al. 2002). Examples of retinal fundus images are shown in Fig. 1, which also shows the blood vessel structures that have been manually segmented. There are many limitations associated with the manual segmentation of vascular tree in retinal images and some of which include human error and time consum-ing. Human error is prone to occur in situations, in which the structure of the vessels is complex and the number of images is huge. Thus, it is important for eye specialists and ophthalmologists to have an automatic system that can help them in the segmentation and extraction of important clinical features from the retinal blood vessels during the early diagnosis of a wide range of retinal diseases and treatment assessment.

The main purpose of identifying and localizing the ves-sels of the retina is to distinguish the diverse vasculature structure tissues of retina, (which could be tight or wide) from the background of the fundus image as well as other retinal anatomical structures like abnormal lesions, macula, and optic disc. The attention of researchers has been con-tinuously focused on the area of retinal vessels identification because of the presence of non-invasively fundus imaging techniques and the important details that are obtainable from the vasculature structure for the recognition and diagnosis of a wide range of retinal pathology such as age-related macu-lar degeneration (AMD), hypertension, diabetic retinopathy (DR) and glaucoma.

Recently, there has been an advancement in the devel-opment of innovative computer-aided techniques in retinal vessels segmentation and their usage in clinical applications. This study aims to provide a detailed overview of the tech-niques available for retinal vessels segmentation. Initially, retinal fundus photography and retinal image patterns are briefly introduced. Then an introduction to the pre-process-ing operations and advanced techniques of identifying retinal vessels is deliberated. In addition, a discussion on the valida-tion and assessment of the outcomes of retinal vessel seg-mentation is presented. There are some challenges associ-ated with vessels’ classification of the retinal fundus images, which include the low-contrast accompanying the fundus image and the inhomogeneity of the background lighting. The inhomogeneity occurs as a result of the process of imag-ing, whereas the low contrast which accompanies the images is caused by the variation between the background and the contrast of the various blood vessels. This means that the contrast of thicker vessels is higher than those that are thin-ner. Another challenge is related to the color changes that occur in the retina from different subjects, which are rooted in biological features. Most of the techniques used for the classification of the retinal vessels are based on geometric and visual characteristics that set the veins apart from the arteries.

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 3: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 3 of 32 20

In this study, different major contributions are summa-rized as follows:

• We review studies that adopted deep learning approaches and machine learning techniques to address each of the limitations and problems in retinal blood vessel segmen-tation and classification techniques.

• We highlight the deep learning approaches and machine learning techniques role in retinal blood vessel segmenta-tion and classification techniques.

• We review the current challenges, knowledge gaps and open issues, limitations and problems in retinal blood vessel segmentation and classification techniques.

The paper is structured as follows: Sect. 2 describes the retinal quantification measures, which refers to the correla-tion amongst the cardiovascular, heart diseases, and retinal variations. Section 3 discusses the retinal fundus medical images. In Sect. 4, the retinal vessel segmentation techniques provide the categorization and description of the extant reti-nal blood vessel segmentation methodologies. A summary of findings of retinal vessels segmentation methods modern and approaches is discussed in Sect. 5. Section 6 describes the retinal vessel classification techniques. Finally, the con-clusion is made in Sect. 7.

2 Retinal quantification measures

With the aid of retinal quantification measures, the correla-tion amongst the cardiovascular, heart diseases, and retinal variations can be described (Patton 2006). The retinal quan-tification measurements also allow the investigation of the associations between the measurements and different clinical factors like blood pressure, body mass index (BMI) and age in many previous studies. These measures are applied as predictions in computerized diagnosis models. The quan-titative measurement of the retina involves measuring the structure of the retinal blood vessels, as well as angles at bifurcations, junctional exponents, measures of vascular tortuosity, length, fractal dimensions, diameter ratios, and AVR (Patton 2006). Basically, in this section, the different measures are described.

The junctional indicator alludes to the magnitude of x in the equation dx0 = dx1 + dx2, which denotes the root vessel’s diameters (d0), with its branches (d1, d2). Theo-retically, the indicator is estimated as a value of 3 in well-formed vascular network so that the magnitude of losses in the vascular structure can be reduced (Patton 2006). Esti-mating the junctional exponent is a challenging task, espe-cially when the diameter of the branches is bigger than the root vessel and also it is highly sensitive to errors that may

Fig. 1 An example of retinal fundus images along with their corresponding manually segmented blood vessel structures obtained from the DRIVE data set

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 4: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 4 of 32

occur during the measurement of the diameter. To address these issues, the authors in Chapman et al. (2002) develop a measured proportion of deviation of the junctional indi-cator. The measure is developed from the optimal value of the junctional exponent, � = [d30(d31 + d32)]1 = 3 = d0 which addresses the above-mentioned problems. In their study, they infer that there is an important variation between the � of healthy people and people with fringe vessel ailment. The angles that are situated amid the branches in the vessel’s branching location are referred to as the vascular bifurcation angles. In theory, the estimated optimal value of angle is 75°. Researchers have found a relationship between the angle and a wide range of medi-cal outcomes. For example, reduction in arteriolar angles is reported for hypertension, with increase in age and low birth-weight males. Furthermore, a relationship has been found between a lower density of vascular network and lower branching angles, but no relationship is found amongst peripheral vascular disease and bifurcation angles (Patton 2006). The vascular tortuosity, which is the meas-urement of the vessels’ curvature, has been employed in measuring the magnitude of health environments like the retinopathy of prematurity (ROP), in which case, a rise in arteriolar tortuosity is one of the earliest determinants of plus disease. Another characteristic of diabetic retinopathy is venous beading. The length or the diameter proportion is determined as the length from a specific vessel bifurcation to the midpoint in the previous bifurcation and isolated using the distance across the parent vessel in the bifurca-tion. It is used in measuring the constriction of the vessel and is presented as higher in hypertension.

The fractal geometry structure of the vessel through which the fractal dimension is assessed, which is based on the best junctional supporter x = 3, can be very near to 2 (ideally satisfying the existing space). Based on research, an estimate of the value of the fractal dimensions is 1.7, and it is also assumed that the dimension of arterioles is lower than the venular diameters (Patton 2006). The venular diam-eters and arteriolar and their ratios, the AVR, are the most commonly utilized measurements in terms of retinal vessel quantification. In typical cases, the estimation of a vessel’s diameter is made at the centre of the sides of the double-Gaussian cross-sectional profile, which reduces the image’s defocusing effect on the diameter estimation. The AVR is basically made up of the central retinal artery equivalent known as (CRAE) and the central retinal vein equivalent known as (CRVE), as well as the estimates of the arteriolar or venular diameter during the entrance of the vessels into the retina via the OD. The vein and arteries located away from the centre of the OD about 1 and 1.5 disc diameters. They are used for the iterative computation of the estimates. Research efforts have been made in terms of the formula to enable the calculation of the diameter equivalents.

Retinal vessels are effectively and non-invasively images utilizing fundus camera devices. Developing prove involving longitudinal prove that proposes morphological changes in retinal vessel parts are early physiomarkers of cardio-meta-bolic chance and result like any disease. Thus, information from expansive populace-based-related works is required to look at the nature of these morphological affiliations. Many systems have been used for retinal image investigation. Whereas these provide a number of retinal vessel lists, they are regularly limited within the range of investigation and quantitative measurement, and have restricted computeriza-tion, counting the capacity to recognize between venules and arterioles. Consequently, creating trustworthy approach for retinal image examination computer program and produc-ing a wealthy measurement of retinal vasculature in huge volumes of fundus cases.

3 Retinal fundus medical images

The retina is the layered part of the human eye which is sensitive to light and it receives images that are framed by the lens focal point and transferred to the brain via the optic nerve. An image of the retinal fundus is described with the inner lining of the ball involving the optic disc, retina, mac-ula and retinal vessel tree. The fundus is an internal part of the eye that can be seen through the pupil while the eye is being examined. By means of the fundus retinal images, the major vessel features as well as the vascular structure can be studied with several tools and applications (Zhang et al. 2010). A wide range of retinal cameras is available for capturing the images of the retina, depending on what is required for the medical research. There are two main types of cameras used for capturing the images of the reti-nal fundus and they are non-mydriatic and mydriatic retinal image cameras. To capture the retinal fundus image using the mydriatic camera, dilation drops must be applied to the patient’s eyes so that the retina can be dilated. This cam-era is often employed in situations when the patient’s pupil is ≤ 4 mm. On the other hand, the non-mydriatic camera is the most commonly used camera for capturing the images of the retinal fundus. Examples of some of the widely identi-fied non-mydriatic cameras are the Non-Mydriatic Topcon TRC-NW6S (Topcon America Corp., Paramus, EEUU) and Canon CR6-45NM (Canon USA, Lake Success, EEUU) as presented in Fig. 2. With the use of these cameras, ultra-high-resolution images can be instantly obtained by optom-etrists and ophthalmologists (Mohammed 2017a).

Fundus retinal images are almost classified into digital red-free photography, digital color fundus photography, and digital fluorescein angiography (see Fig. 3):

The digital fluorescence angiography is an imaging system, which involves image-taking through the dyestuff

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 5: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 5 of 32 20

tracing technique. It encompasses injecting sodium fluo-rescing into the circulation system. Subsequently, the emit-ted fluorescence helps to illuminate the retina with blue light at a wavelength of 490 nm which is photographed to attain what is known as angiography. After 12–24 h, the reappearance of the fluorescing dye is observed in the urine of the patient, which in turn leads to a yellow-green appearance. To detect pathologic changes like tumours, abnormal vessels, staining, or diabetic retinopathy, an evaluation of the dye patterns is conducted by the ophthal-mologist. Nevertheless, there are some high-risk adverse effects that are associated with the use of dye, which is also regarded as the most parasitical mechanism for the patient (Poplin 2018).

The digital color fundus retinal photography involves mounting a microscope’s customized camera with convo-luted mirrors as well as lenses to capture the image. The design of the high-powered lenses is made in a manner that allows the ophthalmologist to visualise the eye’s rear by making light more focused through the cornea, pupil and lens. With the use of fundus photography, the health condi-tion of the macula, optic nerve, vitreous, retina and blood vessels can be evaluated as seen in Fig. 4.

To capture the digital red-free photography, an unrealiz-able infrared light is used to obtain retinal illumination dur-ing collocation and focusing. The aim of this is to prevent the blinding white light experienced by the patient during the image capturing process. A white Zenon flash is used to

Fig. 2 Above are two kinds of cameras which produce a non-mydriatic retinal image: (Left) Canon CR6-45NM and (Right) Topcon TRC-NW6S

Fig. 3 Kinds of digital images for retinal: (from left to right) digital fluorescing angiography, color fundus photography and red-free photogra-phy

Fig. 4 (Left) CCD a camera for retina and (Right) sample of a retinal image captured from the eye

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 6: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 6 of 32

capture the images. However, this method is also accompa-nied by adverse effects and intrusiveness which should be considered depending on the tool or application. Due to the less intrusive nature of obtaining the red-free images and digital color fundus images, this method is selected for use in this study.

Due to several transmutation and measurement appara-tus that are designed to work on grayscale, color images must be subjected to transformation. The pixel intensities of color images are defined through three line methods: blue, red and green (RGB) so that the synoptic composite can be produced. For the additional color information of RGB images to be conveyed, a 3-D array is required. Mostly, the green channel is used in the analysis of fundus image since the difference between the vessel features and background is larger than that of other channels. Numerous imperative eye diseases and infections as well as systemic maladies show themselves within the retina. Whereas a number of other anatomical structures contribute to the method of vision, this study focused on image analysis, retinal imaging, and image investigation. Through this study, phases of image acquisition, image analysis, and clinical relevance are aimed together considered their commonly inserted relationships. Medical imaging is a really imperative premise for the iden-tification and patient treatment. In specific in ophthalmol-ogy photographs of the eye foundation are utilized by the specialists to analyze, diagnose and report diseases such as diabetic retinopathy or glaucoma. Additionally, in the medi-cal images are regularly encourage assessed by automated computer program to supporting the diagnostics process.

4 Retinal vessel segmentation techniques

The aim of identifying and localizing the retinal vessels is to distinguish the retina’s diverse vasculature structure tissues (which could be tight or wide) from the background of the fundus image as well as other retinal anatomical structures like abnormal lesions, macula, and optic disc. The attention of researchers is continuously focused on the area of retinal vessels identification, because of the presence of non-inva-sively fundus imaging techniques and the important details that are obtainable from the vasculature structure for the recognition and diagnosis task of a wide range of retinal pathology such as age-related macular degeneration (AMD hypertension, diabetic retinopathy (DR) and glaucoma. Recently, there has been an advancement in the development of innovative computer-aided techniques for the segmenta-tion of retinal vessels, and in recent times, the application of these techniques is justified in clinical applications. Oph-thalmologists obtain relevant information from the retinal vasculature structure (RVS), which helps them to detect and diagnose of a wide range of retinal pathology like diabetic

retinopathy, glaucoma, age-related macular degeneration and retinopathy of prematurity. Ophthalmologists also use such vital information to diagnose diseases associated with the heart or brain, which are linked to non-standard differences in retinal vascular shape. Thus, the variations that occur in venules morphology and the retina’s arterioles are of iden-tification assessment as they are key pointers of certain abnormalities.

Generally, vessel segmentation is one of the major areas in medical image segmentation (Lesage 2009; Kirbas 2004) and the retinal vessel segmentation falls under this category. Within the context of retina vessels segmentation, there are many methodologies and algorithms that are improved and applied for the automated localization method, segmenta-tion technique and RVS for feature extraction (Fraz 2012; Aparna and Rajan 2017; Arunkumar 2018). In the current study, a review of recent and early literature has been made, covering the techniques and methodologies that have been proposed for detecting and segmenting retinal vasculature shapes in 2-D retinal fundus cases. In the previous studies, the theoretical underpinning of each category of segmenta-tion is presented, as well as the benefits and limitations of each category. In general, there is a variety of algorithms and techniques available for segmentation, because situations and cases vary. However, all the techniques of retinal seg-mentation share the same stages, which are pre-processing, processing and post-processing tasks. The papers reviewed in our study are classified according to the technique or algo-rithm utilized in the processing phase, resulting in six main groups, which include the following: (1) machine learning (2) kernel-based techniques; (3) the multi-scale methods; (4) the model-based methods; (5) the adaptive local threshold-ing techniques; and (6) the mathematical morphology-based techniques. These six classifications are further clustered into two main categories (machine learning techniques or rule-based techniques) as presented in Fig. 5 and character-ized in Table 1.

There are particular rules that must be followed in an algorithm outlined in the group of rule-based techniques. On the other hand, in the machine learning category, the pre-segmentation retinal case (gold standard or ground truth) is used to create a labelled dataset which is utilized dur-ing the process of training. Nevertheless, when the prob-lem of image analysis is faced by a non-image processing specialist, he/she quickly understands that an independent image processing technique or a one image transformation technique is often not the way out. Thus, this is represented in Fig. 5, where the hybrid nature of these techniques is denoted by nested lobes. A majority of the problems associ-ated with image analysis are complex, especially, medical ones. However, these problems can be solved by combining a variety of basic techniques and transformations to achieve high-performance hybrid. It is for these reasons that the use

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 7: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 7 of 32 20

of hybrid techniques in solving problems associated with retinal vessels localization becomes essential as suggested in (Yang et al. 2008).

There are several metrics available for the assessment of retinal segmentation algorithm in terms of its ability to effi-ciently extract the RVS. In this regard, the commonly used metrics include average precision, average accuracy, average true-positive rate (TPR), average sensitivity (recall, TPR), and average false-positive rate (FPR). Of all the aforemen-tioned metrics, the most commonly used ones in the area of medical research are specificity and sensitivity. When higher values of specificity and sensitivity are achieved, better diag-nosis can also be achieved. Sensitivity is indicative of the algorithm’s ability to detect vessels’ pixels, while specificity indicates an algorithm’s ability to detect non-vessel pixels. These two metrics are features of a method, and they are related to the accuracy factor in several medical imaging areas, which include retinal vessels segmentation (Kauppi et al. 2007). The evaluation metrics are used based on the equations presented below (Walter et al. 2002):

in which TP is known as true positives, FP is known as false positives, FN is known as false negatives, and TN is known

(1)Accuracy = (TP + TN)∕(TP + FN + FP + TN),

(2)Sensitivity (Recall) = TP∕(TP + FN),

(3)Specificity = TN∕(TN + FP),

(4)Pr ecision = TP∕(TP + FP),

as true negatives. In contrast, other researchers evaluated their works using the receiver operating characteristic (ROC) curve (Abd Ghani 2018; Mohammed 2017b), a particular approach that strongly determine certain variables through-out the segmentation process. For FPR and TPR values, the ROC curve becomes a non-linear function. For the best per-formance, the best area under the ROC can be 1.

A majority of the available algorithms and techniques for the segmentation of retinal vessels employ the use of the most popular datasets in the field, which include (1) structur-ing analysis of the retina (STARE) (Staal et al. 2004; Nie-meijer et al. 2011) and (2) digital retinal image for vessel extraction (DRIVE) (Hoover et al. 2000). These databases are widely accepted and used in the area of retinal vessel segmentation tasks and classification process, such that the evaluation of all studies of segmentation process is made using these databases. Furthermore, the high resolution of the retinal fundus images that can be obtained using these datasets makes them popular. Their popularity is also based on the accessibility of physically labeled ground truth cases arranged through two experts in the field. There are 40 reti-nal images contained in the DRIVE dataset, and these 40 images are divided into two equal parts; the first part is for training, while the second part is for testing. On the other hand, there are 20 images contained in the STARE data-set, of which 10 are normal images of the retina, while the remaining 10 are abnormal images. However, a good number of researchers prefer to use other datasets that are not so popular for validation and evaluation of the performance of their proposed techniques or algorithms. Some of such datasets include High-Resolution Fundus (HRF) (Bankhead

Fig. 5 Retinal vessels segmentation techniques

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 8: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 8 of 32

Tabl

e 1

Crit

ical

revi

ew o

f app

roac

hes f

or th

e cl

assi

ficat

ion

of re

tinal

ves

sel s

egm

enta

tion

tech

niqu

es d

epen

ding

on

the

med

ical

imag

es

Aut

hor(

s)/y

ear

Imag

e pr

oces

sing

met

hods

/tech

niqu

esPe

rform

ance

eva

luat

ion

met

rics

Valid

atio

n da

tase

t use

dM

etho

d/te

chni

que

clas

sific

atio

n

Cha

udhu

ri et

 al.

(198

9)O

ptic

al a

nd sp

atia

l pro

perti

es–

–K

erne

l-bas

edC

hanw

imal

uang

(200

3)Lo

cal e

ntro

py d

epen

ding

on

thre

sh-

oldi

ng, M

atch

ed fi

lterin

g, v

ascu

lar

inte

rsec

tion

dete

ctio

n, a

nd le

ngth

fil

terin

g

–ST

AR

E–

Al-R

awi e

t al.

(200

7)M

odifi

ed p

aram

eter

s with

Gau

ssia

n m

atch

ed fi

lter

ROC

cur

ve m

etric

DR

IVE

Vill

alob

os-C

asta

ldi e

t al.

(201

0)Th

e G

LCM

and

seco

nd lo

cal e

ntro

pyA

ccur

acy,

spec

ifici

ty;,

sens

itivi

tyD

RIV

E–

Zhan

g (2

010)

Firs

t-ord

er D

eriv

ativ

e G

auss

ian

with

Th

e M

atch

ed F

ilter

Acc

urac

y, fa

lse

posi

tive

rate

(FPR

)D

RIV

E, S

TAR

E

Zhu

(201

1)C

hara

cter

ize

the

inte

nsity

dist

ribu-

tions

by

Piec

e-w

ise

Gau

ssia

n sc

aled

sc

hem

e

––

Kum

ar e

t al.

(201

6)G

abor

filte

r and

thre

shol

ding

with

G

LCM

ROC

cur

ve m

etric

DR

IVE,

STA

RE

Ods

trcili

k (2

013)

Enha

nced

mat

ched

filte

r and

min

i-m

um e

rror

thre

shol

ding

met

hod

Acc

urac

y, sp

ecifi

city

; sen

sitiv

ityD

RIV

E, S

TAR

E

Zolfa

ghar

nasa

b (2

014)

Mat

ched

filte

r with

Cau

chy

distr

ibu-

tion

and

kern

el fu

nctio

nA

ccur

acy ,

fals

e po

sitiv

e ra

te (f

pr)

DR

IVE

Sing

h an

d Sr

ivas

tava

(201

6)Lo

cal e

ntro

py th

resh

oldi

ng w

ith

Mod

ified

Gau

ssia

n m

atch

ed fi

lter

Acc

urac

y, sp

ecifi

city

;, se

nsiti

vity

DR

IVE

Kum

ar e

t al.

(201

6)G

auss

ian

kern

el w

ith C

ontra

st Li

mite

d A

dapt

ive

Hist

ogra

m E

qual

izat

ion

Acc

urac

y, sp

ecifi

city

;, se

nsiti

vity

DR

IVE,

STA

RE

Sing

h an

d Sr

ivas

tava

(201

6)M

atch

ed fi

lter w

ith G

umbe

l pro

babi

l-ity

dist

ribut

ion

Acc

urac

y, re

ceiv

er o

pera

ting

char

ac-

teris

tics

DR

IVE,

STA

RE

Chu

tata

pe e

t al.

(199

8)G

auss

ian

and

Kal

man

filte

rs w

ith

mat

ched

filte

r–

–Ve

ssel

trac

king

Sofk

a (2

006)

Mat

ched

filte

r with

ves

sel c

onfid

ence

, bo

unda

ries m

easu

rem

ents

for V

esse

l tra

ckin

g

The

reca

ll an

d pr

ecis

ion

DR

IVE,

STA

RE

Ade

l et a

l. (2

009)

The

SMF

7 Si

mul

ated

for B

ayes

ian

vess

el tr

acki

ngSe

gmen

tatio

n m

atch

ing

fact

or m

etric

20 fu

ndus

imag

es h

as b

een

colle

cted

Wu

et a

l. (2

007)

Hes

sian

mat

rix w

ith m

atch

ed fi

lters

fo

r Ves

sel t

rack

ing

Sens

itivi

ty, f

alse

pos

itive

rate

(FPR

)D

RIV

E, S

TAR

E

Yedi

dya

(200

8)K

alm

an fi

lter f

or V

esse

l tra

ckin

gFa

lse

nega

tive

rate

(FN

R).

True

neg

a-tiv

e ra

te (T

PR)

DR

IVE

Yin

et a

l. (2

010)

Vess

el tr

acin

g by

Sta

tistic

al m

etho

dFa

lse

posi

tive

rate

(FPR

)Tr

ue n

egat

ive

rate

(TPR

)D

RIV

E

Li e

t al.

(201

3)B

ayes

ian

theo

ry fo

r Ves

sel t

rack

ing

––

–D

e et

 al.

(201

5)M

athe

mat

ical

gra

ph th

eory

with

Ves

-se

l tra

ckin

gG

eom

etric

fals

e po

sitiv

e ra

te (G

FPR

)D

RIV

E, S

TAR

E

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 9: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 9 of 32 20

Tabl

e 1

(con

tinue

d)

Aut

hor(

s)/y

ear

Imag

e pr

oces

sing

met

hods

/tech

niqu

esPe

rform

ance

eva

luat

ion

met

rics

Valid

atio

n da

tase

t use

dM

etho

d/te

chni

que

clas

sific

atio

n

Bud

ai e

t al.

(201

0)M

ulti-

scal

ing

with

Gau

ssia

n py

ram

idA

ccur

acy,

spec

ifici

ty;,

sens

itivi

tyD

RIV

E, S

TAR

EM

ulti-

scal

eM

oghi

mira

d et

 al.

(201

0)W

eigh

ted

med

ialn

ess f

unct

ion

with

M

ulti-

scal

eRe

ceiv

er o

pera

ting

char

acte

ristic

s, ac

cura

cyD

RIV

E, S

TAR

E

Abd

alla

h et

 al.

(201

1)A

niso

tropi

c di

ffusi

on w

ith M

ulti-

scal

eRe

ceiv

er o

pera

ting

char

acte

ristic

sST

AR

ER

atta

than

apad

et a

l. (2

012)

Line

prim

itive

s for

Mul

ti-sc

ale

Fals

e po

sitiv

e ra

te (F

PR)

DR

IVE

Kun

du (2

012)

Scal

e-sp

ace

base

d on

Mor

phol

ogic

al

Ang

ular

Mea

ns sq

uare

err

orD

RIV

EM

orph

olog

ical

bas

ed m

etho

d

Fruc

ci (2

014)

Dire

ctio

nal M

aps,

Wat

ersh

ed tr

ans-

form

and

Con

trast

Acc

urac

y, p

reci

sion

DR

IVE

Jiang

(201

7)M

orph

olog

ical

ope

ratio

ns w

ith G

loba

l th

resh

oldi

ngA

ccur

acy,

exe

cutio

n tim

eD

RIV

E, S

TAR

E

Diz

daro

et a

l. (2

012)

Edge

det

ectio

n an

d Le

vel s

et in

itial

i-za

tion

Acc

urac

y, sp

ecifi

city

; sen

sitiv

ityD

RIV

E Pr

opos

ed D

atas

etD

efor

mab

le m

odel

Zhan

g et

 al.

(201

5)Sn

akes

con

tour

sA

ccur

acy,

spec

ifici

ty; s

ensi

tivity

DR

IVE

Zhao

(201

5)H

ybrid

regi

on in

tere

st an

d ac

tive

cont

our

Acc

urac

y, sp

ecifi

city

; sen

sitiv

ityD

RIV

E, S

TAR

E

Gon

gt e

t al.

(201

5)Lo

cal r

egio

n in

tere

st w

ith L

evel

set

Acc

urac

y, sp

ecifi

city

; sen

sitiv

ityD

RIV

EJia

ng (2

003)

Ada

ptiv

e th

resh

oldi

ng fo

r Kno

wle

dge-

guid

ed lo

cal

Fals

e po

sitiv

e ra

te, f

alse

pos

itive

rate

, fil

ter r

espo

nse

anal

ysis

STA

RE

Ada

ptiv

e lo

cal t

hres

hold

ing

Akr

am e

t al.

(200

9)A

dapt

ive

thre

shol

ding

for S

tatis

tical

m

etho

dsA

ccur

acy,

rece

iver

ope

ratin

g ch

arac

-te

ristic

s (ro

c)D

RIV

E

Chr

istod

oulid

is (2

016)

Mul

ti-sc

ale

base

d on

Loc

al a

dapt

ive

thre

shol

ding

Acc

urac

y, sp

ecifi

city

; sen

sitiv

ityEr

lang

en D

atas

et

Nek

ovei

(199

5)B

ack

prop

agat

ion

neur

al n

etw

ork

Sens

itivi

tyM

achi

ne le

arni

ngSa

lem

and

Nan

di (2

006)

K-n

eare

st ne

ighb

ors

Spec

ifici

ty; s

ensi

tivity

STA

RE

Xie

(201

3)Fu

zzy

c-m

eans

and

Gen

etic

Alg

o-rit

hm–

DR

IVE

Akh

avan

(201

4)Fu

zzy

c-m

eans

for t

he V

esse

l Tra

ck-

ing

Acc

urac

yD

RIV

E, S

TAR

E

Emar

y et

 al.

(201

4)C

ucko

o se

arch

met

hod

and

fuzz

y c-

mea

ns a

ppro

ach

Acc

urac

y, sp

ecifi

city

;, se

nsiti

vity

DR

IVE,

STA

RE

Maj

i et a

l. (2

015)

Ran

dom

fore

st te

chni

que

with

Dee

p ne

ural

net

wor

k ap

proa

chA

ccur

acy,

rece

iver

ope

ratin

g ch

arac

-te

ristic

s (RO

C)

DR

IVE

Gu

(201

5)D

ecis

ion

tree

Acc

urac

yD

RIV

E, S

TAR

ESh

arm

a (2

015)

Fuzz

y Lo

gic

met

hod

Acc

urac

yD

RIV

ERo

y (2

015)

The

auto

-enc

oder

neu

ral n

etw

ork

Rece

iver

ope

ratin

g ch

arac

teris

tics

(roc)

DR

IVE,

STA

RE

Lahi

ri et

 al.

(201

6)Th

e au

to-e

ncod

er n

eura

l net

wor

kA

ccur

acy

DR

IVE

Maj

i et a

l. (2

016)

Ense

mbl

e of

12

CN

NA

ccur

acy

DR

IVE

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 10: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 10 of 32

Tabl

e 1

(con

tinue

d)

Aut

hor(

s)/y

ear

Imag

e pr

oces

sing

met

hods

/tech

niqu

esPe

rform

ance

eva

luat

ion

met

rics

Valid

atio

n da

tase

t use

dM

etho

d/te

chni

que

clas

sific

atio

n

Lisk

owsk

i (20

16)

CN

NRe

ceiv

er o

pera

ting

char

acte

ristic

sD

RIV

E, S

TAR

ELi

skow

ski (

2016

)D

CN

NA

ccur

acy,

rece

iver

ope

ratin

g ch

arac

-te

ristic

s (RO

C)

DR

IVE,

STA

RE

Fraz

et a

l. (2

012)

Dec

isio

n tre

eA

ccur

acy

DR

IVE,

STA

RE

and

CH

ASE

dat

aset

Ense

mbl

e cl

assi

ficat

ion

-bas

ed m

etho

dD

asgu

pta

2017

)C

NN

Acc

urac

y, sp

ecifi

city

; sen

sitiv

ity;

rece

iver

ope

ratin

g ch

arac

teris

tics

(RO

C)

DR

IVE

Fu (2

016)

Con

ditio

nal r

ando

m fi

eld

and

conv

o-lu

tiona

l neu

ral n

etw

ork

base

d on

m

ulti-

scal

e

Acc

urac

y, sp

ecifi

city

; sen

sitiv

ityST

AR

E,D

RIV

E, a

nd C

HA

SE1

Mac

hine

lear

ning

Gao

et a

l. (2

017)

U-n

et a

nd G

auss

ian

mat

ched

filte

rPr

ecis

ion,

spec

ifici

ty se

nsiti

vity

, and

ac

cura

cyD

RIV

EM

achi

ne le

arni

ng

Zhu

(201

7)39

-D d

iscr

imin

ativ

e fe

atur

e ve

ctor

s an

d Ex

trem

e Le

arni

ng M

achi

neA

ccur

acy,

sens

itivi

ty, a

nd sp

ecifi

city

DR

IVE

Mac

hine

lear

ning

Bra

ncat

i (20

18)

CN

N in

clud

ing

dire

ctio

nal fi

lters

Acc

urac

y, se

nsiti

vity

, and

spec

ifici

tyD

RIV

EM

achi

ne le

arni

ngH

u (2

018)

The

CN

N w

ith e

nhan

ced

cros

s-en

tropy

loss

func

tion

Acc

urac

yST

AR

E an

d D

RIV

EM

achi

ne le

arni

ng

Zhan

g (2

018)

U-n

et w

ith re

sidu

al c

onne

ctio

n an

d ed

ge-a

war

e m

echa

nism

Acc

urac

y, a

nd A

UC

ST

AR

E, D

RIV

E, a

nd C

HA

SE1

Mac

hine

lear

ning

Soom

ro (2

018)

Inde

pend

ent c

ompo

nent

ana

lysi

sA

ccur

acy,

sens

itivi

tyST

AR

E an

d D

RIV

EH

ajab

dolla

hi e

t al.

(201

8)C

NN

s with

com

bina

tion

of p

runi

ng

and

quan

tizat

ion

Acc

urac

yST

AR

EM

achi

ne le

arni

ng

Guo

(201

8)Re

info

rcem

ent s

ampl

e le

arni

ng w

ith

CN

Ns

Acc

urac

y, a

nd a

ucST

AR

E, a

nd D

RIV

E,M

achi

ne le

arni

ng

Wu

(201

8)M

ultis

cale

net

wor

k fo

llow

ed n

etw

ork

Acc

urac

yD

RIV

E, a

nd C

HA

SE1

Mac

hine

lear

ning

Soom

ro (2

019)

CN

N w

ith P

rinci

pal C

ompo

nent

A

naly

sis a

nd T

he m

orph

olog

ical

m

appi

ngs

Acc

urac

y, se

nsiti

vity

STA

RE,

DR

IVE,

and

CH

ASE

1M

achi

ne le

arni

ng

Dha

rmaw

an (2

019)

New

dire

ctio

nally

sens

itive

and

CN

NM

athe

ws c

orre

latio

n co

effici

ent,

F1-s

core

, sen

sitiv

ity a

nd g

-mea

nST

AR

E, a

nd D

RIV

EM

achi

ne le

arni

ng

Jiang

et a

l. (2

019)

Dila

ted

Mul

ti-Sc

ale

CN

NA

ccur

acy,

sens

itivi

ty, s

peci

ficity

, and

ro

cST

AR

E, D

RIV

E, a

nd C

HA

SE1

Mac

hine

lear

ning

Xiu

qin

et a

l. (2

019)

Dee

p le

arni

ng U

-Net

mod

elA

ccur

acy,

sens

itivi

ty, s

peci

ficity

DR

IVE

Mac

hine

lear

ning

Jin (2

019)

DU

Net

with

U-s

hape

arc

hite

ctur

eA

ccur

acy,

and

AU

C

STA

RE,

DR

IVE,

CH

ASE

1, W

IDE

and

SYN

THE

Mac

hine

lear

ning

+ de

form

able

mod

el

Bin

h (2

019)

Sobe

l ope

rato

r con

ditio

n an

d sa

lient

re

gion

com

bine

dA

ccur

acy

STA

RE

Vess

el tr

acki

ng

Hat

amiz

adeh

et a

l. (2

019)

CN

N a

nd e

ncod

er-d

ecod

er a

rchi

tec-

ture

Acc

urac

yD

RIV

E an

d C

HA

SE1

Mac

hine

lear

ning

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 11: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 11 of 32 20

Tabl

e 1

(con

tinue

d)

Aut

hor(

s)/y

ear

Imag

e pr

oces

sing

met

hods

/tech

niqu

esPe

rform

ance

eva

luat

ion

met

rics

Valid

atio

n da

tase

t use

dM

etho

d/te

chni

que

clas

sific

atio

n

Lv e

t al.

(202

0)A

trous

con

volu

tion(

AA

-UN

et) a

nd

guid

ed U

-Net

Acc

urac

y, a

nd A

UC

ST

AR

E, D

RIV

E, a

nd C

HA

SE1

Mac

hine

lear

ning

Zou

et a

l. (2

020)

Loca

l Reg

ress

ion

for M

ulti-

labe

l Cla

s-si

ficat

ion

mod

elA

ccur

acy

STA

RE,

DR

IVE

Mac

hine

lear

ning

Wu

(202

0)N

etw

ork

follo

wed

net

wor

kA

ccur

acy,

and

AU

C

STA

RE,

DR

IVE,

and

CH

ASE

1M

achi

ne le

arni

ngM

ou (2

021)

U-N

et w

ith fu

nctio

nal b

lock

sA

ccur

acy

DR

IVE

Mac

hine

lear

ning

Isav

and

Rah

man

i et a

l. (2

020)

Mor

phol

ogic

al re

cons

truct

ion

and

Gab

or fi

lter

Acc

urac

yST

AR

E, D

RIV

E

Zhou

et a

l. (2

020)

Hid

den

Mar

kov

mod

el a

nd w

eigh

ted

line

dete

ctor

Acc

urac

y, se

nsiti

vity

, spe

cific

ity,

feat

ure

sim

ilarit

y in

dex,

dic

e co

effi-

cien

t and

stru

ctur

al si

mila

rity

inde

x

STA

RE,

DR

IVE

Mac

hine

lear

ning

+ de

form

able

mod

el

Fran

cia

et a

l. (2

020)

Resi

dual

U-N

et W

ith a

U-N

etRe

call

and

f1-s

core

STA

RE,

DR

IVE

Mac

hine

lear

ning

Roch

a (2

020)

Mor

phol

ogic

al o

pera

tions

, 2D

Gab

or

wav

elet

, and

CLA

HE

Acc

urac

yST

AR

E, D

RIV

E, a

nd H

RF

Saro

j et a

l. (2

020)

Fréc

het P

DF

base

d m

atch

ed fi

lter

appr

oach

Spec

ifici

ty, s

ensi

tivity

and

aver

age

accu

racy

STA

RE,

DR

IVE,

and

RM

SDM

achi

ne le

arni

ng

Mou

(202

1)N

ew c

urvi

linea

r stru

ctur

e se

gmen

ta-

tion

netw

ork

CS2

-Ne

The

inte

r-cla

ss d

iscr

imin

atio

n an

d in

tra-c

lass

resp

onsi

vene

ssST

AR

E, D

RIV

E, IO

STA

R, C

OR

N-1

, O

CTA

, OC

T R

PED

eep

lear

ning

Tian

yu M

a (2

021)

Ense

mbl

ing

Low

Pre

cisi

on M

odel

sD

ice

scor

e, re

call,

pre

cisi

onH

VSM

R, M

ICCA

I, M

RI

Dee

p le

arni

ngH

uang

et a

l. (2

021)

Dee

p ne

ural

net

wor

ks-b

ased

(DN

N-

base

d) m

odul

eRe

solu

tion

VIC

AVR

, VA

RIA

, STA

RE,

CH

ASE

-D

BI,

ROD

REP

,HR

FD

eep

lear

ning

Dan

, et a

l. (2

021)

Mul

ti-sc

ale

conv

olut

ion

Ker

nel U

-Nrt

mod

elSp

ecifi

city

, sen

sitiv

ity a

nd av

erag

e ac

cura

cyST

AR

E, D

RIV

EM

achi

ne le

arni

ng

Kha

ing

et a

l. (2

021)

AD

I-G

VF

Segm

enta

tion

with

EM

in

itial

izat

ion

Sens

itivi

ty a

nd av

erag

e ac

cura

cyM

ESSI

DO

R, D

RIO

NS-

DB

and

D

IAR

ET-D

B1

Mac

hine

lear

ning

Kam

ran

et a

l. (2

101)

Mul

ti-sc

ale

gene

rativ

e ad

vers

aria

l ne

twor

ksA

UC

D

RIV

E, C

HA

SE-D

B1,

and

STA

RE

Mac

hine

lear

ning

Saha

Tch

inda

(202

1)C

lass

ical

edg

e de

tect

ion

filte

rs a

nd th

e ne

ural

net

wor

kA

ccur

acy,

sens

itivi

ty, s

peci

ficity

e D

RIV

E, C

HA

SE a

nd S

TAR

EM

achi

ne le

arni

ng

Ash

win

(202

1)C

onvo

lutio

nal n

eura

l net

wor

k ba

sed

on th

e ite

rnet

arc

hite

ctur

eA

CC

D

RIV

E an

d SB

VPI

, REI

DA

-R,

REI

DA

-EE

Mac

hine

lear

ning

Ham

ad (2

020)

Fuzz

y C

-mea

ns c

luste

ring

Sens

itivi

ty, s

peci

ficity

, and

acc

urac

y(D

IAR

ETD

B0/

1, ID

RID

, and

e-o

ptha

Mac

hine

lear

ning

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 12: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 12 of 32

2012), (DIARETDB) dataset (Decencière 2014), (Messidor) dataset (Decencière 2014), and Automated Retinal Image Analyzer (ARIA) dataset (Odstrcilik 2013).

The larger part procedures that are presented within this review are assessed on the dataset STARE as well as the dataset DRIVE. These datasets have a small run of fundus images as training cases. The execution measures are com-puted especially on some morphological attributes cases. Some cases interior STARE and DRIVE do not offer the features related to the retinal picture, for example, the spo-radic foundation of gray-level values, irregularities in lumi-nance of inter/intra image, and differentiate float. The fun-dus captured totally different natural conditions and imaging rebellious for retinal vessel division is an open inquire about for creating the segmentation procedures. The supervised algorithms are much way better than the unsupervised algo-rithms with regard to their execution for vessel segmented methods. There is still room for improving an effective seg-mentation method to detect and diagnose the retinal mala-dies that are based on vasculature networking of the retinal images. In this study, several retinal vessel segmentation techniques are presented and discussed such as Ensemble classifiers, artificial neural network, Statistical learning, and clustering methods, while few techniques are discovered in the retinal vessels segmentation by blind signal separation, support vector machine, and hidden Markov model.

4.1 Kernel‑based methods

The kernel-based techniques depend on vessel pixels with scattered intensities to create a filter kernel that is capable of detecting the boundaries of RVS. The kernel-dependent techniques are usually employed at the image pre-processing phase of other retinal segmentation methodologies because

of their ability to improve the mapping of vessel boundaries. The use of one of several frameworks are suggested and applied in retinal vessels outlining for profile-based kernels that are constructed depending on the indication that the features of the retinal vessels can be described by the inten-sity distribution of retinal vessels. These features are used to create a map for the detection of vessels. The basic principle of a kernel-based technique is to compare the variations in the pixel’s intensity together with the retinal vessel cross-segment outline with a pre-defined pattern that serves the kernel. Thus, in the classic matched filter-dependent meth-ods, the matched filter kernel is applied on the grey retinal images and using the thresholding step to enable the detec-tion of retinal vessels.

There is a wide range of areas in vascular width meas-urement (Li et  al. 2005) and vessel type classification (Saha Tchinda 2021) on which the retinal vessel profiling is applied. For the detection and extraction of vessels, it is used for the creation of a detection map, which in turn enables the extraction of vessels by means of filter-based approaches or region growing. There are two main catego-ries of retinal vascular, which are Gaussian-based shaped and non-Gaussian-based shaped (Ma 2015). The first study in this area is made by Chaudhuri et al. (1989), who found that with a Gaussian function the differences of the cross-segment outline of the retina are high, similar to that shown in Fig. 6.

In Chaudhuri et al. (1989), it is stated that the cross-segment outline of RVS has an estimated Gaussian shape. They also observe the emergence of coordinated filters with Gaussian kernels, which is discussed in earlier studies of retinal vessel tree recognition. Various shape of Gaussian fil-ters (diverse in Gaussian factors standards σ and µ) are used and employed in matching different vessel sizes in a simple

Fig. 6 Cross-segment intensity outline

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 13: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 13 of 32 20

and efficient way because these filters allow the modelling of the retinal vessels cross-segment as a Gaussian task. Nev-ertheless, the response of matched filters to both non-vessels and vessels structures is strong, thereby causing the perfor-mance to degrade in terms of false recognition ratio. There are three relevant factors that must be considered when a matched filter kernel is designed: (1) limited curvature of RVS, where bell-shaped piecewise linear segments are used to approximate the curvature of vessel segments; (2) vessel’s width, which gradually reduces as it traverses between the fovea area and optical disc as presented in Fig. 6; and (3) precise pixel intensity cross-segment outline scattering for the retinal blood vessel part (Singh et al. 2015).

In a study by Singh and Srivastava (2016), they use the same idea by Chaudhuri et al. (1989) to execute and apply using the DRIVE database. The segmentation outcomes, which are regenerated, show that the precision, specific-ity, and sensitivity of 0.9387, 0.9647 and 0.6721, respec-tively, are achieved. In another study, a profile kernel-based algorithm is proposed by (Zhu 2011) for the extraction of RVS based on outlining the cross-segmenting of retinal ves-sel. This is achieved through the use of part-wise Gauss-ian scaled scheme. Upon completion of the modelling, the application of a stage arrangement function is made based on the data obtained by oriented log-Gabor wavelet. Sub-sequent to the mapping of the boundary region of the RVS, the extraction of the cross-sections is made using a method used by the author in this field (Zhu 2010). In a study by Villalobos-Castaldi et al. (2010), a good performance of vessel extraction is achieved by combining matched filter with entropy and an adaptive thresholding technique. In this study, they use the DRIVE dataset, in which a matched filter is employed. Subsequently, the co-occurrence matrix tex-ture feature (Lenskiy 2010) that accounts for the quantity of changes among all sets of grey retinal levels is taken, depicting the changes of grey levels. Then a second-entropy thresholding is used to exploit the entropy of the fundus image grey level scattering so that the background pixels can be segmented from the vessels at the foreground. The vas-cular structures are obtained within approximately 3 s, and high detection accuracy is achieved with a value of 0.9759, 0.9648 and 0.9480 for the precision, sensitivity and specific-ity, respectively. The procedure used by Villalobos-Castaldi et al. (2010) is used by Chanwimaluang and Fan (2003) for the extraction of both the optic disc and retinal vessel. They used the STARE dataset in their study. Nevertheless, the time expended is approximately 2.5 min per retina case, and the larger part of this time is used during the processes of matched filtering and local entropy thresholding technique. In addition, the post-processing step, which involves lengthy filtering for the elimination of isolated pixel is required in their study, but not required in Villalobos-Castaldi et al. (2010). Subsequently, the retinal vascular intersection/

crossovers are identified through the application of the mor-phological thinning stage. Meanwhile, the identification of optic disc is made in two stages including (1) the detection of maximum local variance to facilitate the identification of optic disc center, and (2) the use of snake active contour for the identification of optic disc boundary. Despite the exact methodological steps followed by Odstrcilik (2013) Chan-wimaluang (2003) and Villalobos-Castaldi et al. (2010), the performance achieved is totally different.

In a study by Singh et al. (2015), the significant influ-ence of Gaussian kernel factors on the consequent stages of fundus image techniques is highlighted. The procedure proposed by Chanwimaluang (2003) and Villalobos-Castaldi et al. (2010) is used by Singh et al. (2015), who modify the Gaussian function so that the overall perfor-mance is enhanced. They report an accuracy value of 0.9459, a specificity of 0.9721 and a sensitivity of 0.6735 respectively, utilizing the DRIVE dataset in compari-son with the ratio of ROC metric of 0.9352 achieved by Al-Rawi et al. (2007) who also use the DRIVE dataset. However, in Al-Rawi et al. (2007), a group of changes is used for Gaussian-kernel factors. In another study, Kaur and Sinha (Kumar et al. 2016), use the procedure used by Chanwimaluang et al. (2010) and Singh et al. (2015), but rather than using the Gaussian filter, they use the Gabor filter at the initial step of vessel extraction. They obtain the enhanced vessels through sets of 12 various oriented Gabor filters ranging from 0 to 170 degrees. The perfor-mance of the Gabor-filter-based approach is better than that of Gaussian in specificity and ROC metric. However, the overall sensitivity achieved is more than that achieved by Chanwimaluang (2003) and Singh and Srivastava (2016). Using the DRIVE dataset, Singh and Srivastava (2016) and Singh et al. (2015) evaluate the performance of their work, while in (Frucci 2014), both the STARE with challenges of pathologies and DRIVE dataset are employed in the performance evaluation. Their results show that a high rate of specificity (96%) is achieved in the presence of abnormal parts in retinal fundus images with good detection. Zhang et al. (2010) apply two matched filters to a retinal image: the Gaussian cross-sectional symmetric profile of the retinal vessels, and the asym-metric cross-sectional profile of non-vessels. One of the matched filters results from the (zero-mean) kernel of the symmetric Gaussian construction, whereas the other one results from the Gaussian (FDOG) kernel construction of first-order derivative. The vessels are then detected using the existing matched filter response while the dynamic threshold is used to establish and adjust using the local mean of the response of first-order derivative of Gauss-ian kernel. The dynamic threshold is then utilized in the threshold stage and then applied in the filter stage. In the proposed method, the variance among the FDOG kernel

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 14: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 14 of 32

response for the vessels and non-vessels areas (for exam-ple lesions, bright blobs, and optic disc) is exploited with the aim of determining the level of thresholding based on local mean signal. The results of their experiments for STARE and DRIVE datasets reveal that false detection is significantly minimized through the application of hybrid matched filtering kernels. As compared to Gaussian ker-nel, the false detection is reduced to less than 0.05 using the hybrid matched filtering kernels, even for vessels that are thin, with an average of 0.9510 accuracy in the ordi-nary samples of retinal fundus cases, with the ratio 0.9439 for pathological cases.

Based on the discussion of techniques provided above, the majority of traditional matched filter-based approaches do not directly improve the rendering of matched filter-based approach; rather, they improve the rendering of the threshold techniques, which in turn evaluate the matched filter kernel. In the work by (Zolfagharnasab 2014), the CPDF Function is used in place of the Gaussian kernel of matched filter, and their results show that a total precision of 0.9170 is achieved with 3.5% FP rate through the use of the DRIVE dataset. In the algorithm proposed by (Kumar et al. 2016), the integral zero-crossing property of LoG filter is used, whereby the application of two filters for matched case with LoG ker-nel function is made for fundus images in the retinal case especially to facilitate the detection of RVS. The Contrast Limited Adaptive Histogram Equalization (CLAHE) tech-nique is used to improve the RVS. Their experimental results reveal that an accuracy of 0.9626 is achieved, whereas the sensitivity is 0.7006 and the specificity is 0.9871 for the DRIVE dataset. On the other hand, for the STARE data-set, the accuracy achieved is 0.9637, while the sensitivity is 0.7675 and the specificity is 0.9799. Their result is compared with that of (Odstrcilik 2013) who achieve a precision of 0.9340, a sensitivity of 0.7060 and a specificity of 0.9693 for the DRIVE dataset. However, for the STARE dataset the accuracy achieved is 0.9341, the sensitivity is 0.7847 and the specificity is 0.9512 by utilizing enhanced two-dimensional Gaussian kernel and two-dimensional matched filter. Singh and Strivastava (2016) introduce a new matched filter kernel, by suggesting the Gumbel PDF as the kernel function. They notice the trivial skewness of vessel-cross-segment outline is greatest by Gumble PDF as for Cauchy PDF and Gaussian kernels suggested in (Chaudhuri et al. 1989; Al-Rawi et al. 2007). The authors use the entropy-based optimal threshold-ing at the threshold level, while the use of length filtering is employed during the post-processing steps to enable the elimination of isolated pixels. An improved rendering by the proposed methodology achieve a recognition precision of 0.9522 for the DRIVE dataset and an accuracy ratio of 0.9270 for the STARE dataset. The ROC metric value is 0.9287 for the DRIVE dataset and 0.9140 for the STARE dataset.

4.2 Vessel tracing/tracking methods

These techniques are aimed at tracing the ridges of retina fundus medical images based on a group of facts. The pre-liminary stage of the tracking algorithm involves the selec-tion of seeds that are defined manually or automatically. To detect the vessels’ ridges, zero-crossing of the gradient and curvature are inspected. Nevertheless, a pre-processing step is required in “clean-limbed” ridges detection, in which complex steps are required for the enhancement of sizes and orientations of vessels. To this end, the high level of depend-ence on pre-processing steps limits the vessel tracking. In the tracing methods, it is unnecessary for the seed point process, which is the opening point of the tracking method at the middle of RVS. For example, in a study by Chutatape et al. (1998), the seed points are extracted from the circumference of the optic disc, then, an extended Kalman filter is used to trace the centers of the vessels. As an examining area for the starting point of vascular outline, a semi-ellipse is found around the optical disc. This idea is also used in a research by (Li et al. 2013). The location of the candidate pixels are chosen on the semi-ellipse, as such, the vessel is tracked based on the Bayesian theory method.

In a research by (Wu et  al. 2007), a vessel tracking approach is proposed for the extraction of a retinal vascula-ture. According to the proposed methodology, the matched filters are combined with a knowledge that allows the edge details at the vessel’s matching borders to be exploited; an argument primarily used by (Sofka 2006) for the extraction RVS. Upon the enhancement of the contrast amid the vessels and other tissues of the retina and when the data of the ori-entations and sizes of the improved RVS are presented, the vessels are traced using the ridges through the centerlines beside the ridge seeds, which are automatically chosen. The researchers used the DRIVE dataset to test the performance of their methodology in terms of tracking, and their results show the successful detection of retinal vasculature skeleton with a FP ratio of 19.3%, and the preponderance of false tracked vessels are few vessels. Unlike Wu et al. (2007), the use of Kalman filters are employed in the study conducted by Yedidya and Hartley (Yedidya 2008), in which a pursuit approach is proposed for tracing the centers of the retinal vessels. With their proposed methodology, both thin and wide vessels are detected, even when the images of the retina contain noise; this is achieved by proposing a linear model. Their proposed model is made up of four stages. The first stage involves finding a set-seed exploring point through the image by coiling together the entire image of the retina with a group of matched filters at diverse orientations and scales. The aim of this is to find at least a single seed point at each vessel, thereby eliminating the need to go through all branches. The second stage involves the tracing of blood vessels’ centers using Kalman filter; the tracing begins from

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 15: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 15 of 32 20

the seed points that are found at the first stage. In the third stage, the tracking is stopped the moment the possibility of vessel pursuit is small for various consecutive moves. The fourth stage involves the pursuit of segmentation results when tracking fails in less than the minimum number of steps. With their proposed pursuit approach, they are able to achieve true positive rate of 85.9% for the detection of retinal vessels, and false positivity of 8.1% via the DRIVE datasets.

A new technique is designed by (De et al. 2015) for the extraction of filamentary retina structure. In their work, the mathematical graph theory is used, and the building of the technique is made by establishing a relation between the tracing issue and the digraph matrix-forest theorem in the algebraic theory subject. The purpose behind doing so is to pinpoint the vessel cross-over. There are two central stages involved in the proposed technique, which is the segmenta-tion stage and tracing stage. The segmentation stage involves the extraction of the main skeleton of the RVS, whereas, in the second stage, which is the tracing stage, the digraph representation is constructed, thereby enabling the trac-ing process to perform as digraph depending on the label propagation by means of the Matrix-forest theorem method. With the use of their implemented method, both neural and retinal tracing are performed, and the results of their empiri-cal evaluation show that the performance of the proposed technique is high in both cases. An enhanced version of the statistical-based tracking method suggested by (Adel et al. 2009), is presented by (Yin et al. 2010). This method allows the iterative detection of edge points based on a Bayesian approach through the use of continuity properties of blood vessels and local grey levels statistics. To improve the accu-racy and tracking efficiency of the method, the geometric properties of the vessel are combined with the grey level. The results of the experiments which are performed on both real and synthetic images of the retina (the DRIVE data-base) produced favorable outcomes, in which the TP rate is 0.73 and the FP rate is 0.039. Nonetheless, a more thorough evaluation of retinal images may be required, because of the comparatively low detection rate (TPR) achieved. This is to enable a broader usage of the proposed method for the detection of vessels.

4.3 Mathematical morphology‑based methods (MMBM)

The methods based on mathematical morphology are a group of theory that is derived from mathematics. It is viewed as the use of the lattice theory on spatial construc-tions. This theory is associated with the shapes found within the frame of the image, rather than the intensities of pixels. In other words, it does not focus on the information about the content of an image, where the intensities of pixels are regarded as topographical highs. Traditionally, the use of

mathematical morphology is employed in paired images, and later, it becomes a general processing framework. To this end, it is also applied to grey and colored images through morphological operators. In a typical scenario, the application of morphological procedures can be made to the fundus-paired images and expanded to grey images in the TVS. The MMBM processes are classified into open and close processes involving dilation and erosion. Erosion operation is employed in reducing objects present within the fundus, while dilation is utilized to increase the objects’ size. The MMBM openings are employed when the elimination of structures in the image is required, which involves the application of erosion tracked with the dilation operation. MMBM closing involves filling some of the outlines in the fundus image or merging them through the application of dilation process tracked with the erosion operation.

The Morphological Angular Scale-Space (MASS) approach is carried out by (Kundu 2012) for the purpose of segmenting retinal images. The central idea of this technique is to rotate the elements of different linear structuring lengths (multi-scale) at various angles to determine the components which are connected. The technique also helps to ensure that the vessels are connected, from which the creation of the scale-space occurs by means of the varying lengths of linear structuring elements.. The non-vessel elements, such as those obtained from processed retinal image, are lessened by gradual evolution to higher scales, which are built using the details extracted from lower scales. A certain scale case specified from an experimental outcome and utilizing the vesselness measurement is used by (Salem and Nandi 2006), having the lowest MSR value of 0.0363 as reported by the authors and this value is achieved over 50 fundus cases of retinal images obtained from the DRIVE database. Regard-less of the morphological procedures, the use of morpho-logical mechanisms is employed in the task associated with segmentation of retinal vessels: top-hat transform, geodesic distance, gradient, watershed transform, and distance func-tion. Watershed transmission is improved within the model of MMBM by (Salem and Nandi 2006). The underpinning ideology of this approach emerges from the geographical phenomena of flood water on earth. The presence of water-shed is seen in the form of separating lines created by rain falling over an entire area. Frucci et al. (2014) segment RVS through the use a watershed-based segmentation algorithm. In the proposed algorithm, watershed from both directional information and contrast obtained from the image of the retina are combined. First of all, the image is segmented into multi-regions using watershed transform. Then, each region is allocated a unique grey-level value. In every area, the variation in grey-level in terms of its adjacent areas is calculated to enable the computation of a contrast value. An indicator map consisting of 16 ways is obtained through the application of a 9 × 9 window. The pixels’ grey levels

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 16: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 16 of 32

with the standard deviation are aligned along these ways. Therefore, pixels that are situated in the same premises are allocated the same direction depending on the occurrences of ways within the watershed area. Then, the indicator map and the contrast of every watershed area are obtained and a precursory localization of the RVS is captured, where the areas possessing the maximum contrast (TP variance) are most possibly defined as non-vessel areas. Then, they are denoted as the vessel part. The DRIVE set of information is used to assess the work of the proposed algorithm, and the results show that a recognition accuracy of 77% and preci-sion of 95% are achieved.

With the aim of extracting the RVS, a new argument is proposed by (Jiang 2017), who used global threshold on the basis of morphological procedures. The DRIVE and STARE datasets are employed in the evaluation of the proposed system. The authors report that the system demonstrated a precision of 95.27% for the cross-dataset assessment and 95.88% for 1 dataset assessment. Considering computational complexity and time, the system is designed to minimize the computing complication and processing of multiple inde-pendent operations, which are paralleled, thereby achiev-ing an implementation time of 1.677 s for every case of the retinal images on the CPU platform to obtain the best execution time.

4.4 Multi‑scale‑based methods

The central notion of the manifold scale (multi-scale) method is to identify the retinal image at stages of multiple scales by integrating a datum that include a specific image with a set of one-factor set at multiple scales of derived images (Lindeberg 2011). The representation is valid since the outlines at stages of the coarse scales are the identical structures of simplified transmutations at fine scales with consideration to the small kernels. The individual con-ceivable small kernels that fit the spatial shift invariance and the linearity are Gaussian and its derivatives kernels, which increase with their widths (scales σ) (Babaud et al. 1986). Initially, the scale-space is the model of the multi-scale fundus case as an image demonstration. There are two kinds of multi-scale demonstration that are commonly used, which are the pyramid, and Quad-tree (Zhu 2010). The conception of a majority of retinal vessel segmentation methodologies is based on the pyramid multi-scale kind, in which the representation of the grey level details is made in a manner that allows cases processes to be combined with sequential smoothing phases. Using Gaussian kernels with varying scales leads to a reaction that is presented by (Zhu 2010). The vessel-likeness is determined by eigen values of a Hessian matrix provided by (Tankyevych et al. 2008), thereby resulting in the enhancement of RVS. The purpose of processing the Hessian matrix by means of analyzing

eigen values is to acquire the main tracks of the vessels; the local second-order outlines in the image of the retina can be decomposed to obtain the track of the lowest curvature along the RVS (Frangi et al. 1998). A rapid reduction occurs in the size of the retinal image with scale levels. This in turn leads to an increase in the number of computation needed. Nevertheless, it is limited to extracting heterogeneous struc-tures like retinal lesions and fixed-size structures like optic disc. Therefore, multi-scale approaches can be more appro-priate for structures possessing different length and width within the same image. Budai et al. (2010) propose a classic multi-scale based method for the retinal vessel segmentation. There are three main phases in the proposed technique: (i) Gaussian pyramid generation; (ii) analysis of neighborhood; and (iii) method of fusion for fundus images. Subsequent to the extraction of the green channel of raw images of the retina, a Gaussian pyramid of purpose hierarchy is produced. Its clear that there are three levels in the hierarchy, includ-ing, level 0, 1, and 2. The green channel that represents the original retinal image at level 0 for the highest resolution must be obtained, The height and width of the image start to decrease as the next level is approached.

The second phase involves the analysis of a 3 × 3 neigh-borhood window investigation for every level. To analyze each pixel, the Hessian matrix is calculated by computing a couple of eigenvalues λl and λh of the Hessian matrix which is indicative of the biggest one λh and the scale of smallest curvature λl of the target pixel of the neighborhood window. Then a vessel likeness measure Pvessel = 1 − λl is calculated using the ratio of these values; the value of Pvessel deter-mines whether the target pixel belongs to vessel tree or not. If Pvessel value is close to one, it means that it is most likely a vessel pixel since λl and λh are similar to each other. At every scale level, this analysis is carried out for each pixel. The final stage involves the use of two hysteresis thresholds to binarize the results of segmentation obtained from differ-ent levels, and then the use of pixel-wise OR operation is employed in combining the results, thereby creating the final segmented images as the outcomes. The proposed approach achieved an accuracy of 93.8%, a specificity of 97.5%, and a sensitivity of 65.1% for the STARE database. In addition, for the DRIVE database, the accuracy is 94.9%, the specificity is 96.8%, and the sensitivity achieved is 75.9%. In (Abdallah et al. 2011), a t multi-scale retinal vessel segmentation based on a two-step method is used. In the primary stage, denois-ing of the grey layer from corrupted retinal image is carried out beside the improved Gaussian noise. This is achieved through the application of a flux-dependent anisotropic dif-fusion method; the multi-scale response of multi-level reso-lution of the fundus retinal images is calculated. The second stage involves establishing a model for the analysis of Hes-sian matrix including the eigenvectors of every scale. The findings of the multi-level study are representative of the

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 17: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 17 of 32 20

pixel-wise maximum of the outcomes acquired from all the scales. The ROC curve metric achieved was 0.94514 for the STARE database as reported by the proposed method. Algo-rithm for the blood vessel segmentation in the retina images is used by (Rattathanapad et al. 2012). The segmentation in this algorithm is based on multilevel line detection and connection of line primitives. With the use of multilevel line detection, the images of the retina can be extracted as mul-tiple ratios of Gaussian smoothing factors. Then, extraction of the line primitives at various scales are integrated into the vessel feature extraction outcome. The DRIVE dataset is used for validating the proposed algorithm, which dem-onstrates the ability to identify most of the main measure of vessel skeleton with the FP ratios. Moghimirad et al. (2010) propose a novel approach for segmenting retinal vessel based on a multi-scale method. In the proposed approach, func-tion of weighted medialness integrated with the eigenval-ues of the Hessian matrix is utilized. There are two main phases in the proposed approach. The first phase involved the extraction of the medial axis of retinal vessels through the use of two-dimensional medialness function multiplied with smoothed eigenvalues. For the second stage, vessels are reconstructed, involving the extraction of vessels’ center-line and simultaneous estimation of vessels’ radii to acquire the outcomes of segmented image. The validation of the proposed technique is made using the DRIVE and STARE datasets, and the results reveal that the assessment of the method obtained a good accuracy of 0.9659 and an ROC curve metric of 0.9580 for the DRIVE database. For the STARE database, the accuracy achieved is 0.9756 and the ROC curve metric is 0.9678.

4.5 Methods based on model

The idea of deformable framework is utilized to define a lot of image processing algorithms and techniques, through which the difference of a given class of objects in an image are abstractly modeled. The main kinds of these methods are concerned with the modelling of shape variations, involv-ing the representation of the shape as a surface of a flex-ible curve, and then the shape is deformed so that it can be matched to a particular object class instance. The process of deformation is not random, because it functions based on two dominant theories, which are Curve Evolution and Energy Minimization, which originated from geometry, physics and approximation theories. There are two major categories of deformable models, which include geometric and parametric models (McInerney and Terzopoulos 1996).

4.5.1 Models of parametric deformable (PDM)

The PDM modeling is also referred to as snake or active contours that are defined as parametrized curves, which

naturally rely on certain factors to be produced. The PDM modeling like the active contour modelling is basically aimed at segmenting objects in fundus retinal images modalities by assigning curves on objects’ borders in the retinal images. This process can be referred to as dynamic contour modelling, because it is modified within a location in the region of the target object. In this way, dynamic evolution of the model can occur to fit the outline of object through an iterative revision. The reference to snakes arises from the use of parametric curve to represent a curve, but because it relies on a factor to effect the meas-ure of curves through the procedure of fitting, it is topo-logically rigid. This means that it is not flexible enough to define the objects that consist of an adaptable quantity of independent measures. In addition, another limitation of snake-based segmentation technique is that it is unable to join to precise vessel borders, when there is a high level of noise or if the contrast levels of the vessels are relatively low, or if the vessels are “empty” (McInerney and Terzo-poulos 1996).

Based on snake contours, Jin (2019) developed a new segmentation algorithm, which consists of three key stages: (1) first, the parameters initialization method based on the Hessian feature edges, in which the use of the feature is employed to extract all darker linear outlines in the retina fundus image. Depending on the seeds of extracted linear structure, the images used are divided into (N) localization areas (R); (2) the second stage involves representing each localization area R as retina fundus image using pixel’s intensity impact, and then, the construction of the function of snake energy is made on the image representation so that the snake’s location is identifed between the neighborhood of vessel edges and real ones; (3) in the last stage, as all model-based methods close, the region growing method utilizes R to obtain the outcome of retina fundus image area, and then post-processing is applied on the grown area through context feature. The validation of the proposed methodology is made using the DRIVE dataset, and the results show that the performance of the proposed method-ology is remarkable, achieving an accuracy of up to 95.21%, a sensitivity of 75.08%, and a specificity of 96.56%. Zhao (2015) propose an efficient and effective infinite perimeter active contour model with hybrid region for vessel segmen-tation. Fusion of region data of the retinal sample like the grouping of intensity data and local stage improvement map are used. The use of the local stage based on improvement map is employed to preserve the edges of vessels because of its superior nature, while a correct feature segmentation is indicated by the given details of the image intensity. The performance of the proposed method is evaluated for the DRIVE and STARE datasets, and the results show that accu-racy of 0.956, specificity of 0.978, and sensitivity of 0.780 are achieved for STARE, while for DRIVE, a sensitivity of

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 18: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 18 of 32

0.7420, a specificity of 0.9820, and an accuracy of 0.9820, are achieved.

4.6 Models of geometric deformable (GDM)

The Level-set and Fast Marching techniques are numerical methods specially tailored to track the propagation of sur-faces. The starting point of GDM originates from the inves-tigation of curves and surfaces that are regarded as interfaces and is first created and implemented by (McInerney and Terzopoulos 1996). Subsequently, it is suggested by (McIn-erney and Terzopoulos 1996) that the curve should be rep-resented as a level set based on Euclidean distance instead of parameter-dependency, meaning that zero-level set of an auxiliary distance function ∅ represents the contour. The basis of representing contours in a flexible way is the level sets theory; here reparameterization is not required for the joining or breaking of contours. A new level-set method that does not require an initialization for level-set function and a local region area descriptor are used by (Gongt et al. 2015). There are two main steps in the proposed technique which are described as follows: (1) a contour C is found, with which the entire image of the retina is divided into many sub-regions depending on whether the pixels are within the contoured area or not; and (2) a clustering algo-rithm is applied on the sub-regions obtained from the first step, thereby producing a local cluster value, which is a new region information that is used in redefining an energy function in the first step, until the algorithm converges. The major contribution of the paper lies in the second step, which eliminates the heterogeneity of pixel intensities of the retinal image. In addition, the second step helps in provid-ing information regarding the local intensity at image pixel level, thereby eliminating the need for level-set function re-initialization, which is regarded as the main limitation of level-set-based techniques. The DRIVE dataset is used to evaluate the proposed technique and the results show that the technique achieves values of 0.9360, 0.7078, and 0.9699 for accuracy, sensitivity, and specificity, respectively. Dizdaro et al. (2012) enhance the level-set-based segmentation of retinal vessels in terms of edge detection and initialization stages, which are required as a pre-requirement for level-set methods. Initialization steps involve the determination of the points of seed by sampling vessels’ centerlines that rely on identification of ridges via a ridge detection technique. Then a phase map is built to enable the determination of accurate boundaries of the retinal vessel tree. To test the pro-posed algorithm, the authors created their dataset, which is used together with the DRIVE dataset. Results show that the method achieves different ratios, with an accuracy of 0.9412, a sensitivity of 0.9743, and a specificity of 0.7181 for the DRIVE dataset, and an accuracy of 0.9453, a sensitivity of 0.9640 and a specificity of 0.6130 for the STARE dataset.

Conclusively, both geometric and parametric deformable models have the same problem, which is the requirement of seed points set that are automatically or manually detected.

4.7 Adaptive local thresholding techniques

A threshold technique is regarded as an image segmentation methodology that is popular and straightforward. In natural scene images, objects are arranged in a manner that makes them undistinguishable, but the objects such as tissues and organs in medical images are more discernible. Thus, extensive use of the thresholding techniques is employed in research that focus on the segmentation of medical image, in which different grey levels are used in representing the different organs and tissues. Basically, the thresholding techniques is employed in searching for a global value that enables the optimal maximization of the separation between varying classes in the image. At a global level, the effective-ness of thresholding is indicated by clearly defined areas. Another way to determine the effectiveness of thresholding is if the grey levels clustered around values that have the lowest interference. The global thresholding is regarded as a key source of faulty segmentation due to inferior qual-ity of source material, unequal illumination, distortion, and anatomical objects possessing multiple classes and hybrid characteristics. Furthermore, since the gradual transition between different grey levels can be noticed in the image of the retina, noise distortions, uneven illumination and other major segmentation errors become observable because of the pixel-wise approach employed in global thresholding. One of the key challenges of global thresholding is identi-fying the pixel segmentation that includes similar levels of grey (pixel intensity) for the same anatomical object. Thus, as a solution, it is suggested that the use of region-wise thresholding methodologies be employed in the identifica-tion of retinal vessels. It is also suggested that the develop-ment and implementation of such methodologies be made through different approaches that are categorized into three major groups including, fuzzy-based adaptive thresholding, statistical, as well as knowledge based.

In a work by (Christodoulidis 2016), the MTVF method is employed in the segmentation of small thin vessels, based on the fact that 10% of the entire surface of vas-cular network is made up of small retina vessels fundus (Niemeijer et al. 2011), which, in turn, is representative of the numerical model based on the adaptive threshold-ing method. There are four main stages in the proposed technique, which include the pre-processing; multi-scale line identifying vessel improvement; the adapted thresh-olding technique; and Multi-Scale Tensor Voting process-ing known as MTVF; and the post-processing step. The pre-processing stage involves the extraction of the raw image that includes the green channel of the retina. Then,

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 19: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 19 of 32 20

an application that corrects the contrast (Foracchia et al. 2005) is made to the image to enhance its contrast. The removal of noise is achieved through the application of Dual-tree complex wavelet transform. Subsequent to the pre-processing steps, the enhancement of retinal vessel fundus image is made using the multi-scale line recogni-tion method used in (Kingsbury 1998). The vessels are iso-lated by feeding the outcome of the multi-scale line indi-cator to an adaptive thresholding technique. The authors obtain different ranks of the improved thresholding by fit-ting the histogram of MSLD reaction to the modulus of the Gaussian function. Furthermore, they modify the optimum global threshold by varying the distance of Gaussian func-tion from the mean via the following equation:

where µGaussian and σGaussian denote the corresponding mean and standard deviation of the fitted Gaussian function. Then, different thresholds are obtained by experimentally varying the α variable, which is regarded as the nucleus of adaptive thresholding. Consequent to the completion of the adaptive thresholding stage, the separation of several smaller vessels occurs. Therefore, the smaller vessels are rejoined using a multi-scale tensor voting method introduced by (McInerney and Terzopoulos 1996). In conclusion, adaptive threshold-ing is employed in the extraction of large and medium-sized retinal vessels, while the smaller vessels are extracted using MTVF. Finally, a post-processing step is applied using morphological cleaning for the removal of the remnants of non-vasculature components left after the process of adap-tive thresholding. The authors test their method using the recently available Erlangen dataset (Odstrcilik 2013), and the results show that they achieve an average accuracy of 94.79%, a sensitivity of 85.06%, and a specificity of 95.82%.

In the study by (Akram et al. 2009), retinal vessels are automatically located and extracted using an adaptive thresholding technique. Through the selection of points to differentiate vessels from the remaining part of the image, a binary vascular mask is created using the statis-tical-based adaptive thresholding. There are two phases in the proposed method, and they are adaptive threshold-ing and pre-processing phases. The pre-processing phase involves feeding the Gabor wavelet filter with the mono-chromatic RGB retinal image to enhance the vasculature pattern, especially for vessels that are thin and less visible, based on an image examination method that is applied in (Christodoulidis 2016). The enhanced retinal image obtained holds maximum grey values for the background, while the pixels belonging to vessels holds intensity values that are greater than that of the background. The DRIVE dataset is used to test the proposed technique, and the results show that the accuracy achieved is 0.9469 and the

(5)T = |�Gaussian| + �|�Gaussian|,

ROC under the curve metric is 0.963. Jiang et al. (2019) propose an information discovery with full guide for local adaptive thresholding method, which uses a certification process based on multi-thresholding analytical system. In its most fundamental structure, assume a binary image, I, as the binary outcomes from a thresholding procedure at threshold levels T, from which the recognition process is utilized to choose if any of the areas in I is a well-defined object. The process is executed on a set of various thresh-olding methods. The last stage of image localization is achieved through a combination of various outcomes of diverse thresholding methods. In conclusion, binariza-tion is the process through which objects hypotheses in an image are generated through a number of hypothetic thresholds, and then the object is accepted or rejected based on a specific classification. The main contribution of the proposed algorithm is the classification procedure, in which any details like color intensity, shape and contrast related to the object under consideration is incorporated. Hence, the name knowledge-guided technique due to the variation in thresholding levels during the process of seg-mentation, which is based on the information available about a desired object.

4.8 Machine learning (ML) approaches

The utilization of ML is increasing rapidly in the field of pattern recognition, including computer-aided diagnosis and medical image analysis (Mohammed 2018). Since the 1960s, pattern recognition has gained popularity in the area of research (Mostafa 2019) and has made remarkable advance-ment over the years, resulting in a wide range of methods and paradigms that are relevant in several fields like retinal vascular structure. Typically, there are three main classifi-cation of machine learning algorithm, which include, rein-forcement learning, unsupervised and supervised learning. This classification is typically based on the reactions y for input data x. The supervised learning method usually occurs in situations when each input x, have an associated observ-able output y, while, in the case of the former two classes, the lack of data makes this correspondence absent. Unsuper-vised learning involves the exploration of relevant patterns in the input data without the need for explicit supervision (Arunkumar et al. 2018). The assumption in reinforcement learning is that there is a specific class of model that is fol-lowed by the dynamics of the system at hand (Arunkumar 2018). As a means of identifying the blood vasculature structure in angiogram images, Nekovei (1995) designed a back propagation ANN vessel technique. The technique uses raw grey-intensity values of pixels in place of feature extraction. To process each pixel in the image, a window that covers the number of pixels is created around the image, while the neural network is fed with the raw grey intensities

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 20: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 20 of 32

as input. The coverage of the whole window is achieved by sliding window process (pixel by pixel). The training data-set consists of angiogram patch samples that are manually selected, which shows equality between the vessel distri-bution and background pixels so that the biasing of neural network towards pixels classification is prevented. Using this technique, the difficulty associated with feature extrac-tion is avoided. The performance of this approach for vessel detection is 92% on angiograms. The investigation in domain adaptation and transfer learning is conducted by (Weiss et al. 2016) in the domain of retinal vessels fundus images segmentation task, in which a denoised stacked autoen-coder ANN is trained with sufficiently labeled smaller than expected patches of retinal vessels fundus images obtained from the DRIVE database. The DRIVE database is consid-ered as the main area, where the autoencoder is adjusted for arrangement on the STARE database, which represents the main field. There are two layers of encoding in the stacked auto-encoder with 100–400 nodes for every layer, respec-tively, and is followed by a layer of SoftMax regression. As a show of potent knowledge transfer, an accelerated learning performance is demonstrated by the proposed technique with area under ROC curve equal to 0.92. A hybrid framework of deep and ensemble learning is designed by (Maji et al. 2016) to enable a thorough detection of fine retinal vessels. In this framework, an advanced ML, Deep Neural Network (DNN), is employed for detecting vessel-ness based on unsupervised learning via a denoising autoencoder using inadequately pre-pared retinal vascular patches of fundus images. The learn-ing outline of retinal vasculature patches for fundus image is utilized as weights in a Deep Belief Network (DBN) and the reaction of the DBN is utilized in supervised learning task using the random forest technique with the end goal of vasculature tissues detection. A comprehensive exploitation of the denoising autoencoder is carried out in terms of its high capability. The DRIVE dataset is employed in training and testing the method. Regardless of an average accuracy of 0.9327 achieved by the proposed method, it is consid-ered as relatively weak compared with other state-of-the-art approaches. The uniqueness of the framework lies in its abil-ity to detect both fine and coarse retinal vascular structure, as well as its performance consistency. Based on the work of Maji et al. (2015) and Roy and Dasa 2015), Lahiri et al. (2016) demonstrate two parallel levels of stacked ensemble based on denoised autoencoder networks. A specific vessel orientation is distinguished by each kernel. In the first level of the ensemble, (n) denoising a parallel stacked via autoen-coders for the same architecture are trained, while the sec-ond level involves the implementation two stacked denoised autoencoders for parallel training, and then the fine-tuning of the last architecture is carried out until a satisfactory accu-racy is accomplished. The SoftMax classifier is employed in combining the decisions of individual members of the

ensemble. The method demonstrate consistency, reliability, and average accuracy of up to 0.953.

In the work by (Maji et al. 2015), vessel pixels are dis-tinguished from non-vessel pixels using DBN method with ensemble of 12 Convolutional Neural Network (CNN). There are three layers contained by each CNN and the training for each of these layers is made separately using a random selection of 60,000 patches including 31 × 31 × 31-sized obtained from 20 raw color retinal images from the DRIVE dataset. During the extraction of these patches, each convolutional network produce the probabilities of vessel-ness separately. Then the final vessel-ness probability of each pixel is formed by averaging the individual responses. Despite the inability to achieve the highest accuracy of detection (0.9470) by the method, its superiority is demon-strated through the presentation of learning vessel from data, because the strength and accuracy of numerous specialties represented by the ensemble of CNN is greater than that of a single neural network. In the study conducted by (Gu 2015), they focus on the detection and restoration of small foreground retinal filamentary structure through the use of an iterative two-steps method that is created based on the Latent Classification Tree (LCT) framework. Subsequent to the construction of the confidence map, an adequately high threshold is located on it, resulting in a partial image seg-mentation comprises of two major vessels; long and thick. The authors obtain the rest of the low confidence map (fila-mentary filaments) through the use of latent classification tree. The reconnection of the filamentary structure to the major filaments (large vessels) is made through a novel mat-ting and accomplishment domain method. These stages are carried out repeatedly until the entire surface is scanned. The method is tested on the DRIVE and the STARE data-bases, and the result shows a good accuracy in the detection stage of 97.32% for the DRIVE database and an accuracy of 97.72% for the STARE database, which is expected because of the obvious reduction in the FP formed via false identity of the right retinal RVS. The performance of the proposed technique is promising, and aside extraction of retinal ves-sels, the method can be applied in other areas like 3D MRI images and neural tracing procedure. An automated method, which rapidly and accurately segments retinal and optical disc outlines is used in (Liskowski 2016), in which CNNs are used for supervised segmentation. Just like for all NNs, the training of the CNN layers is carried out in a special-ized way so that both retinal and optic disc localization are addressed. The DRIVE and STARE datasets are employed in the validation of the proposed method for retinal ves-sel segmenting stage. Based on the results, the ROC curve metric achieved is 0.822 for the DRIVE database and 0.831 for the STARE database. Within the context of CNN-based methods, astounding execution has been accomplished by (Liskowski 2016) with an ROC metric of 0.99 and an

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 21: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 21 of 32 20

accuracy of 95.33%, whereas (Dasgupta 2017) achieved an AUC of 0.974 for automated retinal vessel segmentation. In the work of (Salem and Nandi 2006), a new enhancement is made to the typical KNN clustering technique for reti-nal vessel segmentation task. The feature vectors consist of the local maxima of the largest eigen value, green channel intensity, and the local maxima of the gradient magnitude that represents each pixel. Based on these features, a modi-fied version of KNN is used in clustering the image pixels without the use of a training set. The evaluation of the seg-mentation method is carried out for the STARE database, which shows a sensitivity of 77% and a specificity of 90% in the three feature vectors. The sensitivity is 76% and the specificity is 93%, while utilizing only the maximum eigen-value feature. Sharma and Wasson (Sharma 2015) propose the fuzzy method in the retinal vessel segmentation task uti-lizing a variety of high-pass and low-pass filter versions of retinal fundus images as the input. There is a wide range of fuzzy rules contained in the fuzzy logic and each fuzzy rule is built based on different thresholding values. The pixel values are selected and discarded using the thresholding values according to the fuzzy rules, leading to the extrac-tion of a vessel. An average accuracy of 95% is achieved by the methodology for the DRIVE database. A two-process combination between a fuzzy logic technique and a vessel tracking procedure is attempted by (Akhavan 2014). The first process involves the detection of the centerlines of improved retinal images, whereas, the second stage involves the use of Fuzzy C-Means (FCM) clustering to fill the retinal vessels. The centerline images are combined with fuzzy segmented images to obtain the final segmented result. Centerlines are utilized as first points for the FCM with region growing method. The assessment results of the techniques show an accuracy of 72.52% for the DRIVE database and 77.66% for the STARE database. A new methodology based on fuzzy c-means clustering and genetic algorithm is proposed in (Xie 2013). The pre-processing step involves the extraction of the green channel of raw retinal images, which is also improved using histogram equalization method. Subsequently, the reti-nal images are divided into two main levels, which are the texture and smooth level. The input of the processing stage is the texture layer because of the amount of information contained in it. The genetic algorithm is used together with the fuzzy c-means approach to cluster the features involv-ing data acquired in the first step. First, the near optimal solution of the global solution is obtained using the genetic algorithm and secondly, the estimated result is utilized as first values of the fuzzy c-means approach. The work of fuzzy c-means is eased and enhanced by genetic algorithm in terms of producing the best outcome without experienc-ing the challenge of local recognition of best results. Emary et al. (2014) attempt to address the issue associated with the objective function of a typical fuzzy c-means using the

possibility kind of fuzzy c-means technique enhanced by Cuckoo search approach. In their work, the novel clustering approaches, possibility c-means proposed by (Roy and Dasa 2015) and possibility fuzzy c-means proposed by (Krinidis 2010) are employed in establishing the best kind of fuzzy c-means that is consequently utilized for the segmentation of retinal vessels fundus images. The heuristic search algo-rithm of the Cuckoo Search is used in investigating the best of the proposed algorithm. The assessment for the STARE database demonstrates an accuracy of 0.94478, a specificity of 0.987 and a sensitivity of 0.586, whereas for the DRIVE database, an accuracy of 0.938, a specificity of 0.984, and a sensitivity of 0.628 are achieved.

5 Summary of findings of retinal vessel segmentation methods modern and approaches

The previous section provides the categorization and description of the extant retinal blood vessel segmentation methodologies. The results of the performances of the meth-ods are compared and the authors evaluate the performance of their methodologies using publicly available datasets. The different methodologies for the segmentation of reti-nal vessels follow similar procedures. The first step in each methodology is the pre-processing step, which involves the extraction of the green or grey layer (from the image of raw color retinal, followed by the enhancement of the image’s contrast. The next step is the processing step which is the nucleus of the algorithm, involving the use of the various techniques that are categorized in the previous section. In the last step of post-processing, the initial segmented image is submitted to be processed for smoothing and edge pre-serving and improvements. With regard to the categories of retinal segmentation provided in Fig. 5, there is no best algorithm, mathematical scheme, or technique that meets all the performance metrics for achieving high segmenta-tion. However, there are a number of factors that help in determining the most appropriate methodology, and some of them include (1) achieved accuracy that in turn, lays on the resulting sensitivity and specificity. With this metric, segmentation is regarded as the best if it is able to attain the biggest potential value of sensitivity, or shows small false detection for other retinal structures, while the specificity is maintained at optimal level. However, when the performance of the method is high in terms of the detection of pathologi-cal retinal images, then the method’s optimality increases; (2) time and computational complexity: with a higher level of accuracy, the computational time and power needed by the techniques tend to decrease; (3) robustness: a technique is considered to be superior than other methods if it dem-onstrates robustness with respect to parameters variation.

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 22: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 22 of 32

The backbone of different automated computer-aided systems for screening and diagnosis of cardiovascular and ophthalmologic diseases is the system’s ability to accu-rately detect and segment the retinal vascular structure. Despite the development and implementation of several promising methodologies, more research is needed so that the blood vessel methodologies can be further improved, especially for images with pathological retina and noisy behind the few number of retinal images for which datasets are available for public use. The role of expert diagnosis in practical applications cannot be replaced by retinal vessels segmentation systems, instead, they are meant to facili-tate accuracy in diagnosis, while reducing the workload of ophthalmologists. This way, experts are able to diagnose a large number of patients with high level of accuracy and comparable time.

Based on the algorithmic perspective, the reliability, per-formance and accuracy of the various methods of extract-ing vessels in the literature are determined by the special features possessed by retinal images. A rough outline of the features is as follows:

• There is a wide range of vessel widths, from less than a pixel up to 12 pixels wide.

• Vessels are often of low contrast, especially narrow ves-sels.

• Stronger responses are produced by different types of structures, like the optic disc, retina boundary, and pathologies at their boundaries.

• A bright strip, which is referred to as the central reflex runs down the center of some vessels, thereby leading to a complicated intensity cross-section, makes it harder to distinguish from two side-by-side vessels.

The results that are obtained from the application of the previously mentioned techniques are influenced by these features. In fact, of all the techniques presented in (Lesage 2009; Kirbas 2004; Fraz 2012), the most flexible tools for the extraction of vessel is demonstrated by active contours and neural networks. On one hand, the ability of neural networks to learn a suitable training set, including all possible objects or features makes it more appropriate for use on medical images. Nevertheless, each time a new feature is introduced to the network, a new training is required. Another limitation is that it is challenging to debug the network’s performance. Furthermore, active contours have been found to be a flex-ible and suitable tool for this task, because they are able to exploit the mixed-control; both bottom-up (image data) and top-down (prior to approximate knowledge about the loca-tion, shape and dimension of the structures). Object bounda-ries that are ambiguous or noisy can be managed by active contours. Such boundaries are commonly found in medical images such as MRI, ultrasound images, angiographies.

6 Retinal vessel classification techniques

The area of retinal vessel segmentation has undergone extensive research (Weiss et al. 2016), yet, less attention is given to the area that deals with the automatic classi-fication of segmented vessels. There are some challenges associated with the classification of vessels in images of the retinal fundus, and some of those challenges include the low contrast accompanying the fundus image, and the inhomogeneity of the background lighting. The inhomoge-neity occurs as a result of the process of imaging, whereas the low contrast is caused by the variation between the background and the contrast of the various blood vessels. This means that the contrast of thicker vessels is higher than those that are thinner. Another challenge is related to the color changes that occur in the retina for different sub-jects which are rooted in biological features. Most of the techniques used for the classification of the retinal vessel are based on geometric and visual characteristics that set the veins apart from the arteries. Basically, there are four areas in which the veins differ from the arteries: the shade of veins is darker than that of arteries, veins are thicker than arteries which are lighter, and the arteries are easily recognized by the central flex. In addition, there is often an alternation between veins and arteries close to the optic disc and before branching off. Nevertheless, in many situ-ations, these variations do not adequately distinguish the arteries from the veins. For instance, in situations when the quality of images is low, the central flex in the exter-nal areas is eliminated. A very dark shade is contained by the external regions of the image due to the effect of shading that arises from the inhomogeneity of the image’s lighting. Such situations create resemblance between the arteries and the veins, resulting in the misclassification of some vessels. In addition, since thickness varies from the highest value close to the optic disc to the smallest value in the external areas, it cannot be relied upon as a suit-able classification feature. The branching off of key veins and arteries into the optic disc, increases the possibility of having two arteries or veins that are adjacently positioned outside the optic disc.

There are five major steps involved in the approaches used in many studies that have focused on the classifi-cation of vessels in fundus images. These steps include the following: (1) segmentation of vessel, (2) selection of ROI for the classification of its vessels, (3) extraction of features from various areas of the vessel, (4) feature vec-tors’ classification, and (5) merging of results so that the vessel’s final label can be determined. In typical situations, the extraction of features involves three main procedures including, segment-based, profile-based, and pixel based. Profile is described as a piece of vessel possessing one

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 23: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 23 of 32 20

pixel thickness that is perpendicular to the orientation of the vessel. There are two major divisions of approaches that are proposed for the classification of vessels; semi-automatic and automatic. The semi-automatic approaches require the labeling of major vessels by an expert and the subsequent propagation of these labels is effected over the vessel network by means of vessel tracking approaches that employ the use of connectivity details, as well as the characteristics of the structure of a vascular tree. Unlike the semi-automatic, the automatic approaches initially involve the extraction of the centreline pixels of the ves-sels that constitute the vessel skeleton from the image of the retinal fundus. This is followed by the extraction of a wide range of features for each centreline pixel. In the last step of the automatic approach, the classifier labels each pixel as a vein or an artery.

6.1 Retinal vessel semi‑automatic techniques

The work in Martinez-Perez et al. (2002) proposes a semi-automatic method to enable the analysis of retinal vessel. Their approach involves the individual analysis of venous and arterial trees. After a branch has been identified by an expert as either an artery or a vein, the topological and geo-metric features are calculated for each of the branch’s seg-ment using an automatic procedure. An approach, in which the conditional optimization is employed, as proposed by (Rothaus et al. 2007, 2009), in their work. This approach, which is an extended version of the work of Martinez- Perez, is based on the anatomical properties of veins and arter-ies. In their method, the propagation of labels is carried out during the creation of vessel graph through the use of some starting segments that have been manually labelled. In the work by Estrada et al. (Estrada 2015), a semi-automatic-approach is presented, in which a combination of domain-specific knowledge and graph-theoretic methods are used. With the approach, which is dependent on the estimation of the vascular topology, the whole vasculature is analyzed. The method is regarded as an extended version of the tree topology estimation framework that is proposed by (Estrada et al. 2014), because it is dependent on the estimation of vascular tree topology, and combines expert domain-spe-cific features for the construction of likelihood model. In the next step of their proposed framework, the space of prob-able solutions that correspond with the projected vessels is searched repeatedly so that the model can be maximized. Four datasets [WIDE (Estrada et al. 2014), AV-DRIVE (Qureshi et al. 2013), CT-DRIVE (Qureshi et al. 2013) and AV-INSPIRE (Niemeijer et al. 2011)] are used to measure the performance of the presented method. The test results show that classification accuracy rates of 91.0, 93.5, 91.7, and 90.9% are achieved for WIDE, AV-DRIVE, CT-DRIVE and AV-INSPIRE, respectively. Reviews of extant literature

show that fully automated approaches that are employed in the clinical context are deployed in most of the studies conducted in the area of retinal vessel classification. The subsequent section presents an extensive review of such fully automated classifiers.

6.2 Retinal vessel automatic techniques

The complexity of artery and vein classification in retinal fundus images arises from the resemblance between the descriptive characteristics of these two structures, as well as the difference in contrast and lighting of fundus images. The two main problems associated with retinal images are the inhomogeneity in contrast and the lighting as a result of changes that occur in intra- and inter-images. However, these changes must be removed so that useful color information is obtained. It is for this reason that authors like (Grisan 2003) perform an analysis of the background image to enable the correction of these changes by statistically estimating their characteristics. The work by (Grisan 2003) in 2003 was one of the earliest works in the area of automatic methods, which were designed for the automatic classification of retinal ves-sels. One of the main steps involved in the analysis of fundus image is the extraction of vessel network, which requires the implementation of a vessel tracking process as well as a set of vessel segments. In their work, the vessel network is extracted automatically using the sparse tracking method. Vessel network symmetry and local features are exploited by dividing the retinal image into different portions having the same number of veins and arteries. The assumption is that the local features of the two types of vessels within these zones are quite different. This approach involves the division of an area around the optic disc (within 0.5–2 of the optic disc diameter from its centre) into four zones, with each zone containing one of the main arches. Despite the pres-ence of several features, the mean of the hue channel, and the difference of the red channels in each vessel segment are regarded as the most unique and suitable features that can be used for classification. Given two adjacent vessels, within the clinical context, the darker vessel is regarded as the vein, and in the absence of a significant difference in the red val-ues, the vessel which possesses more color homogeneity is regarded as a vein. Subsequent to the extraction of features, the fuzzy clustering algorithm is used in the classification of vessels. The criterion for classification is the Euclidean dis-tance between each pixel and the mean value of features in each class. Lastly, the labels of pixels found in each segment are merged based on major voting, and then the classifica-tion of the entire is carried out. Subsequent to the classifi-cation of vessel in the given zone, this classification can be extended from this zone by means of vessel tracking, which is made in a situation when the texture and color provides only little information for distinguishing between arteries

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 24: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 24 of 32

and veins. In this study, the analysis of 35 fundus images is performed and the algorithm is developed using 11 of the images and validated using the remaining 24. Their results show that for the 24 images, an overall error rate of 12.4% is achieved. This approach is considered as a more appropriate approach for optic disc-centered images, because the process of classification is implemented around the optic disc, and the underpinning assumption is the number of veins and arteries possessed by all four quadrants is the same.

In 2007, another method was developed by (Ruggeri et al. 2007) through AVR assessment in the area from 0.5 to 1 disc diameter from the optic disc margin. The authors provide a correlation with a manual reference standard on 14 images with variation ranging between 0.73 and 0.83, subject to the protocol used for the calculation of AVR. Subsequently, a modified version of this method is presented by (Tramon-tan et al. 2008), who improve the vessel tracking algorithm, resulting in an increase in the correlation with a reference standard of up to 0.88 for 20 images that are obtained from a DCCT study. In another study, the authors (Diabetes Control and Complications Trial Research Group 1987) employ the red contrast parameter, which is defined by the ratio of the peak of the central line intensity value to the largest intensity value of two edges of a vessel. The classification of veins and arteries in this study is made based on the average value of the red contrast along the vessel that is responsible for determining the probability of a vein. The classification of veins and arteries are made based on the average value of red contrasts along the vessel that is responsible for determin-ing the probability of falling under the category of veins. In a study conducted by (Li et al. 2003), the central flex in the green channel distinguishes the arteries from the veins. In their work, they identify the type of vessel through the application of the minimum Mahalanobis distance classifier. Using 505 vessel segments that are obtained from a wide range of fundus images, their experiments are performed and the results show that for arteries, a positive rate of 82.46% is achieved by the classifier, whereas the positive rate for veins is 89.03%.

To be able to separate veins from arteries, a wide range of features and classifiers are tested by (Jelinek et al. 2005). These tests are carried out using eight features, some of which are the standard deviation and the mean of red, blue, green and hue channels. The classifiers which used in their work are 13 classifiers obtained from Weka toolbox (Azuaje 2006; Efron 1983; Hall 1999). Their results show that the hue’s standard deviation, and the mean of the green are the best features, whereas for the best results of classification, a mean accuracy of 70% is achieved for eight images by the Naïve-Bayes classifier. (Narasimha-Iyer et al. 2007) carry out an investigation of four classifiers (SVM, 5-NN, NN, and Fisher linear discriminant) with the aim of classifying retinal vessels. Their results show that the Support Vector Machine

achieves the best results. The separation of the arteries from the veins is carried out using functional and structural fea-tures. Here, the central reflex is used as a structural indica-tor, as well as the ratio of the vessel optical densities from images at oxygen-sensitive and oxygen-insensitive as a func-tional feature. The evaluation of the classifier is performed by applying the classifier to a set of 251 segemented ves-sels that are acquired from 25 dual wavelength images. The results obtained show that the true positive which is achieved by their classifier is 97% for arteries, while that of veins is 90%. In the work by (Kondermann 2007) in 2007, ROI-based and two profile-base methods of feature extraction were investigated. In addition to that, the authors use two methods of classification based on NN and SVM for the sep-aration of veins and arteries in the fundus images. The RGB color space values are used as the profile-based features, whereby the mean values of the features are subtracted. The subtracted mean values are previously determined for each centreline pixel, as well as each pixel belonging to its profile. The ROI-based features are obtained from a square location found around each centreline pixel, and this centreline pixel is rotated in a manner that allows the alignment of the hori-zontal axis with the vessel’s main axis. In addition, through the use of multiclass principle component analysis, the size of the feature vector is reduced prior to the application of the classifier.

An ensemble classifier of boot strapped decision trees is proposed by (Fraz et al. 2014), so that vessels in fundus images can be classified as veins or arteries. The extraction of features from HIS and RGB color spaces is performed in three different ways, including, profile-based, pixel-based and segment-based. There are two ways through which the segment-based can be calculated: first, the calculation of the intensities’ variance and the mean is made for the whole segment, whereas the second method involves the division of segments that are comparatively large into smaller pieces having a length of about 50 pixels, and the calculations of mean and variance of the intensities are carried out in the pieces. Thus, a set feature is extracted, containing 51 color features, of which 16 are selected through the use of out-of-bag feature importance index. Their approach is used for the classification of all vessels in the whole image, and it is eval-uated using 3149 segmented vessels that are obtained from 40 macula-centered EPIC Norfolk fundus images (Forouhi 2012). Based on the reported results, their proposed method achieves a classification rate of 83%. A local binary pat-tern (LBP) is presented by (Hatami 1605), who use the pro-posed method to extract features of robustness in fundus images of low quality and low contrast. The LBP extracts features that are capable of providing sufficient details from the shape and texture. In their work, they investigate mul-tiple classifiers like bagging, AdaBoost, majority voting random subspace, random committee and rotation forest,

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 25: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 25 of 32 20

as well as, single classifiers like Cart, Bayesian Network, MLP, Random Tree, LibSVM and Naive Bayes. These clas-sifiers are investigated for the purpose of solving the clas-sification problem associated with retinal vessels. The meth-ods studied by the authors, are evaluated using 20 images that are acquired from the STARE dataset (Guo 2017). For their experiments, nine methods of feature extraction are employed, while 13 methods of classifications are used. The experimental results obtained by these authors show that there is significant improvement in performance of the clas-sifiers when the LBP features are used. In comparison with single classifiers, the performance of the multiple classi-fiers is better with the use of LBP features. These groups of researchers use the MS-R-LBP together with random com-mittee classifier, which in turn produces the best results with a classification rate of 90.7% and an AUC value of 0.97.

7 Summary findings on the automatic retinal vessel classification techniques

Due to the existing challenges associated with retinal ves-sels’ classification, it is difficult to achieve high accuracy of classification. In existing methods, arteries are distinguished from veins by means of four characteristics which include, color variation, central reflex, variation in thickness, and branching information of veins and arteries surrounding the optic disc. In a wide range of classification methods, the use of features, which provide the descriptions of color as well as color differences of the vessels, is employed. One of the main problems associated with classification is the varia-tion in the absolute color of blood vessels between images, and even in the same image. This difference is attributed to some factors like flash spectrum, saturation of hemoglobin oxygen, aging and cataract development, flash artifacts, cam-era nonlinear optical distortions, and focus (Niemeijer et al. 2011). In addition to the aforementioned factors, another factor that should be considered is the images’ resolution. Noise is introduced to images of high resolution; it reduces the color information. In studies in which a fundus camera has a variety of resolutions, it is important to normalize the resolution of images, because several methods of classifica-tion depend on color information. However, a vessel’s thick-ness cannot be relied upon for feature classification because it varies along the vessel, and it is significantly influenced by the vessel’s segmentation. Due to the high volumes of oxy-gen carried by the arteries, the internal parts of the arteries are brighter than the outer parts, meaning that, in arteries, the central reflex is more noticeable. This feature is high-lighted by some researchers as a very critical feature that is used to distinguish between the vessels. However, it is only in the thicker vessels that the central flex is noticeable.

With all these factors, the computational task of auto-matically classifying veins and arteries becomes very chal-lenging, which affects the system’s accuracy. In attempts to address this problem, some researchers employ the use of clustering rather than classification. Other researchers attempt to make the problems simpler by selecting just the main vessels surrounding the optic disc during the process of classification. However, this limits the analysis to just the main vessels, while avoiding the ambiguous information that emerges from smaller veins and arteries. For applica-tions like AVR calculation, the classification of the main vessels is adequate. Apart from AVR, there is a wide range of parameters that are used to evaluate the different available approaches. Classification error is one of the criteria that should be seriously considered due to its great relevance, because a method’s reliability is higher when the number of errors is less. The error rates are used to determine if manual labeling can be replaced with automatic methods. A quantitative comparison of the different proposed methods of the classification of vessel in fundus images cannot be justified due to the different datasets with varying resolu-tion, intensities and imaging conditions that are used for the evaluation of these methods based on a wide range of parameters including AUC, accuracy of classification, AVR and correlation coefficient. Based on the stated limitations, efforts are made in this study to assess the proposed methods based on a different point of view, which is the image model-ling approach. In a study by (Zahra Amini 2016), the differ-ent models that are employed in the processing of medical image are categorized in a detailed manner. Based on the literature review, there are two main categories of model-ling methods, which are transform and spatial domains. However, there are smaller categories in all of the models, including, stochastic, deterministic, partial differential equa-tion and geometric. In this study also, automatic methods of retinal vessels’ classification are categorized based on the related modelling category. These methods of automatic classification of retinal vessels are summarized in Table 2, which is based on, features, datasets, classifiers, methods of evaluation and results, and most especially, the model-ling approaches. The best results obtained by each of the approaches are presented.

In this paper, the proposed methods of classifying arteries and veins in fundus images are extensively reviewed. These approaches are categorized into automatic and semi-auto-matic categories. The semi-automatic approaches involve experts initiating the classification to distinguish between veins and arteries, after which, an automatic propagation occurs throughout the vascular network of the fundus image (Sarah Husham et al. 2020; O.I.O. et al. 2018; Elhoseny et al. 2021). For this reason, vessel-tracking algorithms are employed and in these algorithms, connectivity details and structural characteristics are critical. On the other hand,

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 26: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 26 of 32

Tabl

e 2

The

sum

mar

y fin

ding

s on

the

met

hods

of a

utom

atic

cla

ssifi

catio

n of

retin

al v

esse

ls w

hich

is b

ased

on,

feat

ures

, dat

aset

s, cl

assi

fiers

, met

hods

of e

valu

atio

n an

d re

sults

, and

mos

t esp

e-ci

ally

, the

mod

ellin

g ap

proa

ches

Aut

hor(

s)/y

ear

Feat

ures

ext

ract

ion

tech

niqu

esPe

rform

ance

eva

luat

ion

met

rics

Valid

atio

n da

tase

t use

dM

etho

d/te

chni

que

clas

sific

atio

n ca

tego

ry

Gris

an (2

003)

Mea

n H

—Va

rianc

e R

Acc

35 fu

ndus

imag

es h

ave

been

col

lect

edVe

ssel

trac

king

and

Fuz

zy c

luste

ring

Li e

t al.

(200

3)Th

e C

entra

l refl

ex in

GTP

505

fund

us im

ages

hav

e be

en c

olle

cted

Min

imum

Mah

alan

obis

dist

ance

Jelin

ek e

t al.

(200

5)std

of R

GB

, H a

nd M

ean

Acc

20 fu

ndus

imag

es h

ave

been

col

lect

edN

aive

-Bay

esRu

gger

i et a

l. (2

007)

Mea

n H

—Va

rianc

e R

Cor

rela

tion

and

AVR

14 fu

ndus

imag

es h

ave

been

col

lect

edVe

ssel

trac

king

and

Fuz

zy c

luste

ring

Nar

asim

ha-I

yer e

t al.

(200

7)Th

e ve

ssel

opt

ical

den

sitie

s rat

ioTP

25 fu

ndus

imag

es h

ave

been

col

lect

edSu

ppor

t vec

tor m

achi

neK

onde

rman

n (2

007)

RGB

Acc

4 fu

ndus

imag

es h

ave

been

col

lect

edN

N m

ultil

ayer

per

cept

ron

Tram

onta

n et

 al.

(200

8)R

con

trast

Cor

rela

tion

and

AVR

20 fu

ndus

imag

es h

ave

been

col

lect

edVe

ssel

trac

king

-bas

ed T

hres

hold

ing

Nie

mei

jer e

t al.

(201

1)St

eere

d G

auss

ian

deriv

ativ

es,

HSI

+ w

idth

, and

con

trast,

AU

C c

urve

DR

IVE

k-N

eare

st ne

ighb

ors

Kar

ssem

eije

r et a

l. (2

010)

RGB

Acc

DR

IVE

Line

ar d

iscr

imin

ant a

naly

sis

Mur

amat

su e

t al.

(201

0)G

con

trast,

RG

B +

R,

Acc

DR

IVE

Line

ar d

iscr

imin

ant a

naly

sis

Nie

mei

jer e

t al.

(201

1)RG

B, a

nd H

SIM

ean

AVR

and

AU

C

65 fu

ndus

imag

es h

as b

een

colle

cted

fro

m Io

wa

Uni

vers

ityLi

near

dis

crim

inan

t ana

lysi

s

Roth

aus (

2011

)Fi

ve m

odel

Fea

ture

s and

HIS

Cla

ssifi

catio

n er

ror

MA

RS

data

set

k-M

eans

clu

sterin

gZa

mpe

rini e

t al.

(201

2)Po

sitio

nal f

eatu

res a

nd 1

6 co

lors

Acc

42 fu

ndus

imag

es h

as b

een

colle

cted

fro

m N

inew

ells

Hos

pita

lLi

near

nor

mal

Bay

es

Vázq

uez

(201

2)M

edia

n G

Acc

ICAV

R-2

data

set

Vess

el tr

acki

ng b

ased

k-m

eans

clu

sterin

gM

irsha

rif e

t al.

(201

3)8

(R, G

, LA

B) c

olor

feat

ures

Acc

13 fu

ndus

imag

es h

as b

een

colle

cted

fro

m E

ye H

ospi

tal +

DR

IVE

Line

ar d

iscr

imin

ant a

naly

sis

Rela

n et

 al.

(201

3)Va

rianc

e of

R a

nd M

ean

of (R

, G, H

)A

cc35

fund

us im

ages

has

bee

n co

llect

edG

auss

ian

mix

ture

mod

el e

xpec

tatio

n m

axim

izat

ion

Rela

n et

 al.

(201

4)Va

rianc

e of

R a

nd M

ean

of (R

, G, H

)A

cc35

fund

us im

ages

has

bee

n co

llect

ed

from

ORC

AD

ESLe

ast s

quar

e su

ppor

t vec

tor m

achi

ne

Josh

i et a

l. (2

014)

G, H

var

ianc

e an

d M

ean

Acc

EYEC

HEC

K d

atas

etFu

zzy

C-m

eans

clu

sterin

gD

asht

bozo

rg e

t al.

(201

3)19

col

or fe

atur

esAV

R, A

ccV

ICAV

RD

RIV

EIN

SPIR

ELi

near

dis

crim

inan

t ana

lysi

s and

gra

ph

labe

ling

resu

ltsFr

az e

t al.

(201

4)H

SI c

olor

+ fe

atur

es R

GB

Acc

40 fu

ndus

imag

es h

as b

een

colle

cted

Dec

isio

n tre

esH

atam

i (16

05)

9 fe

atur

e (L

BP,

PCA

, RG

B, e

tc.)

AU

C a

nd A

ccST

AR

EM

ultip

le c

lass

ifier

syste

ms

Rela

n (2

016)

Four

col

or fe

atur

es a

re m

ean

of h

ue

(MH

),mea

n of

red

(MR

), va

rianc

e of

re

d (V

R),

and

mea

n of

gre

en (M

G)

Acc

DR

IVE,

INSP

IRE-

AVR

Squa

red-

loss

mut

ual i

nfor

mat

ion

clus

ter-

ing

(SM

IC)

Das

gupt

a (2

017)

Gab

or, a

t Rid

ge fe

atur

es v

ario

us sc

ales

an

d de

gree

sA

cc a

nd A

UC

D

RIV

EC

NN

Kho

waj

a et

 al.

(201

8)Si

x di

sting

uish

ing

feat

ure

extra

ctio

n te

chni

ques

: LB

P, lo

cal i

nten

sitie

s, H

OG

, hig

h-or

der l

ocal

aut

ocor

rela

-tio

ns, d

iver

genc

e of

vec

tor fi

eld,

and

m

orph

olog

ical

tran

sfor

mat

ion

Acc

CH

ASE

DB

1, S

TAR

E, a

nd D

RIV

EH

iera

rchi

cal c

lass

ifica

tion

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 27: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 27 of 32 20

the automatic approaches involve the automatic classifica-tion of vessels, without human intervention. The automatic approaches are mostly preferred because they are more suit-able for clinical use. An unbiased comparison of the per-formance of the different automatic approaches is impos-sible, due to a wide range of datasets and parameters that are used to evaluate the performance of these approaches (Subathra et al. 2020; Al-Dhief 2020). Thus, in this study, the methods are evaluated from a modelling point of view based on the categorization which (Zahra Amini 2016) pre-sented. It is observed from Table 2 that the geometric models are employed in a majority of the extant approaches for the step involving feature extraction, whereas, the determin-istic or stochastic strategies are used in the step involving classification.

8 Conclusion

In this study, an overview of the problem domain is deliber-ated in three parts. In the first part, the anatomy and physiol-ogy of the eye are discussed in relation to the Retinal Quan-tification Measures along with lesions and associated risks. Furthermore, a review of image modalities for a retina is made. In addition, a discussion on the Medical Images of Retinal Fundus is presented in this study. The second part of the study provides a detailed discussion on the techniques used for the segmentation of retinal vessels based on the current literature. In addition, the different techniques used in the methodologies proposed by different authors are dis-cussed, and a comparison of the results of the methods is made. Publicly available datasets are employed in the evalu-ation of these methodologies, which follow a similar proce-dure: the first step is the pre-processing step, which involves the extraction of the green or grey layer from an image of the raw color retina followed by the enhancement of the image’s contrast. The next step is the processing step, which is the nucleus of algorithms. Finally, in the post-processing step, the initial segmented image is deployed for edge preserving, smoothing and improvements. Based on the reviews made in this study, there are two main categories of modelling methods, which are transform and spatial domains. However, there are smaller categories in all of the models, including, stochastic, deterministic, partial differential equation and geometric. In the third part of this study, automatic meth-ods of retinal vessels classification are categorized based on the related modelling category. These methods of automatic classification of retinal vessels are summarized in Table 2, which is based on features, datasets, classifiers, methods of evaluation and results, and modelling approaches. The best results obtained by each of the approaches are presented.

Tabl

e 2

(con

tinue

d)

Aut

hor(

s)/y

ear

Feat

ures

ext

ract

ion

tech

niqu

esPe

rform

ance

eva

luat

ion

met

rics

Valid

atio

n da

tase

t use

dM

etho

d/te

chni

que

clas

sific

atio

n ca

tego

ry

Jeba

seel

i et a

l. (2

019)

Uni

form

dist

ribut

ion

of g

ray

valu

esA

cc, S

ens,

and

Spec

DR

IVE

Kirs

ch’s

tem

plat

e an

d Fu

zzy

C-M

eans

Hes

linga

et a

l. (2

020)

12 fe

atur

es p

er in

divi

dual

Acc

, and

AU

C

5222

fund

us im

ages

has

bee

n co

llect

edD

eep

neur

al n

etw

orks

Usm

an (2

020)

Tran

sfer

Lea

rnin

gA

cc26

80 fu

ndus

imag

es h

as b

een

colle

cted

Dee

p N

eura

l Net

wor

kW

.W. e

t al.

(202

0)En

hanc

emen

t bas

ed o

n th

e RG

B (r

ed,

gree

n, b

lue)

col

or sp

ace

Acc

HD

R im

ages

Low

-ligh

t im

age

enha

ncem

ent

Cao

et a

l. (2

020)

Rem

ovin

g su

ch lo

w fr

eque

ncy

in th

e ro

ot

dom

ain

Acc

200

retin

al fu

ndus

imag

esG

amm

a m

ap a

nd C

LAH

E

Nav

eed

et a

l. (2

021)

Intro

duci

ng a

noi

se re

mov

al m

etho

dol-

ogy

Acc

, Sen

s, an

d Sp

ecD

RIV

E, S

TAR

E A

ND

CH

ASE

Ense

mbl

e B

lock

Mat

chin

g 3D

Filt

er

(S-B

M3D

)Je

na e

t al.

(202

1)Re

duce

s the

gap

bet

wee

n su

perv

ised

and

un

supe

rvis

ed m

etho

dsA

UC

, Acc

DR

IVE,

STA

RE

Flow

-Bas

ed C

onsi

stenc

ies

Jiang

(202

0)Ex

tract

the

info

rmat

ion

of d

iffer

ent t

hick

-ne

sses

of b

lood

ves

sels

accu

racy

, sen

sitiv

ity,

spec

ifici

ty,F

-mea

sure

, and

A

UC

DR

IVE,

CH

ASE

, and

STA

RE

Mul

ti-Sc

ale

Resi

dual

Atte

ntio

n N

etw

ork

Lian

toni

(202

1)Th

e ap

plic

atio

n of

the

Ada

ptiv

e A

CO

met

hod

has s

ucce

ssfu

lly o

ptim

ized

the

resu

lt of

retin

al v

esse

l edg

e de

tect

ion

Acc

RGB

imag

eG

radi

ent b

ased

ant

spre

ad m

odifi

catio

n on

an

t col

ony

optim

izat

ion

met

hod,

Pea

k Si

gnal

-to-N

oise

Rat

io (P

SNR

)Re

lan

and

Rela

n (2

020)

Gre

at c

apab

ility

to e

nhan

ce c

ompu

ter

assi

sted

diag

nosi

s aA

ccIN

SPIR

E-AV

R, V

ICAV

R, a

nd M

ESSI

-D

OR

Con

siste

nt G

auss

ian

mix

ture

s

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 28: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 28 of 32

Funding This study was not funded.

Declarations

Conflict of interest There is no conflict of interests.

Ethical approval This article does not contain any studies with human participants or animals performed by any of the authors.

References

Abd Ghani MK et al (2018) Decision-level fusion scheme for naso-pharyngeal carcinoma identification using machine learning techniques. Neural Comput Appl 32(3):625–638

Abdallah MB, Malek J, Krissian K and Tourki R (2011) An auto-mated vessel segmentation of retinal images using multiscale vesselness. . In eighth international multi-conference on systems, signals and devices IEEE (1–6)

Abdulhay E et al (2018) Computer aided solution for automatic seg-menting and measurements of blood leucocytes using static microscope images. J Med Syst 42(4):58

Adel M, Rasigni M, Gaidon T, Fossati C and Bourennane S (2009) Statistical-based linear vessel structure detection in medical images. In 2009 16th IEEE international conference on image processing (ICIP) (649–652)

Akhavan RAFK (2014) A novel retinal blood vessel segmentation algo-rithm using fuzzy segmentation. Int J Elect Comp Eng 4(4):561

Akram MU, Tariq A and Khan SA (2009) Retinal image blood vessel segmentation. In 2009 international conference on information and communication technologies IEEE (181–192)

Al-Dhief FT, Latiff NMA, Malik NNNA, Sabri N, Baki MM, Albadr MAA, Abbas AF, Hussein YM, Mohammed MA (2020) Voice pathology detection using machine learning technique. In: 2020 IEEE 5th international symposium on telecommunication tech-nologies (ISTT). IEEE, pp 99–104

Al-Fahdawi S et al (2016) A fully automatic nerve segmentation and morphometric parameter quantification system for early diagno-sis of diabetic neuropathy in corneal images. Comput Methods Programs Biomed 135:151–166

Al-Fahdawi S et al (2018) A fully automated cell segmentation and morphometric parameter system for quantifying corneal endothe-lial cell morphology. Comput Methods Programs Biomed 160:11–23

Al-Rawi M, Qutaishat M, Arrar M (2007) An improved matched filter for blood vessel detection of digital retinal images. Comput Biol Med 37(2):262–267

Aparna CLSP, Rajan J (2017) Recent advancements in retinal vessel segmentation. J Med Syst 41(4):70

Arunkumar N et al (2018) K-Means clustering and neural network for object detecting and identifying abnormality of brain tumor. Soft Comput 23(19):9083–9096

Arunkumar N et al (2018) Fully automatic model-based segmentation and classification approach for MRI brain tumor using artificial neural networks. Concurr Comput Pract Exp 32:1

Azuaje F, Witten IH, Frank E (2006) Data mining: practical machine learning tools and techniques 2nd edition. BioMed Eng OnLine 5:51. https:// doi. org/ 10. 1186/ 1475- 925X-5- 51

Babaud J, Witkin AP, Baudin M, Duda RO (1986) Uniqueness of the Gaussian kernel for scale-space filtering. IEEE Trans Pattern Anal Mach Intell 1:26–33

Bankhead P et al (2012) Fast retinal vessel detection and measure-ment using wavelets and edge location refinement. PLoS ONE 7(3):e32435

Binh NT, Tuyet VTH, Hien NM, Thuy NT (2019) Retinal vessels segmentation by improving salient region combined with Sobel operator condition. In: International conference on future data and security engineering. Springer, Cham, pp 608–617

Brancati N, Frucci M, Gragnaniello D, Riccio D (2018) Retinal ves-sels segmentation based on a convolutional neural network. In: Iberoamerican congress on pattern recognition. Springer, Cham, pp 119–126

Budai A, Michelson G and Hornegger J (2010) Multiscale blood ves-sel segmentation in retinal fundus images. In Bildverarbeitung für die Medizin 2010 - Algorithmen, Systeme, Anwendungen, pp 261–265

Cao L, Li H, Zhang Y (2020) Retinal image enhancement using low-pass filtering and α-rooting. Signal Processing 170:107445

Chanwimaluang TAF (2003) G, <an-efficient-algorithm-for-extrac-tion-of-anatomical-structures-i.pdf>. IEEE. (In proceedings 2003 international conference on image processing): (Cat. No. 03CH37429. (1, I-1093)

Chapman N, Dell’Omo G, Sartini MS, Witt N, Hughes A, Thom S, Pedrinelli R (2002) Peripheral vascular disease is associated with abnormal arteriolar diameter relationships at bifurcations in the human retina. Clin Sci 103(2):111–116

Chaudhuri S, Chatterjee S, Katz N, Nelson M, Goldbaum M (1989) Detection of blood vessels in retinal images using two-dimen-sional matched filters. IEEE Trans Med Imaging 8(3):263–269

Christodoulidis A et al (2016) A multi-scale tensor voting approach for small retinal vessel segmentation in high resolution fundus images. Comput Med Imaging Graph 52:28–43

Chutatape O, Zheng L and Krishnan SM (1998) Retinal blood vessel detection and tracking by matched Gaussian and Kalman filters. . In proceedings of the 20th annual international conference of the IEEE engineering in medicine and biology society, biomedi-cal engineering towards the year 2000 and Beyond (Cat. No. 98CH36286) (6 3144–3149)

Couper DJ, Klein R, Hubbard LD, Wong TY, Sorlie PD, Cooper LS, Brothers RJ, Nieto FJ (2002) Reliability of retinal photography in the assessment of retinal microvascular characteristics: the atherosclerosis risk in communities study. Am J Ophthalmol 133(1):78–88

da Rocha DA et al (2020) An unsupervised approach to improve con-trast and segmentation of blood vessels in retinal images using CLAHE, 2D Gabor wavelet, and morphological operations. Res Biomed Eng 36(1):67–75

Dan Y et al (2021) Retinal blood vessel segmentation method based on multi scale convolution kernel U net model. J Northeast Univ (Nat Sci) 42:1

Dasgupta AASS (2017) A fully convolutional neural network based structured prediction approach towards the retinal vessel segmen-tation. In 2017 IEEE 14th international symposium on biomedi-cal imaging (ISBI 2017), (248–251)

Dashtbozorg B, Mendonça AM, Campilho A (2013) An automatic graph-based approach for artery/vein classification in retinal images. IEEE Trans Image Process 23(3):1073–1083

De J, Cheng L, Zhang X, Lin F, Li H, Ong KH, Yu W, Yu Y, Ahmed S (2015) A graph-theoretical approach for tracing filamentary structures in neuronal and retinal images. IEEE Trans Med Imag-ing 35(1):257–272

Decencière E et al (2014) Feedback on a publicly distributed image database: the messidor database. Image Anal Stereol 33(3):231

De Silva A, Perera MV, Wijethilake N, Jayasinghe S, Nanayakkara ND, De Silva A (2021) A thickness sensitive vessel extraction frame-work for retinal and conjunctival vascular tortuosity analysis. arXiv preprint arXiv: 2101. 00435

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 29: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 29 of 32 20

Dharmawan DA et al (2019) A new hybrid algorithm for retinal vessels segmentation on fundus images. IEEE Access 7:41885–41896

Diabetes Control and Complications Trial Research Group (1987) Color photography vs. fluorescein angiography in the detection of diabetic retinopathy in the Diabetes Control and Complica-tions Trial. Arch Ophthalmol 105:1344–1351

Dizdaro B, Ataer-Cansizoglu E, Kalpathy-Cramer J, Keck K, Chiang MF and Erdogmus D (2012) Level sets for retinal vasculature segmentation using seeds from ridges and edges from phase maps. In 2012 IEEE international workshop on machine learn-ing for signal processing. IEEE (1–6)

Efron B (1983) Estimating the error rate of a prediction rule: improve-ment on cross-validation. J Am Stat Assoc 78(382):316–331

Elhoseny M, Mohammed MA, Mostafa SA, Abdulkareem KH, Maashi MS et al (2021) A new multi-agent feature wrapper machine learning approach for heart disease diagnosis. Comput Mater Contin 67(1):51–71

Emary E, Zawbaa HM, Hassanien AE, Schaefer G and Azar AT (2014) Retinal vessel segmentation based on possibilistic fuzzy c-means clustering optimised with cuckoo search. In 2014 international joint conference on neural networks (IJCNN) IEEE (1792–1796)

Estrada R, Tomasi C, Schmidler SC, Farsiu S (2014) Tree topology esti-mation. IEEE Trans Pattern Anal Mach Intell 37(8):1688–1701

Estrada R et al (2015) Retinal Artery-Vein Classification via Topology Estimation. IEEE Trans Med Imaging 34(12):2518–2534

Foracchia M, Grisan E, Ruggeri A (2005) Luminosity and contrast normalization in retinal images. Med Image Anal 9(3):179–190

Forouhi NG et al (2012) Circulating 25-hydroxyvitamin D concentra-tion and the risk of type 2 diabetes: results from the European Prospective Investigation into Cancer (EPIC)-Norfolk cohort and updated meta-analysis of prospective studies. Diabetologia 55(8):2173–2182

Francia GA, Pedraza C, Aceves M, Tovar-Arriaga S (2020) Chaining a U-net with a residual U-net for retinal blood vessels segmenta-tion. IEEE Access 8:38493–38500

Frangi AF, Niessen WJ, Vincken KL, Viergever MA (1998) Multi-scale vessel enhancement filtering. In International conference on medical image computing and computer-assisted intervention. Springer 1998:130–137

Fraz MM et al (2012) Blood vessel segmentation methodologies in retinal images–a survey. Comput Methods Programs Biomed 108(1):407–433

Fraz MM, Remagnino P, Hoppe A, Uyyanonvara B, Rudnicka AR, Owen CG, Barman SA (2012) An ensemble classification-based approach applied to retinal blood vessel segmentation. IEEE Trans Biomed Eng 59(9):2538–2548

Fraz MM, Rudnicka AR, Owen CG, Strachan DP and Barman SA (2014) Automated arteriole and venule recognition in retinal images using ensemble classification. International conference on computer vision theory and applications (VISAPP). IEEE (3: 194–202): 194–202

Frucci M, Riccio D, Di Baja GS, Serino L (2014) Using contrast and directional information for retinal vessels segmentation. In: 2014 tenth international conference on signal-image technology and internet-based systems. IEEE, pp 592–597

Fu H, Xu,Y, Lin S, Wong DWK, Liu J (2016) Retinal vessel segmenta-tion via deep learning network and fully-connected conditional random fields. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 132–139

Gao X, Cai Y, Qiu C and Cui Y (2017) Retinal blood vessel segmenta-tion based on the Gaussian matched filter and U-net. In 2017 10th international congress on image and signal processing, Biomedi-cal engineering and informatics (CISP-BMEI) IEEE (1–5)

Gongt H, Li Y, Liu G, Wu W and Chen G (2015) A level set method for retina image vessel segmentation based on the local cluster

value via bias correction. In 2015 8th international congress on image and signal processing (CISP) IEEE (413–417)

Grisan EARA (2003) A divide et impera strategy for automatic classifi-cation of retinal vessels into arteries and veins. In Proceedings of the 25th annual international conference of the IEEE engineering in medicine and biology society (IEEE Cat. No. 03CH37439). (1: 890–893). IEEE

Gu L (2015) and L. Learning to boost filamentary structure segmenta-tion, Cheng, pp 639–647

Guo Y et al (2017) A retinal vessel detection approach based on shear-let transform and Indeterminacy Filtering on Fundus Images. Symmetry 9(10):235

Guo Y et al (2018) A retinal vessel detection approach using convolu-tion neural network with reinforcement sample learning strategy. Measurement 125:586–591

Hajabdollahi M, Esfandiarpoor R, Najarian K, Karimi N, Samavi S and Reza-Soroushmeh SM (2018) Low complexity convolutional neural network for vessel segmentation in portable retinal diag-nostic devices. In 2018 25th IEEE international conference on image processing (ICIP). (2785–2789)

Hall MA (1999) Correlation-based feature selection for machine learn-ing, Doctor of Philosophy at The University of Waikato, Ham-ilton, New Zealand

Hamad H et al (2020) Exudates as Landmarks Identified through FCM Clustering in Retinal Images. Appl Sci 11(1):142

Hatami NAGM (2016) Automatic identification of retinal arteries and veins in fundus images using local binary patterns. arXiv preprint arXiv: 1605.00763

Hatamizadeh A, Hosseini H, Liu Z, Schwartz SD and Terzopoulos D (2019) Deep dilated convolutional nets for the automatic seg-mentation of retinal vessels. . arXiv preprint arXiv:, 1905.12120

Heslinga Pluim FG, Houben JPAJHM, Schram MT, Henry RM, Ste-houwer CD, Van Greevenbroek MJ, Veta BTTM (2020) Direct classification of type 2 diabetes from retinal fundus images in a population-based sample from The Maastricht Study In Medical Imaging 2020: computer-Aided Diagnosis. Int Soc Opt Photon 11314:113141N

Hoover AD, Kouznetsova V, Goldbaum M (2000) Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans Med Imaging 19(3):203–210

Hu K et al (2018) Retinal vessel segmentation of color fundus images using multiscale convolutional neural network with an improved cross-entropy loss function. Neurocomputing 309:179–191

Huang J-H, Huck Yang C-H, Liu F, Tian M, Liu Y-C, Wu T-W, Lin I (2021) DeepOpht: medical report generation for retinal images via deep models and visual explanation. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 2442–2452

Isavand Rahmani A, Akbari H, Esmaili S (2020) Retinal blood vessel segmentation using gabor filter and morphological reconstruc-tion. Sign Process Renew Energy 4(1):77–88

Jebaseeli TJ, Durai CAD, Peter JD (2019) Extraction of retinal blood vessels on fundus images by kirsch’s template and Fuzzy C-Means. J Med Phys 44(1):21

Jelinek HF, Depardieu C, Lucas C, Cornforth DJ, Huang W, Cree MJ (2005) Towards vessel characterization in the vicinity of the optic disc in digital retinal images. Image Vis Comput Conf 2:7

Jena R, Singla S, Batmanghelich K (2021) Self-supervised vessel enhancement using flow-based consistencies. arXiv preprint arXiv: 2101. 05145.

Jiang XAMD (2003) Adaptive local thresholding by verification-based multithreshold probing with application to vessel detec-tion in retinal images. IEEE Transactions Patt Anal Mach Intell 25(1):131–137

Jiang Z et al (2017) Fast, accurate and robust retinal vessel segmenta-tion system. Biocybern Biomed Eng 37(3):412–421

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 30: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 30 of 32

Jiang Y, Tan N, Peng T, Zhang H (2019) Retinal vessels segmentation based on dilated multi-scale convolutional neural network. IEEE Access 7:76342–76352

Jiang Y et al (2020) A multi-scale residual attention network for retinal vessel segmentation. Symmetry 13(1):24

Jin Q et al (2019) DUNet: a deformable network for retinal vessel segmentation. Knowl-Based Syst 178:149–162

Joshi VS, Reinhardt JM, Garvin MK, Abramoff MD (2014) Automated method for identification and artery-venous classification of ves-sel trees in retinal vessel networks. PLoS ONE 9:2

Kamran SA, Hossain KF, Tavakkoli A (2021) RV-GAN: retinal vessel segmentation from fundus images using multi-scale generative adversarial networks. arXiv: 2101.00535v1

Karssemeijer N et al (2010) Automated detection and classification of major retinal vessels for determination of diameter ratio of arteries and veins 7624:76240J

Kauppi T, Kalesnykiene V, Kamarainen J-K, Lensu L, Sorri I, Raninen A, Voutilainen R, Uusitalo H, Kälviäinen H, Pietilä J (2007) The diaretdb1 diabetic retinopathy database and evaluation protocol. In: BMVC, vol 1, pp 1–10

Khaing TT et al (2021) Glaucoma detection in mobile phone retinalim-ages based on adi-gvf segmentation withem initialization. ECTI Transactions on Computer Inform Technol 15:1

Khowaja SA, Khuwaja P, Ismaili IA (2018) A framework for retinal vessel segmentation from fundus images using hybrid feature set and hierarchical classification. SIViP 13(2):379–387

Kingsbury N (1998) The dual-tree complex wavelet transform: a new efficient tool for image restoration and enhancement. In 9th Euro-pean signal processing conference (EUSIPCO 1998) (1–4). IEEE

Kirbas CAQF (2004) A review of vessel extraction techniques and algorithms. ACM Comput Surv (CSUR) 36(2):81–121

Kondermann C, Kondermann D, Yan M (2007) Blood vessel clas-sification into arteries and veins in retinal images. In: Medical imaging 2007: image processing, vol 6512. International Society for Optics and Photonics, p 651247

Krinidis SACV (2010) A robust fuzzy local information C-means clustering algorithm. IEEE Transactions Image Process 19(5):1328–1337

Kumar D, Pramanik A, Kar SS and Maity SP (2016) Retinal blood vessel segmentation using matched filter and laplacian of gauss-ian. In 2016 international conference on signal processing and communications (SPCOM) IEEE June. (1–5)

Kundu AACRK (2012) Retinal vessel segmentation using morpho-logical angular scale-space. In 2012 third international confer-ence on emerging applications of information technology. IEEE (316–319)

Lahiri A, Roy AG, Sheet D and Biswas PK (2016) Deep neural ensem-ble for retinal vessel segmentation in fundus images towards achieving label-free angiography. In 2016 38th annual interna-tional conference of the IEEE engineering in medicine and biol-ogy society (EMBC) (1340–1343)

Lenskiy AA, Lee J (2010) Rugged terrain segmentation based on salient features. ICCAS 2010, Gyeonggi-do, Korea (South), pp 1737–1740. https:// doi. org/ 10. 1109/ ICCAS. 2010. 56697 87

Lesage D et al (2009) A review of 3D vessel lumen segmentation tech-niques: models, features and extraction schemes. Med Image Anal 13(6):819–845

Li H, Hsu W, Lee ML and Wang H (2003) A piecewise Gaussian model for profiling and differentiating retinal vessels. In Proceedings 2003 international conference on image processing (Cat. No. 03CH37429). IEEE (1: I-1069)

Li H, Hsu W, Lee ML, Wong TY (2005) Automatic grading of retinal vessel caliber. IEEE Trans Biomed Eng 52(7):1352–1355

Li H, Zhang J, Nie Q and Cheng L (2013) A retinal vessel tracking method based on bayesian theory. In 2013 IEEE 8th conference on industrial electronics and applications (ICIEA) (232–235)

Liantoni F et al (2021) Gradient based ant spread modification on ant colony optimization method for retinal blood vessel edge detec-tion. IOP Conf Ser Mater Sci Eng 1010:012021

Lindeberg T (2011) Scale-space theory: a basic tool for analyzing structures at different scales. J Appl Stat 21(1–2):225–270

Liskowski PAKK (2016) Segmenting retinal blood vessels with deep neural networks. IEEE Transactions Med Imaging 35(11):2369–2380 (9901)

Lv Y, Ma H, Li J, Liu S (2020) Attention guided U-net with atrous con-volution for accurate retinal vessels segmentation. IEEE Access 8:32826–32839

Ma ZALH (2015) Retinal vessel profiling based on four piecewise Gaussian model. IEEE international conference on digital signal processing DSP 1094–1097

Maji D, Santara A, Ghosh S, Sheet D and Mitra P (2015) Deep neu-ral network and random forest hybrid architecture for learning to detect retinal vessels in fundus images. In 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC) (3029–3032)

Maji D, Santara A, Mitra P and Sheet D (2016) Ensemble of deep convolutional neural networks for learning to detect retinal ves-sels in fundus images. arXiv preprint arXiv:, 2016. 1603.04833

Martinez-Perez ME, Highes AD, Stanton AV, Thorn SA, Chapman N, Bharath AA, Parker KH (2002) Retinal vascular tree morphol-ogy: a semi-automatic quantification. IEEE Trans Biomed Eng 49(8):912–917

McInerney T, Terzopoulos D (1996) Deformable models in medical image analysis: a survey. Med Image Anal 1(2):91–108

Mirsharif Q, Tajeripour F, Pourreza H (2013) Automated characteri-zation of blood vessels as arteries and veins in retinal images. Comput Med Imaging Graph 37(7–8):607–617

Moghimirad E, Rezatofighi SH and Soltanian-Zadeh H (2010) Multi-scale approach for retinal vessel segmentation using medialness function. In 2010 IEEE international symposium on biomedical imaging: from nano to macro (29–32)

Mohammed MA et al (2017a) Analysis of an electronic methods for nasopharyngeal carcinoma: prevalence, diagnosis, challenges and technologies. J Comput Sci 21:241–254

Mohammed MA et al (2017b) Artificial neural networks for automatic segmentation and identification of nasopharyngeal carcinoma. J Comput Sci 21:263–274

Mohammed MA et al (2018) A real time computer aided object detec-tion of nasopharyngeal carcinoma using genetic algorithm and artificial neural network based on Haar feature fear. Futur Gener Comput Syst 89:539–547

Mostafa SA et al (2019) Examining multiple feature evaluation and classification methods for improving the diagnosis of Parkinson’s disease. Cogn Syst Res 54:90–99

Mou L et al (2021) CS(2)-Net: deep learning segmentation of curvilin-ear structures in medical imaging. Med Image Anal 67:101874

Muramatsu C, Hatanaka Y, Iwase T, Hara T, Fujita H (2010) Auto-mated detection and classification of major retinal vessels for determination of diameter ratio of arteries and veins. In: Medical imaging 2010: computer-aided diagnosis, vol 7624. International Society for Optics and Photonics, p 76240J

Narasimha-Iyer H, Beach JM, Khoobehi B, Roysam B (2007) Auto-matic identification of retinal arteries and veins from dual-wave-length images using structural and functional features. IEEE Trans Biomed Eng 54(8):1427–1435

Naveed K et al (2021) Towards automated eye diagnosis: an improved retinal vessel segmentation framework using ensemble block matching 3D filter. Diagnostics (Basel) 11:1

Nayak J et al (2008) Automated identification of diabetic retinopathy stages using digital fundus images. J Med Syst 32(2):107–115

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 31: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

Page 31 of 32 20

Nekovei RASY (1995) Back-propagation network and its configura-tion for blood vessel detection in angiograms. IEEE Transactions Neural Netw 6(1):64–72

Niemeijer M, Xu X, Dumitrescu AV, Gupta P, Van Ginneken B, Folk JC, Abramoff MD (2011) Automated measurement of the arte-riolar-to-venular width ratio in digital color fundus photographs. IEEE Trans Med Imaging 30(11):1941–1950

Obaid OI, Mohammed MA, Ghani MKA, Mostafa A, Taha F (2018) Evaluating the performance of machine learning techniques in the classification of Wisconsin breast cancer. Int J Eng Technol 7(4.36):160–166

Odstrcilik J et al (2013) Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database. IET Image Proc 7(4):373–383

Patton N et al (2006) Retinal image analysis: concepts, applications and potential. Am J Ophthalmol 141(3):603

Poplin R et al (2018) Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat Biomed Eng 2(3):158–164

Qureshi TA, Habib M, Hunter A and Al-Diri B (2013) A manually-labeled, artery/vein classified benchmark for the DRIVE dataset. In proceedings of the 26th IEEE international symposium on computer-based medical systems (485–488)

Rattathanapad S, Mittrapiyanuruk P, Kaewtrakulpong P, Uyyanon-vara B and Sinthanayothin C (2012) Vessel extraction in retinal images using multilevel line detection. . In proceedings of 2012 IEEE-EMBS international conference on biomedical and health informatics (345–349)

Relan D, Ballerini L, Trucco E, MacGillivray T (2016) Retinal ves-sel classification based on maximization of squared-loss mutual information. In: Machine intelligence and signal processing. Springer, New Delhi, pp 77–84

Relan D, Relan R (2020) Unsupervised sorting of retinal vessels using locally consistent Gaussian mixtures. Comput Methods Programs Biomed 199:105894

Relan D, MacGillivray T, Ballerini L and Trucco E (2013) Retinal ves-sel classification: sorting arteries and veins. In 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC) (7396–7399)

Relan D, MacGillivray T, Ballerini L and Trucco E (2014) Automatic retinal vessel classification using a least square-support vector machine in VAMPIRE. In 2014 36th annual international confer-ence of the IEEE engineering in medicine and biology society (142–145)

Rothaus K, Jiang X (2011) Classification of arteries and veins in retinal images using vessel profile features. In: AIP conference proceed-ings, vol 1371, no 1. American Institute of Physics, pp 9–18

Rothaus K, Rhiem P and Jiang X (2007) Separation of the retinal vas-cular graph in arteries and veins. In International Workshop on Graph-Based Representations in Pattern Recognition. Springer, Berlin, Heidelberg 251–262

Rothaus K, Jiang X, Rhiem P (2009) Separation of the retinal vascular graph in arteries and veins based upon structural knowledge. Image Vis Comput 27(7):864–875

Roy AGASD (2015) Dasa: domain adaptation in stacked autoencoders using systematic dropout. In 2015 3rd IAPR Asian conference on pattern recognition (ACPR). IEEE (735–739)

Ruggeri A, Grisan E and De Luca M (2007) An automatic system for the estimation of generalized arteriolar narrowing in retinal images. In 2007 29th annual international conference of the IEEE engineering in medicine and biology society (6463–6466). IEEE

Saha Tchinda B et al (2021) Retinal blood vessels segmentation using classical edge detection filters and the neural network. Inform Med Unlock 23:100521

Salem SAS, NMAK Nandi (2006) Segmentation of retinal blood ves-sels using a novel clustering algorithm. In proceedings of the

2006 14th European signal processing conference, Florence, Italy, 1–5

Sarah Husham AM, Mostafa SA, Al-Obaidi MK, Mohammed MA (2020) comparative analysis between active contour and otsuthresholding segmentation algorithms in segmenting brain-tumor magnetic resonance imaging. J Inform Technol Manag. https:// doi. org/ 10. 22059/ jitm. 2020. 78889

Saroj SK, Kumar R, Singh NP (2020) Frechet PDF based matched filter approach for retinal blood vessels segmentation. Comput Methods Programs Biomed 194:105490

Sharma SAWEV (2015) Retinal blood vessel segmentation using fuzzy logic. J Netw Commun Emerg Technol 4:3

Singh NP, Srivastava R (2016) Retinal blood vessels segmentation by using Gumbel probability distribution function based matched filter. Comput Methods Programs Biomed 129:40–50

Singh NP, Kumar R and Srivastava R (2015) Local entropy threshold-ing based fast retinal vessels segmentation by modifying matched filter. In international conference on computing, communication and automation IEEE (1166–1170)

Sofka MASCV (2006) Retinal vessel centerline extraction using mul-tiscale matched filters, confidence and edge measures. IEEE Transactions Med Imaging 25(12):1531–1546

Soomro TA et al (2018) Impact of ICA-based image enhancement technique on retinal blood vessels segmentation. IEEE Access 6:3524–3538

Soomro TA et al (2019) Strided fully convolutional neural network for boosting the sensitivity of retinal blood vessels segmentation. Expert Syst Appl 134:36–52

Staal J, Abràmoff MD, Niemeijer M, Viergever MA, Van Ginneken B (2004) Ridge-based vessel segmentation in color images of the retina. IEEE Trans Med Imaging 23(4):501–509

Subathra MSP, Mohammed MA, Maashi MS, Garcia-Zapirain B, Sairamya NJ, George ST (2020) Detection of focal and non-focal electroencephalogram signals using fast Walsh-Hadamard trans-form and artificial neural network. Sensors 20(17):4952

Tankyevych O, Talbot H, Dokladal P (2008) Curvilinear morpho-Hessian filter. IEEE Int Symp Biomed Imaging 2008:1011–1014

Tianyu Ma HZ (2021) Hanley Ong. Ensembling Low Precision Models for Binary Biomedical Image Segmentation, IEEE Access

Tramontan L, Grisan E and Ruggeri A (2008) An improved system for the automatic estimation of the Arteriolar-to-Venular diameter Ratio (AVR) in retinal images. In 2008 30th annual international conference of the IEEE engineering in medicine and biology society (3550–3553). IEEE

Usman A, Muhammad A, Martinez-Enriquez AM, Muhammad A (2020) Classification of diabetic retinopathy and retinal vein occlusion in human eye fundus images by transfer learning. In: Future of information and communication conference. Springer, Cham, pp 642–653

Vázquez SG et al (2012) Improving retinal artery and vein classifi-cation by means of a minimal path approach. Mach Vis Appl 24(5):919–930

Villalobos-Castaldi FM, Felipe-Riverón EM, Sánchez-Fernández LP (2010) A fast, efficient and automated method to extract vessels from fundus images. J Visual 13(3):263–270

Walter T, Klein JC, Massin P, Erginay A (2002) A contribution of image processing to the diagnosis of diabetic retinopathy-detec-tion of exudates in color fundus images of the human retina. IEEE Trans Med Imaging 21(10):1236–1243

Weiss K, Khoshgoftaar TM, Wang D (2016) A survey of transfer learn-ing. J Big Data 3:1

Wu Y, Xia Y, Song Y, Zhang Y, Cai W (2018) Multiscale network fol-lowed network model for retinal vessel segmentation. In: Inter-national conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 119–126

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 32: Comprehensive review of retinal blood vessel segmentation ...

Network Modeling Analysis in Health Informatics and Bioinformatics (2021) 10:20

1 3

20 Page 32 of 32

Wu CH, Agam G and Stanchev P (2007) A general framework for ves-sel segmentation in retinal images. In 2007 international sympo-sium on computational intelligence in robotics and automation. IEEE (37–42)

Wu Y et al (2020) NFN: a novel network followed network for retinal vessel segmentation. Neural Netw 126:153–162

Wang W, Wu X, Yuan X, Gao Z (2020) An experiment-based review of low-light image enhancement methods. IEEE Access 8:87884–87917

Xie S (2013) and H. Retinal Vascular Image Segmentation Using Genetic Algorithm Plus FCM Clustering, Nie, pp 1225–1228

Xiuqin P, Zhang Q, Zhang H, Li S (2019) A fundus retinal vessels segmentation scheme based on the improved deep learning U-Net model. IEEE Access 7:122634–122643

Yang Y, Huang S, Rao N (2008) An automatic hybrid method for retinal blood vessel extraction. Int J Appl Math Comput Sci 18(3):399–407

Yedidya T (2008) and R. Tracking of Blood Vessels in Retinal Images Using Kalman Filter, Hartley, pp 52–58

Yin Y, Adel M, Guillaume M and Bourennane S (2010) A probabilis-tic based method for tracking vessels in retinal images. In 2010 IEEE international conference on image processing (4081–4084)

Zahra Amini HR (2016) Classification of medical image modeling methods: a review. IEEE 12(2):130–148

Zamperini A, Giachetti A, Trucco E and Chin KS (2012) Effective features for artery-vein classification in digital fundus images. In 2012 25th IEEE international symposium on computer-based medical systems (CBMS) (1–6)

Zhang Y, CACS (2018) Deep supervision with additional labels for retinal vessel segmentation task. In: Frangi A, Schnabel J, Davatzikos C, Alberola-López C, Fichtinger G (eds) Medical image computing and computer assisted intervention: MIC-CAI 2018. MICCAI 2018. Lecture Notes in computer science Springer, Cham vol 11071.

Zhang Z, Yin FS, Liu J, Wong WK, Tan NM, Lee BH, Cheng J and Wong TY (2010) Origa-light: an online retinal fundus image database for glaucoma analysis and research. In 2010 annual

international conference of the IEEE engineering in medicine and biology (3065–3068). IEEE

Zhang B et  al (2010) Retinal vessel extraction by matched filter with first-order derivative of Gaussian. Comput Biol Med 40(4):438–445

Zhang J, Tang Z, Gui W and Liu J (2015) Retinal vessel image seg-mentation based on correlational open active contours model. . In 2015 Chinese automation congress (CAC). IEEE (993–998)

Zhao Y et al (2015) Automated vessel segmentation using infinite perimeter active contour model with hybrid region information with application to retinal images. IEEE Trans Med Imaging 34(9):1797–1807

Zhou C, Zhang X, Chen H (2020) A new robust method for blood ves-sel segmentation in retinal fundus images based on weighted line detector and hidden Markov model. Comput Methods Programs Biomed 187:105231

Zhu T (2010) Fourier cross-sectional profile for vessel detection on retinal images. Comput Med Imaging Graph 34(3):203–212

Zhu TASG (2011) Retinal vessel extraction using a piecewise Gauss-ian scaled model. In 2011 annual international conference of the IEEE engineering in medicine and biology society, 2011, August. (pp. 5008–5011)

Zhu C et al (2017) Retinal vessel segmentation in colour fundus images using extreme learning machine. Comput Med Imaging Graph 55:68–77

Zolfagharnasab HANNAR (2014) Cauchy based matched filter for retinal vessels detection. J Med Sign Sens 4(1):1

Zou B et al (2020) Multi-label classification scheme based on local regression for retinal vessel segmentation. In: IEEE/ACM trans-actions on computational biology and bioinformatics. https:// doi. org/ 10. 1109/ TCBB. 2020. 29802 33

Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Content courtesy of Springer Nature, terms of use apply. Rights reserved.

Page 33: Comprehensive review of retinal blood vessel segmentation ...

1.

2.

3.

4.

5.

6.

Terms and Conditions Springer Nature journal content, brought to you courtesy of Springer Nature Customer Service Center GmbH (“Springer Nature”). Springer Nature supports a reasonable amount of sharing of research papers by authors, subscribers and authorised users (“Users”), for small-scale personal, non-commercial use provided that all copyright, trade and service marks and other proprietary notices are maintained. Byaccessing, sharing, receiving or otherwise using the Springer Nature journal content you agree to these terms of use (“Terms”). For thesepurposes, Springer Nature considers academic use (by researchers and students) to be non-commercial. These Terms are supplementary and will apply in addition to any applicable website terms and conditions, a relevant site licence or a personalsubscription. These Terms will prevail over any conflict or ambiguity with regards to the relevant terms, a site licence or a personal subscription(to the extent of the conflict or ambiguity only). For Creative Commons-licensed articles, the terms of the Creative Commons license used willapply. We collect and use personal data to provide access to the Springer Nature journal content. We may also use these personal data internally withinResearchGate and Springer Nature and as agreed share it, in an anonymised way, for purposes of tracking, analysis and reporting. We will nototherwise disclose your personal data outside the ResearchGate or the Springer Nature group of companies unless we have your permission asdetailed in the Privacy Policy. While Users may use the Springer Nature journal content for small scale, personal non-commercial use, it is important to note that Users maynot:

use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access

control;

use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is

otherwise unlawful;

falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in

writing;

use bots or other automated methods to access the content or redirect messages

override any security feature or exclusionary protocol; or

share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal

content. In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journalcontent cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or anyother, institutional repository. These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information orcontent on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Naturemay revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved. To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or impliedwith respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,including merchantability or fitness for any particular purpose. Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensedfrom third parties. If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner notexpressly permitted by these Terms, please contact Springer Nature at

[email protected]