<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "http://jats.nlm.nih.gov/publishing/1.1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="1.1">
<front>
<journal-meta>
<journal-id journal-id-type="pmc">CSSE</journal-id>
<journal-id journal-id-type="nlm-ta">CSSE</journal-id>
<journal-id journal-id-type="publisher-id">CSSE</journal-id>
<journal-title-group>
<journal-title>Computer Systems Science &#x0026; Engineering</journal-title>
</journal-title-group>
<issn pub-type="ppub">0267-6192</issn>
<publisher>
<publisher-name>Tech Science Press</publisher-name>
<publisher-loc>USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">26119</article-id>
<article-id pub-id-type="doi">10.32604/csse.2023.026119</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Detection and Classification of Hemorrhages in Retinal Images</article-title><alt-title alt-title-type="left-running-head">Detection and Classification of Hemorrhages in Retinal Images</alt-title><alt-title alt-title-type="right-running-head">Detection and Classification of Hemorrhages in Retinal Images</alt-title>
</title-group>
<contrib-group content-type="authors">
<contrib id="author-1" contrib-type="author">
<name name-style="western"><surname>Ali</surname><given-names>Ghassan Ahmed</given-names></name>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
<contrib id="author-2" contrib-type="author" corresp="yes">
<name name-style="western"><surname>Ahmad Al Sariera</surname><given-names>Thamer Mitib</given-names></name>
<xref ref-type="aff" rid="aff-2">2</xref><email>th_670@yahoo.com</email>
</contrib>
<contrib id="author-3" contrib-type="author">
<name name-style="western"><surname>Akram</surname><given-names>Muhammad</given-names></name>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
<contrib id="author-4" contrib-type="author">
<name name-style="western"><surname>Sulaiman</surname><given-names>Adel</given-names></name>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
<contrib id="author-5" contrib-type="author">
<name name-style="western"><surname>Olayah</surname><given-names>Fekry</given-names></name>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
<aff id="aff-1"><label>1</label><institution>College of Computer Science and Information Systems, Najran University</institution>, <addr-line>Najran, 61441</addr-line>, <country>Saudi Arabia</country></aff>
<aff id="aff-2"><label>2</label><institution>Department of Studies in Computer Science, University of Mysore</institution>, <addr-line>Mysore</addr-line>, <country>India</country></aff>
</contrib-group><author-notes><corresp id="cor1"><label>&#x002A;</label>Corresponding Author: Thamer Mitib Ahmad Al Sariera. Email: <email>th_670@yahoo.com</email></corresp></author-notes>
<pub-date pub-type="epub" date-type="pub" iso-8601-date="2022-06-07"><day>07</day>
<month>06</month>
<year>2022</year></pub-date>
<volume>44</volume>
<issue>2</issue>
<fpage>1601</fpage>
<lpage>1616</lpage>
<history>
<date date-type="received"><day>16</day><month>12</month><year>2021</year></date>
<date date-type="accepted"><day>02</day><month>3</month><year>2022</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2023 Ali et al.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Ali et al.</copyright-holder>
<license xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>This work is licensed under a <ext-link ext-link-type="uri" xlink:type="simple" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="TSP_CSSE_26119.pdf"></self-uri>
<abstract>
<p>Damage of the blood vessels in retina due to diabetes is called diabetic retinopathy (DR). Hemorrhages is the first clinically visible symptoms of DR. This paper presents a new technique to extract and classify the hemorrhages in fundus images. The normal objects such as blood vessels, fovea and optic disc inside retinal images are masked to distinguish them from hemorrhages. For masking blood vessels, thresholding that separates blood vessels and background intensity followed by a new filter to extract the border of vessels based on orientations of vessels are used. For masking optic disc, the image is divided into sub-images then the brightest window with maximum variance in intensity is selected. Then the candidate dark regions are extracted based on adaptive thresholding and top-hat morphological techniques. Features are extracted from each candidate region based on ophthalmologist selection such as color and size and pattern recognition techniques such as texture and wavelet features. Three different types of Support Vector Machine (SVM), Linear SVM, Quadratic SVM and Cubic SVM classifier are applied to classify the candidate dark regions as either hemorrhages or healthy. The efficacy of the proposed method is demonstrated using the standard benchmark DIARETDB1 database and by comparing the results with methods in silico. The performance of the method is measured based on average sensitivity, specificity, F-score and accuracy. Experimental results show the Linear SVM classifier gives better results than Cubic SVM and Quadratic SVM with respect to sensitivity and accuracy and with respect to specificity Quadratic SVM gives better result as compared to other SVMs.</p>
</abstract>
<kwd-group kwd-group-type="author">
<kwd>Diabetic retinopathy</kwd>
<kwd>hemorrhages</kwd>
<kwd>adaptive thresholding</kwd>
<kwd>support vector machine</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<label>1</label>
<title>Introduction</title>
<p>Analysis of retinal images is used for diagnosing and treatment of several diseases related to the eye such as DR and glaucoma. The benefits of using computerized retina image analysis are many such as (i) manual diagnosis is usually performed by analyzing the images from a patient, as not all images show signs of DR; (ii) there are insufficient number of healthcare specialists to perform eye examination for huge population of diabetics, (iii) computer-assisted diagnosis of retinal images; used in large screening of diabetics for retinopathy is economical.</p>
<p>Every part of our human body thrives on nourishment derived from the circulating blood. Whenever blood supply to a particular tissue is compromised, the vitality of that tissue is threatened. Diabetes mellitus damages the small blood vessels of the body. As the retina is nourished by small microscopic blood vessels, DR is the damage to the retina due to the diseased blood vessels. Damage to the blood vessels cause the major type of DR [<xref ref-type="bibr" rid="ref-1">1</xref>]. Hemorrhages appear either as small red dots or blots indistinguishable from micro-aneurysms or as larger flame-shaped as shown in <xref ref-type="fig" rid="fig-1">Fig. 1</xref>.</p>
<fig id="fig-1">
<label>Figure 1</label>
<caption>
<title>Retinal image with hemorrhages</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-1.png"/>
</fig>
<p>Early detection of lesions is very important for ophthalmologists in clinical diagnostic and successful treatment. So this paper aims at building a system for early detection and classification of major type of DR.</p>
<p>Hemorrhages in retinal images can be difficult to identify because regions that appear to be small red dots could really be normal. In addition, the blood vessels and fovea are difficult to distinguish from red dots in the retinal image. These can lead to ophthalmologists being misled. The proposed method in this paper is to detect normal objects such as blood vessels, optic disc and fovea and which aids in the detection of red dots. These objects are masked and subsequently hemorrhages are identified. This type of DR are detected and classified using three steps: (i) segmentation of the dark regions in the image using adaptive thresholding algorithm, followed by top hat morphological technique (ii) statistical features and pattern recognition techniques are extracted from each region (iii) SVM classifier is used to classify the regions either as healthy or non-healthy.</p>
<p>The main contributions of this paper are summarized as follows:<list list-type="simple"><list-item><label>1)</label>
<p>A new technique to segment normal objects to distinguish them from hemorrhages.</p></list-item><list-item><label>2)</label>
<p>Segmentation candidates dark regions in the image after masking normal objects.</p></list-item><list-item><label>3)</label>
<p>The features based on pattern recognition and ophthalmologist selection are extracted from these candidates dark regions then the SVM is employed to classify the candidates to detect the presence of hemorrhages.</p></list-item></list></p>
<p>This paper is organized in five sections. In Section 2 the related work is discussed. The technique for segmentation of hemorrhages is described in Section 3. In Section 4 feature extraction is presented. Experimental results and comparative analysis with some existing methods are presented in Section 5.In Section 6 the conclusion is presented.</p>
</sec>
<sec id="s2">
<label>2</label>
<title>Related Work</title>
<p>Different techniques have been used for the detection of hemorrhages in retinal images. Mamilla et al. [<xref ref-type="bibr" rid="ref-2">2</xref>] presented a new technique to extract small red dots based on phase congruency and mathematical morphology. Adem et al. [<xref ref-type="bibr" rid="ref-3">3</xref>] proposed a technique to extract dark regions by iterative thresholding approach based on firefly and particle swarm optimization. Thresholding, morphology and geometrical features are used to detect lesions from retinal images [<xref ref-type="bibr" rid="ref-4">4</xref>].</p>
<p>Bae et al. [<xref ref-type="bibr" rid="ref-5">5</xref>] employed a method for the extraction of candidate dark lesions using a circular template matching with cross correlation. Then the candidates are segmented by two methods of region growing: local threshold and adaptive seed region growing segmentation.</p>
<p>Zhou et al. [<xref ref-type="bibr" rid="ref-6">6</xref>] used a method based on super-pixel to extract the candidate hemorrhages. This is followed by extracting features from these candidates. Subsequently, Fisher Discriminant Analysis classifier is applied to classify the candidates as either healthy or red dots.</p>
<p>Chowdhury et al. [<xref ref-type="bibr" rid="ref-7">7</xref>] applied a new technique to segment the hemorrhages using K means clustering in fundus images and is followed by Random Forest Classifier to classify the retinal images. Hatanaka et al. [<xref ref-type="bibr" rid="ref-8">8</xref>] suggested a rule-based method and three Mahalonobis distance classifiers to classify the candidate hemorrhages. Tang et al. [<xref ref-type="bibr" rid="ref-9">9</xref>] utilized a splat feature classifier for lesions detection in fundus images. A supervised method was used for partitioning image into non-overlapping segments called clusters, consisting of similar color pixels. Features are extracted from these clusters which describes its characteristics. Optimal feature subset is selected by the wrapper approach.</p>
<p>Orlando et al. [<xref ref-type="bibr" rid="ref-10">10</xref>] in this research employed a new technique to extract dark lesions in retinal images based on combining both deep learned and domain knowledge. Features learned by a convolutional neural network (CNN) are augmented by incorporating hand crafted features.</p>
<p>Preprocessing of retinal images is initially performed by Aziz et al. [<xref ref-type="bibr" rid="ref-11">11</xref>]. After that, red dots are segmented using a smart windowing-based adaptive threshold. Finally, the regions conventional and handcrafted features are extracted and classified using a SVM.</p>
<p>A new convolutional neural network (CNN) architecture is presented to detect DR. Features are extracted from the identified blots indistinguishable from micro-aneurysms using a modified pre-trained CNN model. Finally, the multi-logistic regression controlled entropy variance methodology is used to select the best features [<xref ref-type="bibr" rid="ref-12">12</xref>]. For extracting candidates for large red-lesions, Asiri et al. [<xref ref-type="bibr" rid="ref-13">13</xref>] developed a new deep learning-based technique. They have used two different candidate generating algorithms, one for small red lesions and the other for large red lesions, as well as two different stream structures based on candidate type. Also, they utilized the VGG-16 model with ROI pooling, regression, and classification layers for each stream. Khojasteh et al. [<xref ref-type="bibr" rid="ref-14">14</xref>] used probabilistic output from CNN to automatically and simultaneously detect lesions in retinal images. Image pre-processing, training data refining, and object detection employing a convolutional neural network with label smoothing are the three parts of the suggested system to extract hemorrhages used by Huang et al. [<xref ref-type="bibr" rid="ref-15">15</xref>].</p>
<p>The methods described in the literature are focused on identifying a certain type of dark lesion. However, the blood vessels and fovea inside the retinal image have same the features with hemorrhages that lead to false detection. So the proposed strategy for locating hemorrhages is based on the following steps: Locating dark areas in the remainder of retinal image after masking segmented regular objects (vessels, optic disc and fovea) from retinal image.<list list-type="bullet"><list-item>
<p>Selecting the clinical descriptive features to describe these candidate areas.</p></list-item><list-item>
<p>Classifying these candidate areas as either hemorrhages or healthy.</p></list-item></list></p>
</sec>
<sec id="s3">
<label>3</label>
<title>Proposed Method for Segmentation of Hemorrhages</title>
<p>The segmentation of dark regions in fundus retinal images is a difficult step because the normal objects inside retinal images such as blood vessels and fovea have the same color, shape and size features as the hemorrhages. Therefore, as a preprocessing step, the blood vessels, optic disc and fovea are segmented and masked. The sequence of steps is as shown in <xref ref-type="fig" rid="fig-2">Fig. 2</xref>.</p>
<fig id="fig-2">
<label>Figure 2</label>
<caption>
<title>Architecture of the proposed method</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-2.png"/>
</fig>
<sec id="s3_1">
<label>3.1</label>
<title>Segmentation and Masking of Blood Vessels</title>
<p>The identification of DR in retinal images such as hemorrhages requires detecting and masking of the blood vessels. In the first step, extracting the green channel from the color retinal image because it carries the most contrast for blood vessels. Then select the threshold value (T) that separates blood vessels and background intensity. Through extensive experiments, T is fixed to be 60.</p>
<p>Finally, a new filter is developed to extract the border of vessels based on orientations of vessels. We assume one pixel <italic>P</italic> to be a vessel border and the neighboring pixels <italic>Q</italic> have two groups (group A contains three pixels inside the blood vessels and group B contains five pixels representing the background of <italic>P</italic>) [<xref ref-type="bibr" rid="ref-16">16</xref>].</p>
<p>The variation between the two groups will be determined by the contrast between vessels and the neighbor pixels of current pixel <italic>P</italic>. Almost in all orientations, at most three pixels out of eight-neighboring pixels lie inside the blood vessel and may take one of eight possible orientations. Average intensity of all possible group A pixels are computed (It is to be observed that group A pixels are three adjacent pixels of the eight neighboring pixels). The minimum of all average intensities is determined and the corresponding pixels are declared to be inside the blood vessel as described in <xref ref-type="disp-formula" rid="eqn-1">Eq. (1)</xref>.<disp-formula id="eqn-1"><label>(1)</label>
<mml:math id="mml-eqn-1" display="block"><mml:mi>p</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>x</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>y</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mrow><mml:mtable rowspacing="4pt" columnspacing="1em"><mml:mtr><mml:mtd><mml:mrow><mml:mi>a</mml:mi><mml:mi>v</mml:mi><mml:mi>g</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>B</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mi>a</mml:mi><mml:mi>v</mml:mi><mml:mi>g</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>A</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>i</mml:mi><mml:mi>f</mml:mi><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mo stretchy="false">[</mml:mo><mml:mrow><mml:mi>a</mml:mi><mml:mi>v</mml:mi><mml:mi>g</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>B</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mi>a</mml:mi><mml:mi>v</mml:mi><mml:mi>g</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>A</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2265;</mml:mo><mml:mi>T</mml:mi></mml:mrow><mml:mo stretchy="false">]</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mrow><mml:mspace width="thickmathspace" /><mml:mn>0</mml:mn><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mi>O</mml:mi><mml:mi>t</mml:mi><mml:mi>h</mml:mi><mml:mi>e</mml:mi><mml:mi>r</mml:mi><mml:mi>w</mml:mi><mml:mi>i</mml:mi><mml:mi>s</mml:mi><mml:mi>e</mml:mi></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow><mml:mo>}</mml:mo></mml:mrow></mml:math>
</disp-formula>where p<italic>(x, y)</italic> represents the new intensity value of the current pixel <italic>P</italic>, <italic>avg(&#x2026;)</italic> represents to the average value. <xref ref-type="fig" rid="fig-3">Fig. 3b</xref> illustrates the extracted blood vessels.</p>
<fig id="fig-3">
<label>Figure 3</label>
<caption>
<title>Segmentation of blood vessels (a) Green retinal image. (b) Blood vessels after removal background</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-3.png"/>
</fig>
</sec>
<sec id="s3_2">
<label>3.2</label>
<title>Segmentation and Masking of Optic Disc</title>
<p>Optic disc needs to be masked to identify hemorrhages. In this section, the proposed models for segmentation of optic disc and fovea are discussed. Further, optic disc segmentation helps in the detection of fovea as that has a fixed distance from the optic disc.</p>
<p><bold><italic>Maximum Variance Window</italic></bold></p>
<p>The selection of the candidate regions is done by dividing the image into non-overlapping sub-images (100&#x2009;&#x00D7;&#x2009;100) to ensure that the whole optic disc region resides within the window (number of sub-image for each image is 3&#x2009;&#x00D7;&#x2009;3) as shown in <xref ref-type="fig" rid="fig-4">Fig. 4b</xref>. Further, the window size is chosen empirically using extensive experimentation, searching for the brightest window with maximum variance in intensity. Searching for the brightest region inside the retinal image is a challenge because of the presence of vascular trees in the region. These vascular trees have different intensity levels and are obscured by optic disc. These obscured vessels may reduce brightness in the optic disc region. To overcome this problem, the proposed algorithm takes only the pixels having intensity greater than the mean value inside the candidate window [<xref ref-type="bibr" rid="ref-17">17</xref>]. The region brightness is computed as described in <xref ref-type="disp-formula" rid="eqn-2">Eq. (2)</xref>.
<fig id="fig-4">
<label>Figure 4</label>
<caption>
<title>Extraction of optic disc and fovea (a) Green retinal image. (b) Retinal image after dividing it into sub-images. (c) Retinal image after masking optic disc and fovea</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-4.png"/>
</fig>
<disp-formula id="eqn-2"><label>(2)</label>
<mml:math id="mml-eqn-2" display="block"><mml:mi>B</mml:mi><mml:mi>r</mml:mi><mml:mi>i</mml:mi><mml:mi>g</mml:mi><mml:mi>h</mml:mi><mml:mi>t</mml:mi><mml:mi>e</mml:mi><mml:mi>s</mml:mi><mml:mi>t</mml:mi><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mn>1</mml:mn><mml:mi>n</mml:mi></mml:mfrac></mml:mrow><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mi>n</mml:mi></mml:mrow></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mspace width="thickmathspace" /><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:msub><mml:mi>P</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mspace width="thickmathspace" /><mml:mo>&#x003E;</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mrow><mml:mi>m</mml:mi><mml:mi>e</mml:mi><mml:mi>a</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mstyle></mml:math>
</disp-formula>where P<sub>mean</sub> is the mean intensity value of the current window, and <italic>n</italic> is the number of pixels inside the current window. We selected the pixels that have value greater than P<sub>mean</sub>. <xref ref-type="disp-formula" rid="eqn-2">Eq. (2)</xref> is taken as a guide for determining brightness of the examined current window. In addition to the brightness criteria, the variance in intensity levels inside the candidate optic disc region is also considered for selection of window. The variance of each region is computed by <xref ref-type="disp-formula" rid="eqn-3">Eq. (3)</xref> as follows:<disp-formula id="eqn-3"><label>(3)</label>
<mml:math id="mml-eqn-3" display="block"><mml:mi>V</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi><mml:mi>a</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>c</mml:mi><mml:mi>e</mml:mi><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mn>1</mml:mn><mml:mi>n</mml:mi></mml:mfrac></mml:mrow><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mi>n</mml:mi></mml:mrow></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>P</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>&#x2212;</mml:mo><mml:mi>B</mml:mi><mml:mi>r</mml:mi><mml:mi>i</mml:mi><mml:mi>g</mml:mi><mml:mi>h</mml:mi><mml:mi>t</mml:mi><mml:mi>e</mml:mi><mml:mi>s</mml:mi><mml:mi>t</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:mstyle></mml:math>
</disp-formula></p>
<p>Window with maximum variance is selected. Then pixels are located pixels with these intensities (&#x003E;160) and these pixels are likely to be lying in the circumference of the optic disc and will be referred as border pixels. Then we have used Circular Hough Transform (CHT) to segment the optic disc in the retinal image [<xref ref-type="bibr" rid="ref-18">18</xref>]. It is an efficient technique to detect circles in the image. Radius of CHT is chosen to be 20 pixels as most optic disc images have this radius.</p>
</sec>
<sec id="s3_3">
<label>3.3</label>
<title>Segmentation and Masking of Fovea</title>
<p>The fovea is a dark area in the central region of the retina, which measures about 4 to 5&#x2005;mm in diameter, and is often located in the same vertical plane with the optic disc at a distance of about twice the diameter of the optic disc. Masking of fovea enhances detection of some lesions that have the same features as hemorrhages. After extracting the optic disc, search for the darkest region that lies in the vertical plane of the optic disc. Radius of the fovea is chosen to be 8 pixels as most images have this radius and the distance between optic disc and fovea is chosen to be 80 pixels. <xref ref-type="fig" rid="fig-4">Fig. 4c</xref> shows masked optic disc and fovea in the retinal image.</p>
</sec>
</sec>
<sec id="s4">
<label>4</label>
<title>Extraction of Candidate Dark Regions</title>
<p>The purpose of this process is to detect the candidate hemorrhages from the retinal image. The first step is the enhancement of the image using Contrast Limited Adaptive Histogram Equalization (CLAHE) to improve the contrast between hemorrhages and background. A local adaptive thresholding technique is applied first to separate hemorrhages image objects from the background based on the local mean intensity. (Subsequently, black morphological top hat is applied to the image in two steps (i) closing is done on the image to obtain the candidates dark regions in the image using disk shape structuring element (ii) subtracting the input image from the output of the previous step.<disp-formula id="eqn-4"><label>(4)</label>
<mml:math id="mml-eqn-4" display="block"><mml:mi>C</mml:mi><mml:mi>l</mml:mi><mml:mi>o</mml:mi><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>g</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>A</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mi>S</mml:mi><mml:mi>E</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>A</mml:mi><mml:mo>&#x2295;</mml:mo><mml:mi>S</mml:mi><mml:mi>E</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2296;</mml:mo><mml:mi>S</mml:mi><mml:mi>E</mml:mi></mml:math>
</disp-formula><disp-formula id="eqn-5"><label>(5)</label>
<mml:math id="mml-eqn-5" display="block"><mml:msub><mml:mi>T</mml:mi><mml:mi>b</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mi>C</mml:mi><mml:mi>l</mml:mi><mml:mi>o</mml:mi><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>g</mml:mi><mml:mspace width="thickmathspace" /><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>A</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>S</mml:mi><mml:mi>E</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mi>A</mml:mi></mml:math>
</disp-formula></p>
<p>Here A is the input image in green channel and SE is symmetrical disc structuring element with radius 12. <xref ref-type="fig" rid="fig-5">Fig. 5b</xref> shows the binary image of the hemorrhage candidates in white color and the background in black color.</p>
<fig id="fig-5">
<label>Figure 5</label>
<caption>
<title>Extraction of candidate hemorrhages. (a) Retinal image after masking blood vessels, optic disc and fovea. (b) Candidate hemorrhages</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-5.png"/>
</fig>
</sec>
<sec id="s5">
<label>5</label>
<title>Feature Extraction</title>
<p>Not all the extracted dark regions are hemorrhages. The extracted dark areas need to be checked carefully in order to decide; if they are hemorrhages or normal background. This task is achieved by selecting a set of features for each region. The technique for selecting features is based on grouping features into two main categories: One is based on the ophthalmologist&#x0027;s recognition of lesions using color and size; and the other is based on pattern recognition techniques by extracting texture, dominant color and wavelet features.</p>
<sec id="s5_1">
<label>5.1</label>
<title>Features Based on Ophthalmologist Selection</title>
<p><list list-type="simple"><list-item>
<p><bold>1. Reddish</bold></p></list-item></list></p>
<p>Given a pixel represented in RGB, its redness will depend on its values in each color channel; R, G, and B. The redness value increases as the value of R channel increases and both values of G, and B channels decrease and vice versa. So, each pixel can be replaced by <xref ref-type="disp-formula" rid="eqn-6">Eq. (6)</xref> to indicate the amount of redness.<disp-formula id="eqn-6"><label>(6)</label>
<mml:math id="mml-eqn-6" display="block"><mml:msub><mml:mi>R</mml:mi><mml:mi>n</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mi>R</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>G</mml:mi><mml:mo>&#x2217;</mml:mo><mml:mi>B</mml:mi><mml:mo>+</mml:mo><mml:mn>255</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math>
</disp-formula>where R<italic><sub>n</sub></italic> represents the new value of the current processed pixel, and (R, G, B) represent RGB components of the current processed pixel. Putting &#x201C;255&#x201D; in the dominator aims to avoid dividing by zero and normalizing output from &#x201C;0&#x201D; (at R&#x2009;&#x003D;&#x2009;0) to &#x201C;1&#x201D; (at R&#x2009;&#x003D;&#x2009;255 and both G, B&#x2009;&#x003D;&#x2009;0). Even <xref ref-type="disp-formula" rid="eqn-6">Eq. (6)</xref> describes a suggested equation to determine redness feature for a given pixel. Extending this equation for a given region can easily be implemented by taking the mean value for all pixels in that region.<list list-type="simple"><list-item>
<p><bold>2. Size</bold></p></list-item></list></p>
<p>The total number of pixels inside the region.</p>
</sec>
<sec id="s5_2">
<label>5.2</label>
<title>Pattern Recognition Techniques</title>
<p><list list-type="simple"><list-item>
<p><bold>1) Mean</bold></p></list-item></list></p>
<p>The mean value of each region for each color space is determined as follows:<disp-formula id="eqn-7"><label>(7)</label>
<mml:math id="mml-eqn-7" display="block"><mml:mi>&#x03BC;</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>p</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mn>1</mml:mn><mml:mi>N</mml:mi></mml:mfrac></mml:mrow><mml:munder><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>j</mml:mi><mml:mo>&#x2208;</mml:mo><mml:msub><mml:mi>R</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow></mml:munder><mml:mo>&#x2061;</mml:mo><mml:msub><mml:mi>X</mml:mi><mml:mrow><mml:mi>j</mml:mi><mml:mspace width="thickmathspace" /></mml:mrow></mml:msub><mml:mo stretchy="false">(</mml:mo><mml:mi>p</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mstyle></mml:math>
</disp-formula>where <italic>&#x03BC;(i, p)</italic> is the mean intensity value of the color components <italic>P</italic> at the region <italic>i, j</italic> all pixels belonging to region <italic>i</italic>, and <italic>X <sub>j</sub> (P)</italic> represents the intensity value of color component <italic>P</italic> at pixel j.<list list-type="simple"><list-item>
<p><bold>2) Variance</bold></p></list-item></list></p>
<p>The variance of each region at each color space is determined by:<disp-formula id="eqn-8"><label>(8)</label>
<mml:math id="mml-eqn-8" display="block"><mml:mi>v</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mi>p</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mn>1</mml:mn><mml:mi>N</mml:mi></mml:mfrac></mml:mrow><mml:munder><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>j</mml:mi><mml:mo>&#x2208;</mml:mo><mml:msub><mml:mi>R</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow></mml:munder><mml:mo>&#x2061;</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi>X</mml:mi><mml:mi>j</mml:mi></mml:msub><mml:mo stretchy="false">(</mml:mo><mml:mi>p</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>&#x2212;</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>&#x03BC;</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>p</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:msup></mml:mstyle></mml:math>
</disp-formula>where <italic>v(i, p)</italic> represents the square of the standard division value of the color component <italic>P</italic> at the region <italic>i</italic>.<list list-type="simple"><list-item>
<p><bold>3) Compactness</bold></p></list-item></list></p>
<p>A compactness feature gives a measure about how far an object is from a circular shape.<list list-type="simple"><list-item>
<p><bold>4) Dominant Colors</bold></p></list-item></list></p>
<p>The dominant color for each region is determined as color with the maximum frequency in this region. To avoid the effect of spurious noise in determining dominant color, the color space of each region is classified into a set of bins before determining number of occurrences for each bin in the processed region. The dominant color of each region is taken as the bin with maximum frequency occurrences.<list list-type="simple"><list-item>
<p><bold>5) Co-occurrence Matrix</bold></p></list-item></list></p>
<p>From Co-occurrence Matrix we have used 5 formulas [<xref ref-type="bibr" rid="ref-19">19</xref>].</p>
<p><bold><italic>Energy:</italic></bold><disp-formula id="eqn-9"><label>(9)</label>
<mml:math id="mml-eqn-9" display="block"><mml:mi>E</mml:mi><mml:mo>=</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>G</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>G</mml:mi></mml:munderover><mml:mspace width="thickmathspace" /><mml:mspace width="thickmathspace" /><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>j</mml:mi></mml:mrow><mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:msup></mml:math>
</disp-formula></p>
<p><bold><italic>Entropy:</italic></bold><disp-formula id="eqn-10"><label>(10)</label>
<mml:math id="mml-eqn-10" display="block"><mml:mi>E</mml:mi><mml:mi>n</mml:mi><mml:mi>t</mml:mi><mml:mo>=</mml:mo><mml:mo>&#x2212;</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>G</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>G</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mi>log</mml:mi><mml:mo>&#x2061;</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mspace width="thickmathspace" /></mml:math>
</disp-formula></p>
<p><bold><italic>Contrast:</italic></bold><disp-formula id="eqn-11"><label>(11)</label>
<mml:math id="mml-eqn-11" display="block"><mml:mi>C</mml:mi><mml:mo>=</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>G</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>G</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo fence="false" stretchy="false">|</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mi>j</mml:mi></mml:mrow><mml:msup><mml:mo fence="false" stretchy="false">|</mml:mo><mml:mn>2</mml:mn></mml:msup></mml:math>
</disp-formula></p>
<p><bold><italic>Correlation:</italic></bold><disp-formula id="eqn-12"><label>(12)</label>
<mml:math id="mml-eqn-12" display="block"><mml:mrow><mml:mi mathvariant="bold-italic">C</mml:mi><mml:mi>o</mml:mi><mml:mi>r</mml:mi></mml:mrow><mml:mo>=</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">i</mml:mi></mml:mrow><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">G</mml:mi></mml:mrow></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">j</mml:mi></mml:mrow><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">G</mml:mi></mml:mrow></mml:munderover><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">i</mml:mi></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mrow><mml:mi mathvariant="bold-italic">&#x03BC;</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">i</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">j</mml:mi></mml:mrow><mml:mo>&#x2212;</mml:mo><mml:msub><mml:mrow><mml:mi mathvariant="bold-italic">&#x03BC;</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">j</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mrow><mml:mi mathvariant="bold-italic">f</mml:mi></mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">i</mml:mi></mml:mrow><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mrow><mml:mi mathvariant="bold-italic">j</mml:mi></mml:mrow></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi mathvariant="bold-italic">&#x03C3;</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">i</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi mathvariant="bold-italic">&#x03C3;</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="bold-italic">j</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math>
</disp-formula></p>
<p><bold><italic>Homogeneity:</italic></bold><disp-formula id="eqn-13"><label>(13)</label>
<mml:math id="mml-eqn-13" display="block"><mml:mi>H</mml:mi><mml:mo>=</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>G</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>G</mml:mi></mml:munderover><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>f</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mrow><mml:mn>1</mml:mn><mml:mo>+</mml:mo><mml:mo fence="false" stretchy="false">|</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mi>j</mml:mi></mml:mrow><mml:mo fence="false" stretchy="false">|</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math>
</disp-formula></p>
<p>Based on experimental work, the distance at which co-occurrence matrix is calculated is taken as 2 equals pixels. The angle varies from 0 to135 with a difference of 35 steps. To make the features invariant to the orientations of regions, an average of these features at each pixel is extracted from 4 different orientations.<list list-type="simple"><list-item>
<p><bold>6) Wavelets</bold></p></list-item></list></p>
<p>Applying first level DWT on a given color channel of the processed retinal image results in 4 images. The features extracted are energy and entropy from the approximation matrix.<xref ref-type="table" rid="table-1">Tab. 1</xref> shows a list of all features in the proposed method for the classification of hemorrhages. 
<table-wrap id="table-1"><label>Table 1</label>
<caption>
<title>Set of features extracted for each region</title></caption>
<table><colgroup><col align="left"/><col align="left"/><col align="left"/><col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">N</th>
<th align="left">Feature</th>
<th align="left">N</th>
<th align="left">Feature</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">1</td>
<td align="left">Reddish</td>
<td align="left">13</td>
<td align="left">Energy</td>
</tr>
<tr>
<td align="left">2</td>
<td align="left">Mean of each region at red channel</td>
<td align="left">14</td>
<td align="left">Entropy</td>
</tr>
<tr>
<td align="left">3</td>
<td align="left">Mean of each region at green channel</td>
<td align="left">15</td>
<td align="left">Contrast</td>
</tr>
<tr>
<td align="left">4</td>
<td align="left">Mean of each region at blue channel</td>
<td align="left">16</td>
<td align="left">Correlation</td>
</tr>
<tr>
<td align="left">5</td>
<td align="left">Variance of each region at red channel</td>
<td align="left">17</td>
<td align="left">Homogeneity</td>
</tr>
<tr>
<td align="left">6</td>
<td align="left">Variance of each region at green channel</td>
<td align="left">18</td>
<td align="left">Wavelet energy on red channel</td>
</tr>
<tr>
<td align="left">7</td>
<td align="left">Variance of each region at blue channel</td>
<td align="left">19</td>
<td align="left">Wavelet energy on green channel</td>
</tr>
<tr>
<td align="left">8</td>
<td align="left">Size</td>
<td align="left">20</td>
<td align="left">Wavelet energy on blue channel</td>
</tr>
<tr>
<td align="left">9</td>
<td align="left">Compactness</td>
<td align="left">21</td>
<td align="left">Wavelet entropy on red channel</td>
</tr>
<tr>
<td align="left">10</td>
<td align="left">Dominant color at red plane</td>
<td align="left">22</td>
<td align="left">Wavelet entropy on green channel</td>
</tr>
<tr>
<td align="left">11</td>
<td align="left">Dominant color at green plane</td>
<td align="left">23</td>
<td align="left">Wavelet entropy on blue channel</td>
</tr>
<tr>
<td align="left">12</td>
<td align="left">Dominant color at blue plane</td>
<td align="center"/>
<td align="center"/>
</tr>
</tbody>
</table>
</table-wrap><list list-type="simple"><list-item>
<p><bold>-Wavelet Energy</bold>: Wavelet energy of the candidate region is the sum of squares of all elements in the approximation matrix.<disp-formula id="eqn-14"><label>(14)</label>
<mml:math id="mml-eqn-14" display="block"><mml:mrow><mml:mi mathvariant="bold">E</mml:mi><mml:mi mathvariant="bold">n</mml:mi><mml:mi mathvariant="bold">e</mml:mi><mml:mi mathvariant="bold">r</mml:mi><mml:mi mathvariant="bold">g</mml:mi><mml:mi mathvariant="bold">y</mml:mi></mml:mrow><mml:msub><mml:mspace width="thickmathspace" /><mml:mrow><mml:mi mathvariant="bold">w</mml:mi><mml:mi mathvariant="bold">v</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>m</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:mi>C</mml:mi><mml:mi>a</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>j</mml:mi></mml:mrow><mml:msup><mml:mo stretchy="false">)</mml:mo><mml:mn>2</mml:mn></mml:msup></mml:math>
</disp-formula></p></list-item></list>where ca(i, j) are intensities of the approximation matrix computed through various processing steps.<list list-type="simple"><list-item>
<p><bold>-Wavelet Entropy</bold>: Wavelet entropy is used to recognize the randomness texture of each candidate region.<disp-formula id="eqn-15"><label>(15)</label>
<mml:math id="mml-eqn-15" display="block"><mml:mrow><mml:mi mathvariant="bold">E</mml:mi><mml:mi mathvariant="bold">n</mml:mi><mml:mi mathvariant="bold">t</mml:mi><mml:mi mathvariant="bold">r</mml:mi><mml:mi mathvariant="bold">o</mml:mi><mml:mi mathvariant="bold">p</mml:mi><mml:mi mathvariant="bold">y</mml:mi></mml:mrow><mml:msub><mml:mspace width="thickmathspace" /><mml:mrow><mml:mi mathvariant="bold">w</mml:mi><mml:mi mathvariant="bold">v</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>m</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:munderover><mml:mrow><mml:mo movablelimits="false">&#x2211;</mml:mo></mml:mrow><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mo>&#x2061;</mml:mo><mml:mi>C</mml:mi><mml:mi>a</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mi>log</mml:mi><mml:mo>&#x2061;</mml:mo><mml:mi>C</mml:mi><mml:mi>a</mml:mi><mml:mspace width="thickmathspace" /><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mspace width="thickmathspace" /><mml:mi>j</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:math>
</disp-formula></p></list-item></list></p>
</sec>
</sec>
<sec id="s6">
<label>6</label>
<title>Experimental Results</title>
<p>SVM are supervised learning models with associated learning algorithms that analyze data and recognize patterns in the input data. In our approach three different types of SVM are applied; Linear SVM, Quadratic SVM and Cubic SVM that takes a set of input data and predicts the output, which forms two possible classes.</p>
<p>In our work, we have extracted 3386 candidate dark regions from the dataset. Each region is represented with 23 extracted features. The experiment is conducted by varying the number of candidate areas. The candidate areas (testing data set size) are 30&#x0025;, 40&#x0025;, 50&#x0025; and 60&#x0025;.</p>
<p>The proposed technique has been experimented on the publicly available database DIARETDB1 [<xref ref-type="bibr" rid="ref-20">20</xref>].This dataset consists of 89 fundus images with 50&#x00B0; field-of-view. Each image has a resolution of 1500&#x2009;&#x00D7;&#x2009;1152 pixels. Further, the ground truth label for segmentation of optic disc and hemorrhages are available from the dataset. The dataset contains 59 abnormal images with the labels.</p>
<p>To measure the performance of the proposed method, experiments are done using proposed and state-of-the-art methods to segment optic disc and classify the hemorrhages. Metrics such as the average sensitivity, specificity, average predictive value and F-score are taken to quantify the performance.<disp-formula id="eqn-16"><label>(16)</label>
<mml:math id="mml-eqn-16" display="block"><mml:mi>S</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>v</mml:mi><mml:mi>i</mml:mi><mml:mi>t</mml:mi><mml:mi>y</mml:mi><mml:mspace width="thickmathspace" /><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>S</mml:mi><mml:mi>e</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math>
</disp-formula><disp-formula id="eqn-17"><label>(17)</label>
<mml:math id="mml-eqn-17" display="block"><mml:mi>S</mml:mi><mml:mi>p</mml:mi><mml:mi>e</mml:mi><mml:mi>c</mml:mi><mml:mi>i</mml:mi><mml:mi>f</mml:mi><mml:mi>i</mml:mi><mml:mi>c</mml:mi><mml:mi>i</mml:mi><mml:mi>t</mml:mi><mml:mi>y</mml:mi><mml:mspace width="thickmathspace" /><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>S</mml:mi><mml:mi>p</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>N</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math>
</disp-formula><disp-formula id="eqn-18"><label>(18)</label>
<mml:math id="mml-eqn-18" display="block"><mml:mi>A</mml:mi><mml:mi>c</mml:mi><mml:mi>c</mml:mi><mml:mi>u</mml:mi><mml:mi>r</mml:mi><mml:mi>a</mml:mi><mml:mi>c</mml:mi><mml:mi>y</mml:mi><mml:mspace width="thickmathspace" /><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>A</mml:mi><mml:mi>c</mml:mi><mml:mi>c</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi><mml:mi>N</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math>
</disp-formula><disp-formula id="eqn-19"><label>(19)</label>
<mml:math id="mml-eqn-19" display="block"><mml:mi>P</mml:mi><mml:mi>P</mml:mi><mml:mi>V</mml:mi><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math>
</disp-formula><disp-formula id="eqn-20"><label>(20)</label>
<mml:math id="mml-eqn-20" display="block"><mml:mi>F</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mi>s</mml:mi><mml:mi>c</mml:mi><mml:mi>o</mml:mi><mml:mi>r</mml:mi><mml:mi>e</mml:mi><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mn>2</mml:mn><mml:mi>T</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>2</mml:mn><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math>
</disp-formula></p>
<p>The results of candidate window selection and extraction of the optic disc on two images using variance are shown in <xref ref-type="fig" rid="fig-6">Fig. 6</xref>. <xref ref-type="table" rid="table-2">Tab. 2</xref> shows the performance of the proposed method in three terms and is compared with state-of-art-methods for segmentation optic disc.</p>
<fig id="fig-6">
<label>Figure 6</label>
<caption>
<title>Segmentation of optic disc. (a) Retinal images. (b) Extracted candidate window. (c) Window with optic disc</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-6.png"/>
</fig>
<table-wrap id="table-2"><label>Table 2</label>
<caption>
<title>Optic disc segmentation results and compared with other methods on DIARETDB1</title></caption>
<table><colgroup><col align="left"/><col align="left"/><col align="left"/><col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">Method</th>
<th align="left">Se (&#x0025;)</th>
<th align="left">Sp (&#x0025;)</th>
<th align="left">PPV (&#x0025;)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Walter et al. [<xref ref-type="bibr" rid="ref-21">21</xref>]</td>
<td align="left">65.69</td>
<td align="left">99.3</td>
<td align="left">93.95</td>
</tr>
<tr>
<td align="left">Lupasu et al. [<xref ref-type="bibr" rid="ref-22">22</xref>]</td>
<td align="left">68.48</td>
<td align="left">99.69</td>
<td align="left">81.17</td>
</tr>
<tr>
<td align="left">Bharkad [<xref ref-type="bibr" rid="ref-23">23</xref>]</td>
<td align="left">75.11</td>
<td align="left">99.54</td>
<td align="left">71.73</td>
</tr>
<tr>
<td align="left">Proposed method</td>
<td align="left">80.42</td>
<td align="left">99.44</td>
<td align="left">72.12</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The overall algorithm for segmentation of optic disc is given below</p>
<fig id="fig-10">
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-10.png"/>
</fig>
<p>Extensive experimentation with different thresholds on various parameters are used, and found the best threshold value to extract optic disc is 160.</p>
<p>From <xref ref-type="table" rid="table-2">Tab. 2</xref> it is evident that the proposed method achieves better performance than the other methods with respect to average sensitivity for segmentation of optic disc. <xref ref-type="fig" rid="fig-7">Fig. 7</xref> shows green channel retinal images after masking normal objects and the candidate region of hemorrhages.</p>
<fig id="fig-7">
<label>Figure 7</label>
<caption>
<title>Extraction candidates region of hemorrhages. (a) Green channel retinal images after normal objects. (b) Candidates region of hemorrhages</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-7.png"/>
</fig>
<p>The overall algorithm for detection and classification of hemorrhages is given below</p>
<fig id="fig-11">
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-11.png"/>
</fig>
<p>The performance of the proposed method for detection hemorrhages are tabulated (<xref ref-type="table" rid="table-3">Tabs. 3</xref> to <xref ref-type="table" rid="table-5">5</xref>) for linear SVM, quadratic SVM and cubic SVM respectively and compared with the other state-of-art-methods as shown in (<xref ref-type="table" rid="table-6">Tab. 6</xref>). <xref ref-type="fig" rid="fig-8">Figures 8</xref> and <xref ref-type="fig" rid="fig-9">9</xref> show the graph ofcomparison on different techniques for detection of haemorrhages.</p>
<table-wrap id="table-3"><label>Table 3</label>
<caption>
<title>Performance result of the proposed model (Linear SVM)</title></caption>
<table><colgroup><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">No of candidate areas &#x0025; (Testing set)</th>
<th align="left">TP</th>
<th align="left">TN</th>
<th align="left">FP</th>
<th align="left">FN</th>
<th align="left">Se &#x0025;</th>
<th align="left">Sp &#x0025;</th>
<th align="left">Acc &#x0025;</th>
<th align="left">F-score &#x0025;</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">30&#x0025;</td>
<td align="left">641</td>
<td align="left">274</td>
<td align="left">32</td>
<td align="left">68</td>
<td align="left">90.4</td>
<td align="left">89.5</td>
<td align="left">90.1</td>
<td align="left">92.7</td>
</tr>
<tr>
<td align="left">40&#x0025;</td>
<td align="left">800</td>
<td align="left">394</td>
<td align="left">52</td>
<td align="left">108</td>
<td align="left">88.1</td>
<td align="left">88.3</td>
<td align="left">88.2</td>
<td align="left">90.9</td>
</tr>
<tr>
<td align="left">50&#x0025;</td>
<td align="left">1047</td>
<td align="left">401</td>
<td align="left">79</td>
<td align="left">166</td>
<td align="left">86.3</td>
<td align="left">84.4</td>
<td align="left">85.5</td>
<td align="left">87.6</td>
</tr>
<tr>
<td align="left">60&#x0025;</td>
<td align="left">1349</td>
<td align="left">312</td>
<td align="left">96</td>
<td align="left">274</td>
<td align="left">83.1</td>
<td align="left">80.5</td>
<td align="left">85.5</td>
<td align="left">87.9</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="table-4"><label>Table 4</label>
<caption>
<title>Performance result of the proposed model (Quadratic SVM)</title></caption>
<table><colgroup><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">No of candidate areas &#x0025; (Testing set)</th>
<th align="left">TP</th>
<th align="left">TN</th>
<th align="left">FP</th>
<th align="left">FN</th>
<th align="left">Se &#x0025;</th>
<th align="left">Sp &#x0025;</th>
<th align="left">Acc &#x0025;</th>
<th align="left">F-score &#x0025;</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">30&#x0025;</td>
<td align="left">629</td>
<td align="left">268</td>
<td align="left">44</td>
<td align="left">74</td>
<td align="left">89.4</td>
<td align="left">89.5</td>
<td align="left">88.4</td>
<td align="left">91.4</td>
</tr>
<tr>
<td align="left">40&#x0025;</td>
<td align="left">764</td>
<td align="left">395</td>
<td align="left">88</td>
<td align="left">107</td>
<td align="left">87.7</td>
<td align="left">81.7</td>
<td align="left">85.6</td>
<td align="left">88.6</td>
</tr>
<tr>
<td align="left">50&#x0025;</td>
<td align="left">1005</td>
<td align="left">401</td>
<td align="left">121</td>
<td align="left">166</td>
<td align="left">85.8</td>
<td align="left">76.8</td>
<td align="left">83.0</td>
<td align="left">87.5</td>
</tr>
<tr>
<td align="left">60&#x0025;</td>
<td align="left">1308</td>
<td align="left">383</td>
<td align="left">137</td>
<td align="left">203</td>
<td align="left">86.5</td>
<td align="left">73.6</td>
<td align="left">83.3</td>
<td align="left">88.4</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="table-5"><label>Table 5</label>
<caption>
<title>Performance result of the proposed model (Cubic SVM)</title></caption>
<table><colgroup><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">No of candidate areas &#x0025; (Testing set)</th>
<th align="left">TP</th>
<th align="left">TN</th>
<th align="left">FP</th>
<th align="left">FN</th>
<th align="left">Se &#x0025;</th>
<th align="left">Sp &#x0025;</th>
<th align="left">Acc &#x0025;</th>
<th align="left">F-score &#x0025;</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">30&#x0025;</td>
<td align="left">646</td>
<td align="left">249</td>
<td align="left">27</td>
<td align="left">93</td>
<td align="left">87.4</td>
<td align="left">90.0</td>
<td align="left">88.2</td>
<td align="left">91.5</td>
</tr>
<tr>
<td align="left">40&#x0025;</td>
<td align="left">803</td>
<td align="left">336</td>
<td align="left">49</td>
<td align="left">166</td>
<td align="left">82.8</td>
<td align="left">87.2</td>
<td align="left">84.1</td>
<td align="left">88.1</td>
</tr>
<tr>
<td align="left">50&#x0025;</td>
<td align="left">1041</td>
<td align="left">340</td>
<td align="left">85</td>
<td align="left">227</td>
<td align="left">82.0</td>
<td align="left">80.0</td>
<td align="left">81.6</td>
<td align="left">86.9</td>
</tr>
<tr>
<td align="left">60&#x0025;</td>
<td align="left">1343</td>
<td align="left">286</td>
<td align="left">102</td>
<td align="left">300</td>
<td align="left">81.7</td>
<td align="left">73.7</td>
<td align="left">80.2</td>
<td align="left">86.9</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="table-6"><label>Table 6</label>
<caption>
<title>Proposed method results and compared with state-of-art methods</title></caption>
<table><colgroup><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/><col align="left"/>
</colgroup>
<thead>
<tr>
<th align="left">Method</th>
<th align="left">Approach</th>
<th align="left">Dataset</th>
<th align="left">Se &#x0025;</th>
<th align="left">Sp &#x0025;</th>
<th align="left">Acc &#x0025;</th>
<th align="left">F-score</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Zhou et al. [<xref ref-type="bibr" rid="ref-6">6</xref>]</td>
<td align="left">SLIC super-pixel</td>
<td align="left">DIARETDBA1</td>
<td align="left">83.30</td>
<td align="left">97.30</td>
<td align="left">-</td>
<td align="left">92.4</td>
</tr>
<tr>
<td align="left">Roychowdhury et al. [<xref ref-type="bibr" rid="ref-24">24</xref>]</td>
<td align="left">Gaussian Mixture Models (GMM)</td>
<td align="left">DIARETDBA1</td>
<td align="left">75.50</td>
<td align="left">93.73</td>
<td align="left">-</td>
<td align="left">-</td>
</tr>
<tr>
<td align="left">Romero-Ora&#x00E1; et al. [<xref ref-type="bibr" rid="ref-25">25</xref>]</td>
<td align="left">Entropy Rate Super pixel (ER)</td>
<td align="left">DIARETDBA1</td>
<td align="left">84.00</td>
<td align="left">88.89</td>
<td align="left">-</td>
<td align="left">-</td>
</tr>
<tr>
<td align="left">Chowdhury et al. [<xref ref-type="bibr" rid="ref-7">7</xref>]</td>
<td align="left">Random forest classifier</td>
<td align="left">DIARETDBA1</td>
<td align="left">-</td>
<td align="left">-</td>
<td align="left">93.58</td>
<td align="left">-</td>
</tr>
<tr>
<td align="left">Aziz et al. [<xref ref-type="bibr" rid="ref-11">11</xref>]</td>
<td align="left">Smart window-based adaptive thresholding</td>
<td align="left">DIARETDBA1</td>
<td align="left">83.74</td>
<td align="center"/>
<td align="left">-</td>
<td align="left">83.85</td>
</tr>
<tr>
<td align="left">Orlando et al. [<xref ref-type="bibr" rid="ref-10">10</xref>]</td>
<td align="left">CNN</td>
<td align="left">MESSIDOR</td>
<td align="left">84.7</td>
<td align="left">-</td>
<td align="left">79.12</td>
<td align="left">-</td>
</tr>
<tr>
<td align="left">Khojasteh et al. [<xref ref-type="bibr" rid="ref-14">14</xref>]</td>
<td align="left">CNN</td>
<td align="left">e-Ophtha&#x002B; DIARETDBA1</td>
<td align="left">84.0</td>
<td align="left">92.0</td>
<td align="left">90.0</td>
<td align="left">-</td>
</tr>
<tr>
<td align="left">Kleawsirikul et al. [<xref ref-type="bibr" rid="ref-26">26</xref>]</td>
<td align="left">Rule based classification (RB)</td>
<td align="left">DIARETDBA1</td>
<td align="left">80.37</td>
<td align="left">99.53</td>
<td align="left">-</td>
<td align="left">-</td>
</tr>
<tr>
<td align="left">Asiri et al. [<xref ref-type="bibr" rid="ref-13">13</xref>]</td>
<td align="left">Pre-trained VGGNe</td>
<td align="left">DIARETDBA1</td>
<td align="left">78.69</td>
<td align="left">-</td>
<td align="left">-</td>
<td align="left">-</td>
</tr>
<tr>
<td align="left">Proposed method</td>
<td align="left">SVM (Quadratic)<break/>SVM (Linear)<break/>SVM (Cubic)</td>
<td align="left">DIARETDBA1</td>
<td align="left">87.40<break/>90.40<break/>89.4</td>
<td align="left">90.00<break/>89.5<break/>89.5</td>
<td align="left">88.20<break/>90.1<break/>88.4</td>
<td align="left">91.4<break/>92.7<break/>91.5</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="fig-8">
<label>Figure 8</label>
<caption>
<title>Graph of sensitivity of lesion classification</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-8.png"/>
</fig>
<fig id="fig-9">
<label>Figure 9</label>
<caption><title>Graph of specificity of lesion classification</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CSSE_26119-fig-9.png"/>
</fig>
<p>From <xref ref-type="table" rid="table-3">Tabs. 3</xref> to <xref ref-type="table" rid="table-5">5</xref> we observe that Linear SVM classifier gives better results than Cubic SVM and Quadratic SVM with respect to sensitivity and accuracy and with respect to specificity Quadratic SVM gives better results as compared to other SVMs.</p>
</sec>
<sec id="s7">
<label>7</label>
<title>Conclusion</title>
<p>An efficient framework for the early diagnosis of DR diseases such as hemorrhages has been proposed in this paper.We have developed a new technique to detect and classify hemorrhages in retinal images. The proposed method consists of four steps; (i) normal objects in retinal images are detected and masked because these objects have the same features with hemorrhages that lead to misdiagnosis. (ii) The dark regions are extracted by using adaptive thresholding and top-hat morphological techniques. (iii) Statistical and pattern recognition features are extracted from each region (iv) SVM is used to classify the candidate dark regions as either hemorrhages or healthy.</p>
<p>We have achieved 90.4&#x0025;, 89.5&#x0025;, 90.1&#x0025; and 92.7&#x0025; for sensitivity, specificity, accuracy and F-score respectively. Further, the proposed method is compared with the state-of-art-methods.</p>
<p>In the future, we intend to collect a private dataset that contains more than a thousand images to apply deep learning classification techniques. Also we plan to detect and classify other types of DR diseases such as Micro-aneurysms.</p>
</sec>
</body>
<back>
<ack>
<p>The authors would like to express their gratitude to the ministry of education and the deanship of scientific research&#x2013;Najran University&#x2013;Kingdom of Saudi Arabia for their financial and technical support under code number NU/-/SERC/10/640.</p>
</ack><fn-group>
<fn fn-type="other">
<p><bold>Funding Statement:</bold> This work was supported by the ministry of education and the deanship of scientific research&#x2013;Najran University&#x2013;Kingdom of Saudi Arabia for their financial and technical support under code number NU/-/SERC/10/640.</p>
</fn>
<fn fn-type="conflict">
<p><bold>Conflicts of Interest:</bold> The authors declare that they have no conflicts of interest to report regarding the present study.</p>
</fn>
</fn-group>
<ref-list content-type="authoryear">
<title>References</title>
<ref id="ref-1"><label>[1]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>T. G.</given-names> <surname>Schmidt</surname></string-name>, <string-name><given-names>R. E.</given-names> <surname>Linderman</surname></string-name>, <string-name><given-names>M. R.</given-names> <surname>Strampe</surname></string-name>, <string-name><given-names>T. Y.</given-names> <surname>Chui</surname></string-name>, <string-name><given-names>R. B.</given-names> <surname>Rosen</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<article-title>The utility of frame averaging for automated algorithms in analyzing retinal vascular biomarkers in AngioVue OCTA</article-title>,&#x201D; <source>Translational Vision Science &#x0026; Technology</source>, vol. <volume>8</volume>, no. <issue>1</issue>, pp. <fpage>10</fpage>&#x2013;<lpage>10</lpage>, <year>2019</year>.</mixed-citation></ref>
<ref id="ref-2"><label>[2]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>R. T.</given-names> <surname>Mamilla</surname></string-name>, <string-name><given-names>V. K. R.</given-names> <surname>Ede</surname></string-name> and <string-name><given-names>P. R.</given-names> <surname>Bhima</surname></string-name></person-group>, &#x201C;<article-title>Extraction of micro-aneurysms and hemorrhages from digital retinal images</article-title>,&#x201D; <source>Journal of Medical and Biological Engineering</source>, vol. <volume>37</volume>, no. <issue>3</issue>, pp. <fpage>395</fpage>&#x2013;<lpage>408</lpage>, <year>2017</year>.</mixed-citation></ref>
<ref id="ref-3"><label>[3]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>K.</given-names> <surname>Adem</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Hekim</surname></string-name> and <string-name><given-names>S.</given-names> <surname>Demir</surname></string-name></person-group>, &#x201C;<article-title>Detection of hemorrhage in retinal images using linear classifiers and iterative thresholding approaches based on firefly and particle swarm optimization algorithms</article-title>,&#x201D; <source>Turkish Journal of Electrical Engineering &#x0026; Computer Sciences</source>, vol. <volume>27</volume>, no. <issue>1</issue>, pp. <fpage>499</fpage>&#x2013;<lpage>515</lpage>, <year>2019</year>.</mixed-citation></ref>
<ref id="ref-4"><label>[4]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>N.</given-names> <surname>Sengar</surname></string-name> and <string-name><given-names>M. K.</given-names> <surname>Dutta</surname></string-name></person-group>, &#x201C;<article-title>Automated method for hierarchal detection and grading of diabetic retinopathy</article-title>,&#x201D; <source>Computer Methods in Biomechanics and Biomedical Engineering: Imaging &#x0026; Visualization</source>, vol. <volume>6</volume>, no. <issue>6</issue>, pp. <fpage>649</fpage>&#x2013;<lpage>659</lpage>, <year>2018</year>.</mixed-citation></ref>
<ref id="ref-5"><label>[5]</label><mixed-citation publication-type="journal"><person-group person-group-type="author">J. P. Bae, K. G. Kim, H. C. Kang, C. B. Jeong, K. H. Park <etal>et al.,</etal></person-group> &#x201C;<article-title>A study on haemorrhage detection using hybrid method in fundus images</article-title>,&#x201D; <source>Journal of Digital Imaging</source>, vol. <volume>24</volume>, no. <issue>3</issue>, pp. <fpage>394</fpage>&#x2013;<lpage>404</lpage>, <year>2011</year>.</mixed-citation></ref>
<ref id="ref-6"><label>[6]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>W.</given-names> <surname>Zhou</surname></string-name>, <string-name><given-names>C.</given-names> <surname>Wu</surname></string-name>, <string-name><given-names>D.</given-names> <surname>Chen</surname></string-name>, <string-name><given-names>Z.</given-names> <surname>Wang</surname></string-name> and <string-name><given-names>Y.</given-names> <surname>Yi</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<article-title>Automated detection of red lesions using superpixel multichannel multifeature</article-title>,&#x201D; <source>Computational and Mathematical Methods in Medicine</source>, <year>2017</year>.</mixed-citation></ref>
<ref id="ref-7"><label>[7]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>A. R.</given-names> <surname>Chowdhury</surname></string-name>, <string-name><given-names>T.</given-names> <surname>Chatterjee</surname></string-name> and <string-name><given-names>S.</given-names> <surname>Banerjee</surname></string-name></person-group>, &#x201C;<article-title>A random forest classifier-based approach in the detection of abnormalities in the retina</article-title>,&#x201D; <source>Medical &#x0026; Biological Engineering &#x0026; Computing</source><italic>, vol.</italic> <volume>57</volume>, no. <issue>1</issue>, pp. <fpage>193</fpage>&#x2013;20, <year>2019</year>.</mixed-citation></ref>
<ref id="ref-8"><label>[8]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>Y.</given-names> <surname>Hatanaka</surname></string-name>, <string-name><given-names>T.</given-names> <surname>Nakagawa</surname></string-name>, <string-name><given-names>Y.</given-names> <surname>Hayashi</surname></string-name>, <string-name><given-names>T.</given-names> <surname>Hara</surname></string-name> and <string-name><given-names>H.</given-names> <surname>Fujita</surname></string-name></person-group>, &#x201C;<article-title>Improvement of automated detection method of hemorrhages in fundus images</article-title>,&#x201D; in <conf-name>2008 30th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society</conf-name>, <conf-loc>Vancouver, British Columbia, Canada</conf-loc>, pp. <fpage>5429</fpage>&#x2013;<lpage>5432</lpage>, <year>2008</year>.</mixed-citation></ref>
<ref id="ref-9"><label>[9]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>L.</given-names> <surname>Tang</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Niemeijer</surname></string-name>, <string-name><given-names>J.</given-names> <surname>Reinhardt</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Garvin</surname></string-name> and <string-name><given-names>M.</given-names> <surname>Abr&#x00E0;moff</surname></string-name></person-group>, &#x201C;<article-title>Splat feature classification with application to retinal haemorrhage detection in fundus images</article-title>,&#x201D; <source>IEEE Transactions on Medical Imaging</source>, vol. <volume>32</volume>, no. <issue>2</issue>, pp. <fpage>364</fpage>&#x2013;<lpage>375</lpage>, <year>2012</year>.</mixed-citation></ref>
<ref id="ref-10"><label>[10]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>J. I.</given-names> <surname>Orlando</surname></string-name>, <string-name><given-names>E.</given-names> <surname>Prokofyeva</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Del Fresno</surname></string-name> and <string-name><given-names>M. B.</given-names> <surname>Blaschko</surname></string-name></person-group>, &#x201C;<article-title>An ensemble deep learning based approach for red lesion detection in fundus images</article-title>,&#x201D; <source>Computer Methods and Programs in Biomedicine</source>, vol. <volume>153</volume>, pp. <fpage>115</fpage>&#x2013;<lpage>127</lpage>, <year>2018</year>.</mixed-citation></ref>
<ref id="ref-11"><label>[11]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>T.</given-names> <surname>Aziz</surname></string-name>, <string-name><given-names>A. E.</given-names> <surname>Ilesanmi</surname></string-name> and <string-name><given-names>C.</given-names> <surname>Charoenlarpnopparut</surname></string-name></person-group>, &#x201C;<article-title>Efficient and accurate hemorrhages detection in retinal fundus images using smart window features</article-title>,&#x201D; <source>Applied Sciences</source>, vol. <volume>11</volume>, no. <issue>14</issue>, pp. <fpage>6391</fpage>, <year>2021</year>.</mixed-citation></ref>
<ref id="ref-12"><label>[12]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>S.</given-names> <surname>Maqsood</surname></string-name>, <string-name><given-names>R.</given-names> <surname>Dama&#x0161;evi&#x010D;ius</surname></string-name> and <string-name><given-names>R.</given-names> <surname>Maskeli&#x016B;nas</surname></string-name></person-group>, &#x201C;<article-title>Hemorrhage detection based on 3D CNN deep learning framework and feature fusion for evaluating retinal abnormality in diabetic patients</article-title>,&#x201D; <source>Sensors</source>, vol. <volume>21</volume>, no. <issue>11</issue>, pp. <fpage>3865</fpage>, <year>2021</year>.</mixed-citation></ref>
<ref id="ref-13"><label>[13]</label><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><given-names>N.</given-names> <surname>Asiri</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Hussain</surname></string-name>, <string-name><given-names>F.</given-names> <surname>Al Adel</surname></string-name> and <string-name><given-names>H.</given-names> <surname>Aboalsamh</surname></string-name></person-group>, &#x201C;<article-title>A deep learning-based unified framework for red lesions detection on retinal fundus images</article-title>,&#x201D; arXiv preprint arXiv: 2109.05021, <year>2021</year>.</mixed-citation></ref>
<ref id="ref-14"><label>[14]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>P.</given-names> <surname>Khojasteh</surname></string-name>, <string-name><given-names>B.</given-names> <surname>Aliahmad</surname></string-name> and <string-name><given-names>D. K.</given-names> <surname>Kumar</surname></string-name></person-group>, &#x201C;<article-title>Fundus images analysis using deep features for detection of exudates, hemorrhages and micro-aneurysms</article-title>,&#x201D; <source>BMC Ophthalmology</source>, vol. <volume>18</volume>, no. <issue>1</issue>, pp. <fpage>1</fpage>&#x2013;<lpage>13</lpage>, <year>2018</year>.</mixed-citation></ref>
<ref id="ref-15"><label>[15]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>Y.</given-names> <surname>Huang</surname></string-name>, <string-name><given-names>L.</given-names> <surname>Lin</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Li</surname></string-name>, <string-name><given-names>J.</given-names> <surname>Wu</surname></string-name>, <string-name><given-names>P.</given-names> <surname>Wang</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<article-title>Automated hemorrhage detection from coarsely annotated fundus images in diabetic retinopathy</article-title>,&#x201D; in <conf-name>Proc. of the 2020 IEEE 17th Int. Symp. on Biomedical Imaging (ISBI)</conf-name>, <conf-loc>Iowa City, IA, USA</conf-loc>, pp. <fpage>1369</fpage>&#x2013;<lpage>1372</lpage>, <year>2020</year>.</mixed-citation></ref>
<ref id="ref-16"><label>[16]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>T. M.</given-names> <surname>Al Sariera</surname></string-name>, and <string-name><given-names>L.</given-names> <surname>Rangarajan</surname></string-name></person-group>, &#x201C;<article-title>Extraction of blood vessels in retina</article-title>,&#x201D; <source>Journal of Information Technology Research (JITR)</source>, vol. <volume>11</volume>, no. <issue>4</issue>, pp. <fpage>122</fpage>&#x2013;13, <year>2018</year>.</mixed-citation></ref>
<ref id="ref-17"><label>[17]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>T. M.</given-names> <surname>Al Sariera</surname></string-name>, <string-name><given-names>L.</given-names> <surname>Rangarajan</surname></string-name> and <string-name><given-names>R.</given-names> <surname>Amarnath</surname></string-name></person-group>, &#x201C;<article-title>Detection and classification of hard exudates in retinal image</article-title>,&#x201D; <source>Journal of Intelligent &#x0026; Fuzzy Systems</source>, vol. <volume>38</volume>, no. <issue>2</issue>, pp. <fpage>1943</fpage>&#x2013;194, <year>2020</year>.</mixed-citation></ref>
<ref id="ref-18"><label>[18]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>D.</given-names> <surname>Ioannou</surname></string-name>, <string-name><given-names>W.</given-names> <surname>Huda</surname></string-name> and <string-name><given-names>A. F.</given-names> <surname>Laine</surname></string-name></person-group>, &#x201C;<article-title>Circle recognition through a 2D hough transform and radius histogramming</article-title>,<italic>&#x201D;</italic> <source>Image and Vision Computing</source>, vol. <volume>17</volume>, no. <issue>1</issue>, pp. <fpage>15</fpage>&#x2013;<lpage>26</lpage>, <year>1999</year>.</mixed-citation></ref>
<ref id="ref-19"><label>[19]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>S. C.</given-names> <surname>Lee</surname></string-name> and <string-name><given-names>Y.</given-names> <surname>Wang</surname></string-name></person-group>, &#x201C;<article-title>A general algorithm of recognizing small, vague and imager-alike objects in a non-uniformly illuminated medical diagnostic image</article-title>,&#x201D; in <conf-name>Conf. Record of Thirty-Second Asilomar Conf. on Signals, Systems and Computers</conf-name>, <conf-loc>Pacific Grove, CA, USA</conf-loc>, pp. <fpage>941</fpage>&#x2013;<lpage>943</lpage>, <year>1998</year>.</mixed-citation></ref>
<ref id="ref-20"><label>[20]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>R. V. J. P. H.</given-names> <surname>K&#x00E4;lvi&#x00E4;inen</surname></string-name> and <string-name><given-names>H.</given-names> <surname>Uusitalo</surname></string-name></person-group>, &#x201C;<article-title>DIARETDB1 diabetic retinopathy database and evaluation protocol</article-title>,&#x201D; in <source>Medical Image Understanding and Analysis</source>, vol. <volume>2007</volume>, pp. <fpage>61</fpage>, <year>2007</year>.</mixed-citation></ref>
<ref id="ref-21"><label>[21]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>T.</given-names> <surname>Walter</surname></string-name>, <string-name><given-names>J. C.</given-names> <surname>Klein</surname></string-name>, <string-name><given-names>P.</given-names> <surname>Massin</surname></string-name> and <string-name><given-names>A.</given-names> <surname>Erginay</surname></string-name></person-group>, &#x201C;<article-title>A contribution of image processing to the diagnosis of diabetic retinopathy-detection of exudates in color fundus images of the human retina</article-title>,&#x201D; <source>IEEE Transactions on Medical Imaging</source>, vol. <volume>21</volume>, no. <issue>10</issue>, pp. <fpage>1236</fpage>&#x2013;<lpage>1243</lpage>, <year>2002</year>.</mixed-citation></ref>
<ref id="ref-22"><label>[22]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>C. A.</given-names> <surname>Lupascu</surname></string-name>, <string-name><given-names>D.</given-names> <surname>Tegolo</surname></string-name> and <string-name><given-names>L.</given-names> <surname>Di Rosa</surname></string-name></person-group>, &#x201C;<article-title>Automated detection of optic disc location in retinal images</article-title>,&#x201D; in <conf-name>21st IEEE Int. Symp. on Computer-Based Medical Systems</conf-name>, <conf-loc>Jyv&#x00E4;skyl&#x00E4;, Finland</conf-loc>, pp. <fpage>17</fpage>&#x2013;<lpage>22</lpage>, <year>2008</year>.</mixed-citation></ref>
<ref id="ref-23"><label>[23]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>S.</given-names> <surname>Bharkad</surname></string-name></person-group>, &#x201C;<article-title>Automatic segmentation of optic disk in retinal images</article-title>,&#x201D; <source>Biomedical Signal Processing and Control</source>, vol. <volume>31</volume>, pp. <fpage>483</fpage>&#x2013;<lpage>498</lpage>, <year>2017</year>.</mixed-citation></ref>
<ref id="ref-24"><label>[24]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>S.</given-names> <surname>Roychowdhury</surname></string-name>, <string-name><given-names>D. D.</given-names> <surname>Koozekanani</surname></string-name> and <string-name><given-names>K. K.</given-names> <surname>Parhi</surname></string-name></person-group>, &#x201C;<article-title>Screening fundus images for diabetic retinopathy</article-title>,&#x201D; in <conf-name>Proc. of the 2012 Conf. Record of the Forty Sixth Asilomar Conf. on Signals, Systems and Computers (ASILOMAR)</conf-name>, <conf-loc>Pacific Grove, CA, USA</conf-loc>, pp. <fpage>1641</fpage>&#x2013;<lpage>1645</lpage>, <year>2012</year>.</mixed-citation></ref>
<ref id="ref-25"><label>[25]</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><given-names>R.</given-names> <surname>Romero-Ora&#x00E1;</surname></string-name>, <string-name><given-names>J.</given-names> <surname>Jim&#x00E9;nez-Garc&#x00ED;a</surname></string-name>, <string-name><given-names>M.</given-names> <surname>Garc&#x00ED;a</surname></string-name>, <string-name><given-names>M. I.</given-names> <surname>L&#x00F3;pez-G&#x00E1;lvez</surname></string-name>, <string-name><given-names>J.</given-names> <surname>Ora&#x00E1;-P&#x00E9;rez</surname></string-name> <etal>et al.,</etal></person-group> &#x201C;<article-title>Entropy rate superpixel classification for automatic red lesion detection in fundus images</article-title>,&#x201D; <source>Entropy</source>, vol. <volume>21</volume>, no. <issue>4</issue>, pp. <fpage>417</fpage>, <year>2019</year>.</mixed-citation></ref>
<ref id="ref-26"><label>[26]</label><mixed-citation publication-type="conf-proc"><person-group person-group-type="author"><string-name><given-names>N.</given-names> <surname>Kleawsirikul</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Gulati</surname></string-name> and <string-name><given-names>B.</given-names> <surname>Uyyanonvara</surname></string-name></person-group>, &#x201C;<article-title>Automated retinal hemorrhage detection using morphological top hat and rule-based classification</article-title>,&#x201D; in <conf-name>3rd Int. Conf. on Intelligent Computational Systems</conf-name>, <conf-loc>singapore</conf-loc>, pp. <fpage>39</fpage>&#x2013;<lpage>43</lpage>, <year>2013</year>.</mixed-citation></ref>
</ref-list>
</back>
</article>