1
Locating Texture Boundaries Using a Fast
Unsupervised Approach Based on
Clustering Algorithms Fusion and Level Set
Slides by:
Mehryar Emambakhsh
Sahand University of Technology
2
Outline
 About image segmentation and its methods
 Feature extraction
– Color transformation
– Non-linear diffusion
 Clustering algorithms
– Fusion
 Level set
 Simulation results
 Summary
 References
3
About image segmentation and its
methods
 Image segmentation is a procedure in which
an image is partitioned into its constituting
regions.
 There must be a uniformity in some
predefined features in each region:
– Pixels intensity
– Color components
– Texture features
– Motion vectors
4
About image segmentation and its
methods
 There are many different approaches for
image segmentation:
1) Clustering-based methods  feature space 
clustering algorithms
 Advantage:
– Fast computational speed
 Disadvantages:
– Sensitivity to noise and outliers in the feature space
– Over-segmentation
5
About image segmentation and its
methods
2) Energy minimization methods  feature space
 energy function minimization
 Advantages:
– Reasonable results
– Robust against noise
 Disadvantages:
– High computational complexity
– Sensitive to local minima
6
About image segmentation and its
methods
 Our proposed method:
7
Feature extraction: color
transformation
 Color transformation:
– Non-linear color spaces generate a more
separable feature space compared to linear
color spaces.
– Among non-linear color spaces, CIE L*a*b*,
which is a uniform color space, produces a much
detachable feature space compared to the non-
uniform ones.
8
Feature extraction: non-linear diffusion
 Non-linear diffusion is a method for image de-noising and
simplification.
 It is used for feature extraction from texture in our approach.
 Non-linear diffusion equation is solved on the color image:
 g(.) is a decreasing function of image gradient.
 Non-linear diffusion has many superiority compared to other
texture feature extraction methods:
– Low dimensionality
– Preserving image edges
– Robust against noise
9
Clustering algorithms
 Fuzzy C-means (FCM), K-means, SOM (Self-
Organizing Map), and GMM (Gaussian Mixture
Model) have been evaluated in our work.
 FCM is a clustering technique wherein each data
point belongs to a cluster to some degree that is
specified by a membership degree.
 However, K-means assigns each point to the cluster
whose center (centroid) is nearest.
– Euclidean distance is used in our work because of its better
performance than city-block and Hamming distance criteria.
– Also it is faster that Mahalanobis distance.
10
Clustering algorithms
 The other clustering algorithm that we have
utilized is SOM neural network.
 It is an unsupervised competitive neural
network.
 The structure of the neural network is as
follows:
11
Clustering algorithms
 Finally, GMM is our last clustering algorithm.
 In GMM, each mass of features is modeled as
multivariate normal density function.
 These models are fit to data using expectation
maximization algorithm, which assign a posteriori
probability to each observation.
 The dependency of each pixel to a specific cluster is
determined by examining the value of the probability.
12
Clustering algorithms: fusion
 Choosing a clustering
method depends on the input
data distribution.
– Highly overlapped feature
space  SOM
– Moderately overlapped feature
space  FCM and K-means
– Feature space with suitable
detachability  GMM
 To incorporate these
clustering algorithms, a
fusion of them is used here.
13
Level set
 Unlike previous algorithms, the cluster map
is used to evolve the contour.
 This significantly, decreases the
computational complexity.
14
Simulation results
 Our algorithm has been evaluated on an Intel
Core 2 Due CPU (T7250).
 59 images from Corel texture dataset has been
used.
 The average values for :
 120 and 80 epochs for training the first and the
second SOM stages, respectively.
1543.0,2462.0,3176.0,2819.0 4321 ==== αααα
iα
15
Simulation results
 The input image and the ground
truth
 Color transformation result
 Non-linear diffusion result
16
Simulation results
 The clustering
results
17
Simulation results
 (a) contour
initialization
 (b) 60th
iteration
 (c) 100th
iteration
 (d) The final
segmentation
result
18
Simulation results
 PSNR =
28.22 (db)
 (a) contour
initialization
 (b) 20th
iteration
 (c) 120th
iteration
 (d) The final
segmentation
result
19
Simulation results
 PSNR =
27.63 (db)
 (a) contour
initialization
 (b) 60th
iteration
 (c) 120th
iteration
 (d) The final
segmentation
result
20
Simulation results
 Clustering algorithms performance: PSNR
vs. PCS
21
Simulation results
 Comparison between our algorithm and
traditional level set methods proposed in [1
and 2]
22
Simulation results
23
Simulation results
 PSNR =
28.53 (db)
 (a) The input
image
 (b)
initialization
 (c) 60th
iteration
 (d) The final
segmentation
result
24
Simulation results
 PSNR =
26.72 (db)
 (a) The input
image
 (b)
initialization
 (c) 60th
iteration
 (d) The final
segmentation
result
25
Simulation results
 We claimed that CIE Lab color space is
highly more suitable for setting up a feature
space, instead of RGB color space.
26
Simulation results
27
Summary
 In this paper, a fast level set based method has been
proposed for image segmentation.
 Our algorithm is robust against noise.
 The proposed feature space has much less
dimensionality compared to Gabor and structure
tensors.
 Unlike [1], image gradients have not been calculated,
which decreases the effects of noise.
 Using fusion, significantly increases the
generalization of the clustering algorithms.
28
References
[1] S. Daniel Cremers, M. Rousson, and R. Deriche, "A Review of Statistical Approaches
to level sets Segmentation: Integrating Colour, Texture, Motion and Shape", 2007,
International Journal of Computer Vision 72(2), 195–215
[2] M. Rousson, T. Brox, and R. Deriche, "Active Unsupervised Texture Segmentation on
a Diffusion Based Feature Space", 2003, Proceedings of the 2003 IEEE Computer
Society Conference on Computer Vision and Pattern Recognition (CVPR’03)
29
Thanks for your attention!

More Related Content

PDF
Survey on clustering based color image segmentation
PDF
Segmentation of Color Image using Adaptive Thresholding and Masking with Wate...
PDF
O0342085098
PDF
Image segmentation using advanced fuzzy c-mean algorithm [FYP @ IITR, obtaine...
PDF
A version of watershed algorithm for color image segmentation
PPTX
Image parts and segmentation
PPTX
Comparison of image segmentation
PPTX
Segmentation Techniques -II
Survey on clustering based color image segmentation
Segmentation of Color Image using Adaptive Thresholding and Masking with Wate...
O0342085098
Image segmentation using advanced fuzzy c-mean algorithm [FYP @ IITR, obtaine...
A version of watershed algorithm for color image segmentation
Image parts and segmentation
Comparison of image segmentation
Segmentation Techniques -II

What's hot (20)

PPT
Image segmentation ppt
PDF
Fractal Image Compression of Satellite Color Imageries Using Variable Size of...
PPTX
various methods for image segmentation
PPTX
Images Analysis  in matlab
PDF
Image segmentation based on color
PPTX
Image segmentation
PPTX
rs and gis
PPTX
Image enhancement techniques
PPTX
Segmentation Techniques -I
PPTX
Image enhancement techniques
PDF
Contrast enhancement in digital images
PPTX
Comparative study on image segmentation techniques
PPTX
Image segmentation
PPT
04 image enhancement in spatial domain DIP
PDF
Image Compression using DPCM with LMS Algorithm
PPT
Multimedia image compression standards
PPTX
Image representation
PPT
Image enhancement
PDF
Video Inpainting detection using inconsistencies in optical Flow
PPTX
COM2304: Intensity Transformation and Spatial Filtering – II Spatial Filterin...
Image segmentation ppt
Fractal Image Compression of Satellite Color Imageries Using Variable Size of...
various methods for image segmentation
Images Analysis  in matlab
Image segmentation based on color
Image segmentation
rs and gis
Image enhancement techniques
Segmentation Techniques -I
Image enhancement techniques
Contrast enhancement in digital images
Comparative study on image segmentation techniques
Image segmentation
04 image enhancement in spatial domain DIP
Image Compression using DPCM with LMS Algorithm
Multimedia image compression standards
Image representation
Image enhancement
Video Inpainting detection using inconsistencies in optical Flow
COM2304: Intensity Transformation and Spatial Filtering – II Spatial Filterin...
Ad

Similar to Locating texture boundaries using a fast unsupervised approach based on clustering algorithms fusion and level set (20)

PDF
Survey on clustering based color image segmentation and novel approaches to f...
PDF
Cj36511514
PDF
Automatic Detection of Window Regions in Indoor Point Clouds Using R-CNN
DOC
MODEL-BASED EDGE DETECTOR FOR SPECTRAL IMAGERY USING SPARSE SPATIOSPECTRAL MASKS
PPTX
Presentation for korea multimedia(in english)
PPT
A Hybrid top-down/bottom-up approach for image segmentation incorporating col...
PDF
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
PPTX
Automatic Image Annotation
PPTX
crowd counting.pptx
PDF
Segmentation by Fusion of Self-Adaptive SFCM Cluster in Multi-Color Space Com...
PDF
Ay33292297
PDF
Ay33292297
PDF
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
PDF
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
PDF
Median based parallel steering kernel regression for image reconstruction
PDF
Segmentation of Images by using Fuzzy k-means clustering with ACO
PPTX
BM3D based Multiplicative Noise Removal.pptx
PPTX
Explaining the decisions of image/video classifiers
PPT
regions
DOCX
Multifocus image fusion based on nsct
Survey on clustering based color image segmentation and novel approaches to f...
Cj36511514
Automatic Detection of Window Regions in Indoor Point Clouds Using R-CNN
MODEL-BASED EDGE DETECTOR FOR SPECTRAL IMAGERY USING SPARSE SPATIOSPECTRAL MASKS
Presentation for korea multimedia(in english)
A Hybrid top-down/bottom-up approach for image segmentation incorporating col...
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Automatic Image Annotation
crowd counting.pptx
Segmentation by Fusion of Self-Adaptive SFCM Cluster in Multi-Color Space Com...
Ay33292297
Ay33292297
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
Median based parallel steering kernel regression for image reconstruction
Segmentation of Images by using Fuzzy k-means clustering with ACO
BM3D based Multiplicative Noise Removal.pptx
Explaining the decisions of image/video classifiers
regions
Multifocus image fusion based on nsct
Ad

More from Mehryar (Mike) E., Ph.D. (6)

ODP
Deep Recurrent Neural Network for Multi-target Filtering
PDF
POL-LWIR Vehicle Detection: Convolutional Neural Networks Meet Polarised Infr...
PPT
Automatic MRI brain segmentation using local features, Self-Organizing Maps, ...
PPTX
An Evaluation of Denoising Algorithms for 3D Face Recognition
PPT
Self-dependent 3D face rotational alignment using the nose region
PPT
Using nasal curves matching for expression robust 3D nose recognition
Deep Recurrent Neural Network for Multi-target Filtering
POL-LWIR Vehicle Detection: Convolutional Neural Networks Meet Polarised Infr...
Automatic MRI brain segmentation using local features, Self-Organizing Maps, ...
An Evaluation of Denoising Algorithms for 3D Face Recognition
Self-dependent 3D face rotational alignment using the nose region
Using nasal curves matching for expression robust 3D nose recognition

Recently uploaded (20)

PDF
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
A comparative study of natural language inference in Swahili using monolingua...
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PDF
DP Operators-handbook-extract for the Mautical Institute
PDF
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
PDF
Getting Started with Data Integration: FME Form 101
PPT
What is a Computer? Input Devices /output devices
PDF
CloudStack 4.21: First Look Webinar slides
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
Hybrid model detection and classification of lung cancer
PPTX
The various Industrial Revolutions .pptx
PDF
STKI Israel Market Study 2025 version august
PPTX
Web Crawler for Trend Tracking Gen Z Insights.pptx
PPTX
Chapter 5: Probability Theory and Statistics
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PDF
Hindi spoken digit analysis for native and non-native speakers
PDF
Zenith AI: Advanced Artificial Intelligence
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PPT
Module 1.ppt Iot fundamentals and Architecture
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
A novel scalable deep ensemble learning framework for big data classification...
A comparative study of natural language inference in Swahili using monolingua...
Final SEM Unit 1 for mit wpu at pune .pptx
DP Operators-handbook-extract for the Mautical Institute
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
Getting Started with Data Integration: FME Form 101
What is a Computer? Input Devices /output devices
CloudStack 4.21: First Look Webinar slides
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
Hybrid model detection and classification of lung cancer
The various Industrial Revolutions .pptx
STKI Israel Market Study 2025 version august
Web Crawler for Trend Tracking Gen Z Insights.pptx
Chapter 5: Probability Theory and Statistics
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
Hindi spoken digit analysis for native and non-native speakers
Zenith AI: Advanced Artificial Intelligence
Group 1 Presentation -Planning and Decision Making .pptx
Module 1.ppt Iot fundamentals and Architecture

Locating texture boundaries using a fast unsupervised approach based on clustering algorithms fusion and level set

  • 1. 1 Locating Texture Boundaries Using a Fast Unsupervised Approach Based on Clustering Algorithms Fusion and Level Set Slides by: Mehryar Emambakhsh Sahand University of Technology
  • 2. 2 Outline  About image segmentation and its methods  Feature extraction – Color transformation – Non-linear diffusion  Clustering algorithms – Fusion  Level set  Simulation results  Summary  References
  • 3. 3 About image segmentation and its methods  Image segmentation is a procedure in which an image is partitioned into its constituting regions.  There must be a uniformity in some predefined features in each region: – Pixels intensity – Color components – Texture features – Motion vectors
  • 4. 4 About image segmentation and its methods  There are many different approaches for image segmentation: 1) Clustering-based methods  feature space  clustering algorithms  Advantage: – Fast computational speed  Disadvantages: – Sensitivity to noise and outliers in the feature space – Over-segmentation
  • 5. 5 About image segmentation and its methods 2) Energy minimization methods  feature space  energy function minimization  Advantages: – Reasonable results – Robust against noise  Disadvantages: – High computational complexity – Sensitive to local minima
  • 6. 6 About image segmentation and its methods  Our proposed method:
  • 7. 7 Feature extraction: color transformation  Color transformation: – Non-linear color spaces generate a more separable feature space compared to linear color spaces. – Among non-linear color spaces, CIE L*a*b*, which is a uniform color space, produces a much detachable feature space compared to the non- uniform ones.
  • 8. 8 Feature extraction: non-linear diffusion  Non-linear diffusion is a method for image de-noising and simplification.  It is used for feature extraction from texture in our approach.  Non-linear diffusion equation is solved on the color image:  g(.) is a decreasing function of image gradient.  Non-linear diffusion has many superiority compared to other texture feature extraction methods: – Low dimensionality – Preserving image edges – Robust against noise
  • 9. 9 Clustering algorithms  Fuzzy C-means (FCM), K-means, SOM (Self- Organizing Map), and GMM (Gaussian Mixture Model) have been evaluated in our work.  FCM is a clustering technique wherein each data point belongs to a cluster to some degree that is specified by a membership degree.  However, K-means assigns each point to the cluster whose center (centroid) is nearest. – Euclidean distance is used in our work because of its better performance than city-block and Hamming distance criteria. – Also it is faster that Mahalanobis distance.
  • 10. 10 Clustering algorithms  The other clustering algorithm that we have utilized is SOM neural network.  It is an unsupervised competitive neural network.  The structure of the neural network is as follows:
  • 11. 11 Clustering algorithms  Finally, GMM is our last clustering algorithm.  In GMM, each mass of features is modeled as multivariate normal density function.  These models are fit to data using expectation maximization algorithm, which assign a posteriori probability to each observation.  The dependency of each pixel to a specific cluster is determined by examining the value of the probability.
  • 12. 12 Clustering algorithms: fusion  Choosing a clustering method depends on the input data distribution. – Highly overlapped feature space  SOM – Moderately overlapped feature space  FCM and K-means – Feature space with suitable detachability  GMM  To incorporate these clustering algorithms, a fusion of them is used here.
  • 13. 13 Level set  Unlike previous algorithms, the cluster map is used to evolve the contour.  This significantly, decreases the computational complexity.
  • 14. 14 Simulation results  Our algorithm has been evaluated on an Intel Core 2 Due CPU (T7250).  59 images from Corel texture dataset has been used.  The average values for :  120 and 80 epochs for training the first and the second SOM stages, respectively. 1543.0,2462.0,3176.0,2819.0 4321 ==== αααα iα
  • 15. 15 Simulation results  The input image and the ground truth  Color transformation result  Non-linear diffusion result
  • 16. 16 Simulation results  The clustering results
  • 17. 17 Simulation results  (a) contour initialization  (b) 60th iteration  (c) 100th iteration  (d) The final segmentation result
  • 18. 18 Simulation results  PSNR = 28.22 (db)  (a) contour initialization  (b) 20th iteration  (c) 120th iteration  (d) The final segmentation result
  • 19. 19 Simulation results  PSNR = 27.63 (db)  (a) contour initialization  (b) 60th iteration  (c) 120th iteration  (d) The final segmentation result
  • 20. 20 Simulation results  Clustering algorithms performance: PSNR vs. PCS
  • 21. 21 Simulation results  Comparison between our algorithm and traditional level set methods proposed in [1 and 2]
  • 23. 23 Simulation results  PSNR = 28.53 (db)  (a) The input image  (b) initialization  (c) 60th iteration  (d) The final segmentation result
  • 24. 24 Simulation results  PSNR = 26.72 (db)  (a) The input image  (b) initialization  (c) 60th iteration  (d) The final segmentation result
  • 25. 25 Simulation results  We claimed that CIE Lab color space is highly more suitable for setting up a feature space, instead of RGB color space.
  • 27. 27 Summary  In this paper, a fast level set based method has been proposed for image segmentation.  Our algorithm is robust against noise.  The proposed feature space has much less dimensionality compared to Gabor and structure tensors.  Unlike [1], image gradients have not been calculated, which decreases the effects of noise.  Using fusion, significantly increases the generalization of the clustering algorithms.
  • 28. 28 References [1] S. Daniel Cremers, M. Rousson, and R. Deriche, "A Review of Statistical Approaches to level sets Segmentation: Integrating Colour, Texture, Motion and Shape", 2007, International Journal of Computer Vision 72(2), 195–215 [2] M. Rousson, T. Brox, and R. Deriche, "Active Unsupervised Texture Segmentation on a Diffusion Based Feature Space", 2003, Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’03)
  • 29. 29 Thanks for your attention!