You are on page 1of 33

A Bio-Inspired System for Boundary Detection in Color Natural Scenes

Karin S. Komati (IFES/ Serra), Evandro Salles (UFES), Mario Sarcinelli-Filho (UFES)
1

Input

The only input of our method is the raw image. 2 2

Output

The output is a marked image, like the one presented in 3 slide. this

Edge detection result

Examples
In a natural illumination condition, a scene includes both direct and indirect illumination distributed in a complex way.

Examples
Different pattern structures, in different sizes and rotations. A repetitive pattern but non-regular.

Examples
The border is not very well-defined, that is a ill-defined.

Examples
There is a huge variety of textures.

The Proposed Method

Fully-Unsupervised
There isn't training phase; We don't require input of number of regions; We don't require input of any characteristics of each image; Don't require any parameter-tuning for individual images.
10

10

Human Visual System

P&M
Parvocelular Magnocelular
Retinas parvocellular ganglion Retinas magnocellular ganglion neurons show a low sensitivity to neurons show a high sensitivity to contrast, high spatial resolution, and contrast, low spatial resolution, and low temporal resolution or sustained high temporal resolution or fast responses to visual stimuli. These transient responses to visual cellular characteristics make the stimuli. These characteristics make parvocellular visual path-ways the magnocellular branch of the especially suitable for the analysis of visual system especially suitable to details in the visual world, the quickly detect novel or moving perception of color and maintenance stimuli. of color perception regardless of lighting (color constancy).

Human Visual System


dorsal

ventral

Grossberg Theory
Complementary Computing

FACADE)

The Two Streams Hypothesis

Complementary paths

FACADE

WHAT stream

Image

Multifractal Descriptor

J-image
Region Growing MM-Frac

Controled by the shape of power spectrum of the image

Edge Detection
Enhance Superposed Pixels +
Eliminate or Reduce False Boundaries

= KSS

Result

1) J-Image from original work Deng and Manjunath (2001)

2) Multifractal Measurement
We use the differential box-counting method, proposed by Chaudhuri and Sarkar (1995), to estimate the multifractal measurement (MM) of the original image.
17

17

1/f Spectra of Natural Images


Torralba and Oliva (2003) observed the energy spectra of real-world images falls, in average, into a form 1/f . They also show that the shape of the power spectrum can be used to categorize the different semantic of scenes.

18

Alpha Estimation

Here represents the slope of the decreasing energy spectrum values, from low to high spatial frequencies. 19

19

MM-Frac

mapij = J-valuenorm + (1-norm)MM-value where norm= /max(i), iindexing the 200 images used as training set (provided by BSDS)

20

20

Image

Multifractal Descriptor

J-image
Region Growing MM-Frac

Controled by the shape of power spectrum of the image

Edge Detection
Enhance Superposed Pixels +
Eliminate or Reduce False Boundaries

= KSS

Result

Traditional Approaches
Region-Growing Methods
Result tend to be over-segmented Inaccurate boundaries

Edge-Detection Methods
Noisy edges Gaps

22

23

KSS

23

23

Experimental Results

24

Human Perception

Human percpetion is subjective. Here we present segmentations from 6 different human beings. 25

25

The Berkeley Segmentation Dataset and Benchmark (BSDS)

We tested all methods with natural colored images provided by BSDS test dataset.

100 images of the test dataset 200 images of the training dataset
26

BSDS metrics

Each image has at least 5 hand-labeled segmentations made by human beings, which constitute the ground truth. Precision, Recall and F-measure metrics!

27

Results

28

Results

29

Results

30

Metrics

31

31

Conclusion

One conclusion is that the Multfractal descriptor improves the sensitivity to boundary regions, thus providing segmentation results that match the human perception better than the segmentation results associated with the original JSEG algorithm. The KSS algorithm works well and solves the problem of false boundaries of region-growing approach and keeping the details of edge detection approach. The final results match the human perception better than the individual methods. Unfortunately, the KSS results present broken edges, not keeping the contour closed.
32

Thank you for your attention

33

You might also like