Investigating Different Approaches for Nearest

Neighbours-Based
Jose Augusto S. Lustosa Filho
Postgraduate Program in Systems and Computing
Federal University of Rio Grande do Norte, Natal, BR
Email: jaugusto@ppgsc.ufrn.br

Anne Magaly P. Canuto

Department of Applied Math and Computer Science
Federal University of Rio Grande do Norte, Natal, BR
Email: anne@dimap.ufrn.br

Abstract

Keywords: ensemble, classifiers, diversity, similarity

1. Introduction
2. Ensemble of Classifiers
2.1. Diversity in Ensemble Systems
2.2. Diversity Measures for Ensemble Systems
3. Dynamic Ensemble Selection
4. Experimental work
5. The Experimental Results
6. Conclusions
[1] L. I. Kuncheva, Combining Pattern Classifiers, Methods and Algorithms,
New York, NY: Wiley Interscience, 2005.

[2] Albert Hung-Ren Ko, ”Static and dynamic selection of ensemble of clas-
sifiers” , Ecole de Technologie Superieure(Canada), 2007.

Preprint submitted to Expert Systems with Application January 11, 2019

 [3] Romesh Ranawana and Vasile Palade, ”Multi-Classifier Systems: Re-
view and a roadmap for developers”, in International Journal of Hybrid
Intelligent Systems, v.3 n.1, p.35-61, January 2006.

[4] Ko, A.; Sabourin, R.; Brittojr, A. From dynamic classifier selection to
dynamic ensemble selection. Pattern Recognition, 2008, 41, 17181731.

[5] A. M. P. Canuto, R. G. F. Soares, A. Santana et al (2006), ”Using accu-

racy and diversity to select classifiers to build ensembles.”, in Proceedings
of international joint conference on neural networks,

[6] R. M. Cruz, R. Sabourin, G. D. Cavalcanti, META-DES.H: a dynamic

ensemble selection technique using meta-learning and a dynamic weight-
ing approach,Proceedings of the International Joint Conference on Neu-
ral Networks.,

[7] L. M. Vriesmann, A. S. Britto Jr, L. S. Oliveira, A. L. Koerich, R.

Sabourin, Combining Overall and Local Class Accuracies in an Oracle-
based Method for Dynamic Ensemble Selection.International Joint Con-
ference on Neural Networks IJCNN 2015 , pages 323-329, Killarney,
Ireland, 2015.

[8] W. B. Yates and D. Partridge, ”Use of methodological diversity to im-

prove neural network generalisation”, in Neural Computing Applications,
vol. 4, pp. 114-128, 1996.

[9] R. Banfield, L. Hall, K. Bowyer, and W. Kegelmeyer, ”A new ensem-

ble diversity measure applied to thinning ensemble”, in Multiple Classi-
fier Systems. Fourth International Workshop, MCS 2003, Guilford, UK,
2003, ser. Lecture Notes in Computer Science, T. Windeatt and F. Roli,
Eds., vol. 2709. Springer-Verlag, 2003, pp. 306316.

[10] A. Tsymbal, M. Pechenizkiy, and P. Cunningham, ”Diversity in search

strategies for ensemble feature selection,”, in Information Fusion, vol.6,
no.1, pp.83-98, 2005.

[11] S. Wang and X. Yao, ”Relationships between diversity of classifica-

tion ensembles and single-class performance measures”, in IEEE Trans.
Knowl. Data Eng.,

2
[12] G. Giacinto and F. Roli, ”Design of effective neural network ensembles
for image classification”, in Image Vis. Comput. J., vol. 19, no. 9/10,
pp. 697-705, 2001.

[13] L.M. Vriesmann, A.D. Souza Britto, L. Oliveria, R. Sabourin, and A.H.
Ko, ”Improving a dynamic ensemble selection method based on oracle
information.”, in International Journal of Innovative Computing.

[14] L. Didaci and G. Giacinto, ”Dynamic classifier selection by adaptative

k-nearest-neighbourhood rule”, in International Workshop on Multiple
Classifier Systems (MCS 2004), pp. 174-183.

[15] L. Didaci, G. Giacinto, F. Roli , G. Luca Marcialis, ”Rapid and brief

communication: A study on the performances of dynamic classifier se-
lection based on local accuracy estimation”, in Pattern Recognition, v.38
n.11, p.2188-2191, November, 2005.

[16] Kevin Woods, W. Philip Kegelmeyer, Jr. ,Kevin Bowyer, ”Combina-

tion of Multiple Classifiers Using Local Accuracy Estimates”, in IEEE
Transactions on Pattern Analysis and Machine Intelligence, v.19 n.4,
p.405-410, April 1997.

[17] E.K. Tang, P.N. Suganthan, X. Yao,”An analysis of diversity measures”,

in Mach. Learn. 65, 247271 (2006)

[18] A.H.R. Ko,R. Sabourin, A. de Souza Britto Jr., ”Compound diversity

functions for ensemble selection”, in IJPRAI 23(4), 659686(2009).

[19] V. Bhatnagar, M. Bhardwaj, S. Sharma, S. Haroon, ”Accuracydiversity

based pruning of classifier ensembles”, in Progress in Artificial Intelli-
gence, in 2(2-3), pp. 97-111, 2014.

[20] A. Asuncin and D. J. Newman, in UCI Machine

Learning Repository, University of California at Irvine,
http://ics.uci.edu/ mlearn/MLRepository.html, 2007.

[21] J. Demsar, ”Statistical Comparisons of Classifiers over Multiple Data

Sets”, in Journal of Machine Learning Research, v.7, pp. 1-30, 2006.