A New Classification Algorithm: Optimally Generalized Learning Vector Quantization (OGLVQ)

Turgay Temel

Abstract


We present a new Generalized Learning Vector Quantization classifier called Optimally Generalized Learning Vector Quantization based on a novel weight-update rule for learning labelled samples. The algorithm attains stable prototype/weight vector dynamics in terms of estimated current and previous weights and their updates. Resulting weight update term is then related to the proximity measure used by Generalized Learning Vector Quantization classifiers. New algorithm and some major counterparts are tested and compared for synthetic and publicly available datasets. Results reveal that new classifier is faster in training and is more successful and robust in classifying test samples of datasets studied than the counterparts it is compared.

Keywords


Classification; machine learning; supervised learning; learning vector quantization

Full Text:

PDF

References


BACKHAUS A., SEIFFERT U. Classication in high-dimensional spectral data: Accuracy

vs. Spectral data: Accuracy vs. interpretability vs. model size. Neurocomputing. 2014, 131(5),

pp. 15{22, doi: 10.1016/j.neucom.2013.09.048.

BOUBEZOUL A., PARIS S., OULADSINE M. Application of the cross entropy method to

the GLVQ algorithm. Pattern Recognition. 2008, 41, pp. 3173{3178, doi: 10.1016/j.patcog.

03.016.

CATARON A., ANDONIE R. Energy Generalized LVQ with Relevance Factors. In: Pro-

ceedings of IEEE International Joint Conference on Neural Networks (IJCNN 2004). 2004,

pp. 1421{1426, doi: 10.1109/IJCNN.2004.1380159.

HAMMER B., STRICKERT M., VILLMANN T. On the generalization ability of

GRLVQ networks. Neural Processing Lett. 2005, 21(2), pp. 109{120, doi: 10.1007.

s11063-004-1547-1.

JANARDHANAN S., BANDYOPADHYAY B. On Discretization of Continuous-Time Terminal

Sliding Mode. IEEE Trans. Automatic Control. 2006, 51(9), pp. 1532{1536, doi: 10.

/TAC.2006.880805.

KADEN M., LANGE M., NEBEL D., RIEDEL M., GEWENIGER T., VILLMANN T.

Aspects in Classication Learning-Review of Recent, Developments in Learning Vector

Quantization. Foundations of Computing and Decision Sciences, 2014, 39(1), pp. 79{105,

doi: 10.2478/fcds-2014-0006.

KASTNER M., HAMMER B., BIEHL M., VILLMANN T. Functional relevance learning

in generalized learning vector quantization. Neurocomputing. 2012, 90, pp. 85{95, doi: 10.

/j.neucom.2011.11.029.

KOHONEN T. Self-Organized Formation of Topologically Correct Feature Maps. Biological

Cybernetics. 1982, 43(1), pp. 59{69, doi: 10.1007/bf00337288.

LLOYD G.R., BRERETON R.G., FARIA R., DUNCAN J.C. Learning Vector Quantization

for Multiclass Classication:? Application to Characterization of Plastics. Jour. of Chem.

Info. Model. 2007, 47(4), pp. 1553{1563, doi: 10.1021/ci700019.

NOVA D., ESTEVEZ P. A review of learning vector quantization classiers. Neural Com-

puting and Applications, 2013, 25(3-4), pp. 511{524, doi: 10.1007/s00521-013-1535-3.

SATO A., YAMADA K. Generalized learning vector quantization. Advances in Neural In-

formation Processing Systems. 1996, pp. 423{429. Available from: https://papers.nips.

cc/paper/1113-generalized-learning-vector-quantization.pdf.

SCHMIDT M., BABANEZHAD R., AHMED M.O., DEFAZIO A., CLIFTON A., SARKAR

A. Non-Uniform Stochastic Average Gradient Method for Training Conditional Random

Fields. arXiv preprint. 2015. Available from: arXiv:1504.04406 [stats.ML].

TEMEL T., KARLIK B. An improved odor recognition system using learning vector quantization

with a new discriminant analysis. Neural Network World. 2007, 17(4), pp. 287{294.

TEMEL T. Biologically-inspired Learning: An Overview and Application to Odor Recognition.

In: T. TEMEL, ed. System and Circuit Design for Biologically-Inspired In-

telligent Learning. Hershey, PA, USA: IGI Global, 2010, pp. 59{92, doi: 10.4018.

-1-60960-018-1.ch004.

TEMEL T., ASHRAFIUON H. Sliding-mode control approach for faster tracking. IET Elect.

Lett. 2012, 48(15), pp. 916{917,doi: 10.1049/el.2012.1576.

TEMEL T., ASHRAFIUON H. Sliding-mode speed controller for tracking of underactuated

surface vessels with extended Kalman lter. IET Elect. Lett. 2015, 51(6), pp. 467{469,

doi: 10.1049/el.2014.4516?.

WILLIAMS B.L. UCI Machine Learning Repository, Irvine, CA, Character Trajectories

Data Set. 2008, School of Informatics, University of Edinburgh, UK. Available from: http:

//archive.ics.uci.edu/ml/machine-learning-databases/character-trajectories/.




DOI: http://dx.doi.org/10.14311/NNW.2017.031

Refbacks

  • There are currently no refbacks.


Should you encounter an error (non-functional link, missing or misleading information, application crash), please let us know at nnw.ojs@fd.cvut.cz.
Please, do not use the above address for non-OJS-related queries (manuscript status, etc.).
For your convenience we maintain a list of frequently asked questions here. General queries to items not covered by this FAQ shall be directed to the journal editoral office at nnw@fd.cvut.cz.