- LVQ
LVQ, or Learning Vector Quantization, is a prototype-based supervised classification
algorithm .LVQ can be understood as a special case of an
artificial neural network , more precisely, it applies awinner-take-all Hebbian learning -based approach. It is a precursor toSelf-organizing map s (SOM) and related toNeural gas , and to thek-Nearest Neighbor algorithm (k-NN). LVQ was invented byTeuvo Kohonen .The network has two layers: a layer of input neurons, and a layer of output neurons. The network is given by prototypes W=(w(i),...,w(n)). It changes the weights of the network in order to classify the data correctly. For each data point, the prototype (neuron) that is closest to it is determined (called the winner neuron). The weights of the connections to this neuron are then adapted, i.e. made closer if it correcly classifies the data point or made less similar if it incorrectly classifies it.
An advantage of LVQ is that it creates prototypes that are easy to interpret for experts in the field.
LVQ can be a source of great help in classifying text documents.
References
* [http://www.cis.hut.fi/panus/papers/dtwsom.pdf Self-Organizing Maps and Learning Vector Quantization for Feature Sequences, Somervuo and Kohonen. 2004] (pdf)
* [http://www.ansijournals.com/itj/2007/154-159.pdf Classification of Textual Documents using LVQ, Fahad and Sikander. 2007] (pdf)See also
*
Self-organizing map External links
* [http://fuzzy.cs.uni-magdeburg.de/~borgelt/doc/lvqd/ Introduction to the algorithm. Plus download of codes and programs implementing it (University of Magdeburg)]
* [http://wekaclassalgos.sourceforge.net/ LVQ for WEKA] : Implementation of LVQ variants (LVQ1, OLVQ1, LVQ2.1, LVQ3, OLVQ3) for the WEKA Machine Learning Workbench.
Wikimedia Foundation. 2010.