Manifold Learning and Visualization Based on Dynamic Self-Organizing Map

Chao Shao, Chunhong Wan, Haitao Hu

Abstract


For the data sampled from a low-dimensional nonlinear manifold embedded in a high-dimensional space, such as Swiss roll and S-curve, Self-Organizing Map (SOM) tends to get stuck in local minima and then yield topological defects in the final map. To avoid this problem and obtain more faithful visualization results, a variant of SOM, i.e. Dynamic Self-Organizing Map (DSOM), was presented in this paper. DSOM can dynamically increase the map size, as the training data set is expanded according to its intrinsic neighborhood structure, starting from a small neighborhood in which the data points can lie on or close to a linear patch. According to the locally Euclidean nature of the manifold, the map can be guided onto the manifold surface and then the global faithful visualization results can be achieved step by step. Experimental results show that DSOM can discover the intrinsic manifold structure of the data more faithfully than SOM. In addition, as a new manifold learning method, DSOM can obtain more concise visualization results and be less sensitive to the neighborhood size and the noise than typical manifold learning methods, such as Isometric Mapping (ISOMAP) and Locally Linear Embedding (LLE), which can also be verified by experimental results.

Keywords


manifold learning; self-organizing map; topological defect; neighborhood structure; robustness

Full Text:

PDF

References


BELKIN M., NIYOGI P. Laplacian Eigenmaps for dimensionality reduction and data representation. Neural Computation. 2003, 15(6), pp. 1373-1396, doi: 10.1162/089976603321780317.

GUAN H., TURK M. 3D hand pose reconstruction with ISOSOM. In: Proceedings of the 1st international conference on Advances in Visual Computing (ISVC 2005), Lake Tahoe, Nevada: Springer-Verlag, 2005, pp. 630-635.

KOHONEN T. Self-organized formation of topologically correct feature maps. Biological Cybernetics. 1982, 43(1), pp. 59-69, doi: 10.1007/BF00337288.

MURAKOSHI K., SATO Y. Reducing topological defects in self-organizing maps using multiple scale neighborhood functions. Biosystems. 2007, 90(1), pp. 101-104, doi: 10.1016/j.biosystems.2006.07.004.

OTA K., AOKI T., KURATA K., AOYAGI T. Asymmetric neighborhood functions accelerate ordering process of self-organizing maps. Physical Review E. 2011, 83(2 Pt 1), pp. 021903-(1-9), doi: 10.1103/PhysRevE.83.021903.

OZAKI K., SHIMBO M., KOMACHI M., MATSUMOTO Y. Using the mutual k-nearest neighbor graphs for semi-supervised classification of natural language data. In: Proceedings of the 15th Conference on Computational Natural Language Learning (CoNLL 2011), Portland, Oregon, USA: Association for Computational Linguistics, 2011, pp. 154-162.

ROWEIS S., SAUL L. Nonlinear dimensionality reduction by locally linear embedding. Science. 2000, 290(5500), pp. 2323-2326, doi: 10.1126/science.290.5500.2323.

SAXENA A., GUPTA A., MUKERJEE A. Non-linear dimensionality reduction by locally linear isomaps. In: Proceedings of the 11th International Conference on Neural Information Processing (ICONIP 2004), Calcutta, India: Springer-Verlag, 2004, pp. 1038-1043.

SHAO C., WAN C. Selection of the neighborhood size for manifold learning based on Bayesian information criterion. Journal of Computational Information Systems. 2012, 8(7), pp. 3043-3050. Available from: http://www.jofcis.com/publishedpapers/2012 8 7 3043 3050.pd.

SHI C., ZHANG S., SHI Z.Z. Geodesic distance based SOM for image clustering. In: Proceedings of the 2006 International Conference on Sensing, Computing and Automation (ICSCA 2006), Chongqing, China: Watam, 2006, pp. 2483-2488.

SIMILĂ„ T. Self-organizing map learning nonlinearly embedded manifolds. Information Visualization. 2005, 4(1), pp. 22-31, doi: 10.1057/palgrave.ivs.9500088.

TENENBAUM J. Mapping a manifold of perceptual observations. In: Proceedings of the 1997 conference on Advances in neural information processing systems (NIPS 1997), Cambridge, MA, USA: MIT, 1997, pp. 682-688.

TENENBAUM J., DE SILVA V., LANGFORD J. A global geometric framework for nonlinear dimensionality reduction. Science. 2000, 290(5500), pp. 2319-2323, doi: 10.1126/science.290.5500.2319.

VESANTO J. SOM-based data visualization methods. Intelligent Data Analysis. 1999, 3(2), pp. 111-126, doi: 10.1016/S1088-467X(99)00013-X.




DOI: http://dx.doi.org/10.14311/NNW.2015.25.009

Refbacks

  • There are currently no refbacks.


Should you encounter an error (non-functional link, missing or misleading information, application crash), please let us know at nnw.ojs@fd.cvut.cz.
Please, do not use the above address for non-OJS-related queries (manuscript status, etc.).
For your convenience we maintain a list of frequently asked questions here. General queries to items not covered by this FAQ shall be directed to the journal editoral office at nnw@fd.cvut.cz.