Information model of resonance phenomena in brain neural networks
DOI:
https://doi.org/10.14311/NNW.2018.%25xAbstract
The paper presents an information model for representation of brain linear and nonlinear resonance phenomena based on information nullors. In the brain functions the rhythms and quasi periodicity of processes in neural networks play the outstanding role. It is why adaptive resonance theory (ART) including resonant effects is for long time studied by many authors. The periodicity in the transfers of signals between the long-term memory (LTM) and short-term memory (STM) creates possibility of resonance system structure. LTM with information content representing expectations and STM covering sensory information in resonance process offer an effective learning. Nonlinear adaptive resonance creates condition for a new knowledge, or inventory observation. In the paper this feature is newly modelled by information gyrator that best suits for these linear and non-linear phenomena.
References
Brown, J.W., Bullock, D., and Grossberg, S. (2004). How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades. Neural Networks, 17, 471-510.
Braun, J.: Topological analysis of networks with nullators and norators. Electronic Letters 2, 1966, 427-428.
Cai, Y., Wang, J.-Z., Tang, Y., and Yang, Y.-C. (2011). An efficient approach for electric load forecasting using distributed ART (adaptive resonance theory) & HS-ARTMAP (Hyper-spherical ARTMAP network) neural network. Energy, 36, 1340-1350.
Cao, Y., Grossberg, S., and Markowitz, J. (2011). How does the brain rapidly learn and reorganize view and positionally - invariant object representations in inferior temporal cortex, Neural Networks. 24. 1050-1061.
Carpenter, G.A., Martens, S., and Ogas, O.J. (2005). Self-organizing information fusion and hierarchical knowledge discovery: a new framework using ARTMAP neural networks. Neural Networks, 18, 287-295.
Grossberg, S. (1968a). A prediction theory for some nonlinear functional-differential equations, II: Learning of patterns. Journal of Mathematical Analysis and Applications, 22, 490-522.
Grossberg, S. (1968b). Some physiological and biochemical consequences of psychological postulates. Proceedings of the National Academy of Sciences, 60, 758-765.
Grossberg, S. (1988) Nonlinear neural networks: Principles, mechanisms, and architectures. Neural Networks, 1, 17-61.
Grossberg, S. (2012). Adaptive Resonance Theory: How a brain learns to consciously attend, learn, and recognize a changing world. Neural Networks, 37, 1-47.
Grossberg, S., and Pearson, L. (2008). Laminar cortical dynamics of cognitive and motor working memory, sequence learning and performance: Toward a unified theory of how the cerebral cortex works. Psychological Review, 115, 677-732.
Martinelli, G.: On the nullor. Proceedings of the IEEE, March 1965, 332-333.¨
Moos, P.: Aplications of mutators in active RC networks. Proceedings of the Conference “Summer School on Circuit Theory, Prague, 1994.
Moos, P. Nullor Models of Quasilinear and nonlinear elements, Studie ACADEMIA 8-83 CAS, Prague 1983.
Novak, M. and all. : Artificial Neural networks, C. H. Beck, 1998, (in Czech: Teorie a syntéza umělých neuronových sítí) .
Novák M.: Theory of system tolerances, Academia, 1987 (in Czech: Teorie tolerancí systémů)
Novak M., Votruba Z.: Theory of System Complexes Reliability, Aracne edit., Roma, 2018, ISBN 178-88-255-0801-7
Pilly, P.K. and Grossberg, S, How do spatial learning and memory occur in the brain? Coordinated learning of entorhinal grid cells and hippocampal place cells. Journal of Cognitive Neuroscience May; 24(5):1031-54. doi: 10.1162/jocn_a_00200. Epub 2012 Jan 30.
Svítek M. (2015) Towards Complex System Theory, In: Neural Network World 2015, vol. 25, no. 1, p. 241-247. ISSN 1210-0552.
Wienke, D., and Buydens, L. (1995). Adaptive resonance theory based neural networks—the “ART” of real-time pattern recognition in chemical process monitoring. Trends in Analytical Chemistry, 14, 398-406.
Vlček, J.: (1999) Systems Engineering (in Czech: Systémové inženýrství), CTU in Prague ISBN 80-01-01905-5
Svítek M., Votruba Z., Moos P. (2010) Towards Information Circuits, In: Neural Network World 2010, vol. 20, no. 2, p. 241-247. ISSN 1210-0552.
Thom, René. Structural Stability and Morphogenesis: An Outline of a General Theory of Models. Reading, MA: Addison-Wesley, 1989. ISBN 0-201-09419-3.
Pilly, P.K. and Grossberg, S, How do spatial learning and memory occur in the brain? Coordinated learning of entorhinal grid cells and hippocampal place cells. Journal of Cognitive Neuroscience May;24(5):1031-54. doi: 10.1162/jocn_a_00200. Epub 2012 Jan 30.
Published
Issue
Section
License
Only original research papers (not published or not simultaneously submitted to another journal) will be reviewed. Before the article is printed, the authors are required to transfer the copyright of the published article to the publisher. The copyright transfer form can be downloaded here: http://www.nnw.cz/copyright.html or here.
Effective upon acceptance for publication in NNW, copyright (including all rights there under and including the right to authorise dissemination, distribution, photocopying and reproduction in all media, whether separately or as a part of a journal issue or otherwise) in the work and any modifications of it by the authors is hereby transferred throughout the world and for the full term and all extensions and renewals thereof, to CTU as a representative of publishers of NNW.
The following rights are retained by the author(s):
- Patent and trademark rights and rights to any process or procedure described in the work.
- The right to photocopy or make single electronic copies of the work for their own personal use, including for their own classroom use, or for the personal use of colleagues, provided that the copies are not offered for sale and are not distributed ina systematic way outside of their employing institution. Posting of a preprint version of the work on an public server is permitted. Posting of the published work on a secure network (not accessible to the public) within the Author's institution is permitted. However, posting of the published work on an electronic public server can only be done with written permission of CTU as a representative of the publishers of NNW.
- The right, subsequent to publication, to use the work or any part there of free of charge in a printed compilation of works of their own, such as collected writings or lecture notes, in a thesis, or to expand the work into book-length form for publication.
All copies, paper or electronic or other use of the work must include an indication of the copyright ownership and a full citation of the journal source.
Abstracting is permitted with credit to the source. For all other copying, reprint or republication permission write to the Czech Technical University in Prague.
Responsibility for the contents of all the publisher papers and letters rests upon the authors and not upon the editors of the NNW.