Influence of pRNGs onto GPA-ES behaviors

Tomáš Brandejský

Abstract


The main aim of this paper is to investigate if the evolutionary algorithms (EAs) can be influenced by (pseudo) Random Number Generators ((p)RNGs) and if different evolutionary operators applied within EAs requires different features of (p)RNGs. This question is significant especially if genetic programming is applied to symbolic regression task with the aim to produce human expert comparable results because such task requires massive computations.

Experiments were performed on GPA-ES algorithm combining genetic programming algorithm (GPA) for structure development and evolutionary strategy (ES) algorithm for parameter optimization. This algorithm is described bellow and it applies extended scale of different evolutionary operators (additional individuals generating, symmetric crossover, mutations, and one point crossover). These experiments solved problem of symbolic regression of dynamic system. The number of iterations needed for required quality of regression was used as the measure of (p)RNG influence. These experiments point that different (p)RNGs fit to different evolutionary operators, that some combinations (p)RNGs are better than others and that some theoretically excellent (p)RNGs produces poor results. Presented experiments point that the efficiency of evolutionary algorithms might be increased by application of more (p)RNGs in one algorithm optimised for each particular evolutionary operator.

 


Keywords


(pseudo) Random Number Generator ((p)RNG); Genetic Programming Algorithm (GPA); Evolutionary Strategy (ES); GPA-ES algorithm; sensitivity to (p)RNG properties

Full Text:

PDF

References


Bastos-Filho C.J.A., Oliveira Junior M.A.C., Nascimento D.N.O., Ramos A. D. Impact of the

Random Number Generator Quality on Particle Swarm Optimization Algorithm Running on

Graphic Processor Units. Conference: 10th International Conference on Hybrid Intelligent

Systems (HIS 2010), Atlanta, GA, USA, August, 2010, 23-25, Curran Associates, Inc. ISBN

, doi: 10.1109/HIS.2010.5601073.

Brandejsky T. Limited randomness evolutionary strategy algorithm. In: Matousek R. (ed.):

Mendel 2015. Springer, 2015, pp. 53{62, ISBN 978-3-319-19824-8.

Brandejsky T. Multi-layered evolutionary system suitable to symbolic model regression. In:

Nikos Mastorakis, Metin Demiralp, and N. A. Baykara (Eds.) Proceedings of the 2nd interna-

tional conference on Applied informatics and computing theory (AICT'11). World Scientic

and Engineering Academy and Society (WSEAS), Stevens Point, Wisconsin, USA, 2011, pp.

{225. ISBN 978-1-61804-034-3

Brandejsky T. Evolutionary system to model structure and parameters regression, Neural

Network World. 2012, 22(2), pp. 181{194. ISSN 1210-0552, doi: 10.14311/NNW.2012.22.011.

Brandejsky T. Analysis of Genetic Algorithm Behavior. In: Matousek R., ed. Mendel

Mendel 2012 { 18th International Conference on Soft Computing. Brno, 27.06.2012

{ 29.06.2012. Brno: VUT v Brne, Faculty of mechanical engineering, 2012, pp. 76{80. ISSN

-3814. ISBN 978-80-214-4540-6.

Brandejsky T., Zelinka I. Specic behaviour of GPA-ES evolutionary system observed

in deterministic chaos regression. In: Nostradamus : Modern Methods of Prediction,

Modelling and Analysis of Nonlinear Systems. Heidelberg, Springer, 2013, pp. 73{81.

ISSN 2194-5357. ISBN 978-3-642-33226-5, https://link.springer.com/chapter/10.1007.

-3-642-33227-2_10.

Cantu-Paz E. On Random Numbers and the Performance of Genetic Algorithms. GECCO

: Proceedings of the Genetic and Evolutionary Computation Conference, New York,

USA, 2002, pp. 311{318, Morgan Kaufmann.

Cardenas-Montes M., Vega-Rodrguez M.A., Gomez-Iglesias A. Sensitiveness of Evolution-

ary Algorithms to the Random Number Generator. In: Dobnikar, A. Ster, U., Branko L.

Adaptive and Natural Computing Algorithms: 10th International Conference, ICANNGA

, Ljubljana, Slovenia, April 14{16, Proceedings, Part I, 2011, pp. 371{380, Springer,

Berlin, Heidelberg, ISBN 978-3-642-20282-7, doi: 10.1007/978-3-642-20282-7_38.

James F. A review of pseudorandom number generators. Computer Physics Communications.

, 60, pp. 329{344, North-Holland.

Koza J.R. Genetic Programming: On the Programming of Computers by Means of Natural

Selection, MIT Press, 1992. ISBN 0-262-11170-5

Koza J.R., Bennett F.H., Andre D., Keane M.A. Genetic Programming III: Darwinian

Invention and Problem Solving, Morgan Kaufmann, 1999. ISBN 1-55860-543-6

Kr}omer P., Snasel V., Platos J., Husek D. Genetic algorithms for the linear ordering problem,

Neural Network World. 2009, 19, pp. 65{80, CTU in Prague.

Langdon W.B., Poli R. Foundations of Genetic Programming. Springer, New York, eidelberg,

Berlin, 1998. ISBN 978-3-662-04726-2

Brandejsky T.: In

uence of (p)RNGs onto GPA-ES behaviors

Poli R., Langdon W.B., McPhee N.F. A eld guide to genetic programming, Lulu Enterprises,

UK Ltd (March 26, 2008), ISBN-13: 978-1409200734

Senkerik R., Davendra D.D., Zelinka I., Pluhacek M., Kominkova-Oplatkova Z. Chaos Driven

Dierential Evolution with Lozi Map in the Task of Chemical Reactor Optimization. Lecture

Notes in Computer Science. Volume 7895, Springer, 2013, pp. 56{66.

Senkerik R., Davendra D.D., Zelinka I., Pluhacek M., Kominkova-Oplatkova Z.: On The Dif-

ferential Evolution Driven By Selected Discrete Chaotic Systems: Extended Study. Mendel

: 19th International Conference on Soft Computing : June 26-28, 2013, Brno, Czech

Republic, Brno University of Technology, 2013, pp. 137{144.

Senkerik R., Pluhacek M., Davendra D.D., Zelinka I., Kominkova-Oplatkova Z.: Chaos

Driven Evolutionary Algorithm: a New Approach for Evolutionary Optimization. Recent

advances in systems, control and informatics: proceedings of the 2013 International con-ference on systems, control and informatics (SCI 2013) : September 28{30, 2013, Venice,

Italy, WSEAS Press, 2013, pp. 117{122.

Senkerik R., Pluhacek M., Kominkova-Oplatkova Z.: Simulation of time-continuous chaotic

systems for the generating of random numbers. Latest Trends on Systems { Volume II.

Proceedings of the 18th International Conference on Systems (part of CSCC '14). Santorini

Island, Greece, July 17{21, 2014, pp. 557-561, ISSN: 1790-5117, ISBN: 978-1-61804-244-6.

GPA benchmarks, http://www.gpbenchmarks.org/wiki/index.php?title$=$Problem.

Classification, accessed 21st July 2017.




DOI: http://dx.doi.org/10.14311/NNW.2017.033

Refbacks

  • There are currently no refbacks.


Should you encounter an error (non-functional link, missing or misleading information, application crash), please let us know at nnw.ojs@fd.cvut.cz.
Please, do not use the above address for non-OJS-related queries (manuscript status, etc.).
For your convenience we maintain a list of frequently asked questions here. General queries to items not covered by this FAQ shall be directed to the journal editoral office at nnw@fd.cvut.cz.