Bias-variance decomposition in Genetic Programming

• Autorzy: Taras Kowaliw , René Doursat
• Języki publikacji: EN

Abstrakty

EN

We study properties of Linear Genetic Programming (LGP) through several regression and classification benchmarks. In each problem, we decompose the results into bias and variance components, and explore the effect of varying certain key parameters on the overall error and its decomposed contributions. These parameters are the maximum program size, the initial population, and the function set used. We confirm and quantify several insights into the practical usage of GP, most notably that (a) the variance between runs is primarily due to initialization rather than the selection of training samples, (b) parameters can be reasonably optimized to obtain gains in efficacy, and (c) functions detrimental to evolvability are easily eliminated, while functions well-suited to the problem can greatly improve performance-therefore, larger and more diverse function sets are always preferable.

Słowa kluczowe

EN

Analysis of algorithms; Bias-variance decomposition; Classification; Computational learning theory; Evolutionary computation; Genetic programming; Learning and adaptive systems; Non-parametric inference; Regression

Kategorie tematyczne

• 68Q32: Computational learning theory
• 68T05: Learning and adaptive systems
• 62G08: Nonparametric regression
• 68W40: Analysis of algorithms
• 62J10: Analysis of variance and covariance

• Wydawca: De Gruyter Open
• Czasopismo: Open Mathematics
• Rocznik: 2016
• Tom: 14
• Numer: 1
• Strony: 62-80

Daty

wydano

2016-01-01

otrzymano

2014-11-25

zaakceptowano

2015-01-07

online

2016-02-13

Twórcy

autor

Taras Kowaliw

• Institut des Systèmes Complexes Paris Île-de-France (ISC-PIF), Centre National de la Recherche Scientifique (CNRS UPS3611), 113 rue Nationale, 75013 Paris,

autor

René Doursat

• Informatics Research Centre, School of Computing, Mathematics & Digital Technology, Manchester Metropolitan University, John Dalton Building, Chester Street, Manchester M1 5GD,

Identyfikatory

DOI

10.1515/math-2016-0005