Multi expression programming

Multi Expression Programming (MEP) is an evolutionary algorithm for generating mathematical functions describing a given set of data. MEP is a Genetic Programming variant encoding multiple solutions in the same chromosome. MEP representation is not specific (multiple representations have been tested). In the simplest variant, MEP chromosomes are linear strings of instructions. This representation was inspired by Three-address code. MEP strength consists in the ability to encode multiple solutions, of a problem, in the same chromosome. In this way, one can explore larger zones of the search space. For most of the problems this advantage comes with no running-time penalty compared with genetic programming variants encoding a single solution in a chromosome.Oltean M.; Dumitrescu D.:
Multi Expression Programming
, Technical report, Univ. Babes-Bolyai, Cluj-Napoca, 2002Oltean M.; Grosan C.:
Evolving Evolutionary Algorithms using Multi Expression Programming
, The 7th European Conference on Artificial Life, September 14–17, 2003, Dortmund, Edited by W. Banzhaf (et al), LNAI 2801, pp. 651-658, Springer-Verlag, Berlin, 2003Oltean M.; Grosan C.:
Evolving Digital Circuits using Multi Expression Programming
, NASA/DoD Conference on Evolvable Hardware, 24–26 June, Seattle, Edited by R. Zebulum (et al.), pages 87-90, IEEE Press, NJ, 2004

Representation

MEP chromosomes are arrays of instructions represented in Three-address code format.

Each instruction contains a variable, a constant, or a function. If the instruction is a function, then the arguments (given as instruction's addresses) are also present.

Example of MEP program

Here is a simple MEP chromosome (labels on the left side are not a part of the chromosome):

1: a
2: b
3: + 1, 2
4: c
5: d
6: + 4, 5
7: * 3, 5

Fitness computation

When the chromosome is evaluated it is unclear which instruction will provide the output of the program. In many cases, a set of programs is obtained, some of them being completely unrelated (they do not have common instructions).

For the above chromosome, here is the list of possible programs obtained during decoding:

E1 = a,
E2 = b,
E4 = c,
E5 = d,
E3 = a + b.
E6 = c + d.
E7 = (a + b) * d.

Each instruction is evaluated as a possible output of the program.

The fitness (or error) is computed in a standard manner. For instance, in the case of symbolic regression, the fitness is the sum of differences (in absolute value) between the expected output (called target) and the actual output.

Fitness assignment process

Which expression will represent the chromosome? Which one will give the fitness of the chromosome?

In MEP, the best of them (which has the lowest error) will represent the chromosome. This is different from other GP techniques: In Linear genetic programming the last instruction will give the output. In Cartesian Genetic Programming the gene providing the output is evolved like all other genes.

Note that, for many problems, this evaluation has the same complexity as in the case of encoding a single solution in each chromosome. Thus, there is no penalty in running time compared to other techniques.

Software

MEPX

MEPX is a cross-platform (Windows, macOS, and Linux Ubuntu) free software for the automatic generation of computer programs. It can be used for data analysis, particularly for solving symbolic regression, statistical classification and time-series problems.

libmep

Libmep
is a free and open source library implementing Multi Expression Programming technique. It is written in C++.

hmep

hmep
is a new open source library implementing Multi Expression Programming technique in Haskell programming language.

See also

* Genetic programming
* Cartesian genetic programming
* Gene expression programming
* Grammatical evolution
* Linear genetic programming

Notes

External links

Multi Expression Programming websiteMulti Expression Programming source code

Genetic programming
Genetic algorithms
Evolutionary algorithms
Machine learning algorithms
Regression and curve fitting software