HeuristicLab is a software environment for
heuristic
A heuristic (; ), or heuristic technique, is any approach to problem solving or self-discovery that employs a practical method that is not guaranteed to be optimal, perfect, or rational, but is nevertheless sufficient for reaching an immediate ...
and
evolutionary algorithm
In computational intelligence (CI), an evolutionary algorithm (EA) is a subset of evolutionary computation, a generic population-based metaheuristic optimization algorithm. An EA uses mechanisms inspired by biological evolution, such as reproduct ...
s, developed by members of the Heuristic and Evolutionary Algorithm Laboratory (HEAL) at the
University of Applied Sciences Upper Austria, in
Hagenberg im Mühlkreis
Hagenberg im Mühlkreis is a town in the district of Freistadt in the Austrian state of Upper Austria 20 km from Linz. Hagenberg became known for Softwarepark Hagenberg a major technology park focusing on IT, with research, education and busi ...
.
HeuristicLab has a strong focus on providing a graphical user interface so that users are not required to have comprehensive programming skills to adjust and extend the algorithms for a particular problem. In HeuristicLab algorithms are represented as operator graphs and changing or rearranging operators can be done by drag-and-drop without actually writing code. The software thereby tries to shift algorithm development capability from the software engineer to the user and practitioner. Developers can still extend the functionality on code level and can use HeuristicLab's plug-in mechanism that allows them to integrate custom algorithms, solution representations or optimization problems.
History
Development on HeuristicLab was started in 2002 by Stefan Wagner and Michael Affenzeller. The main motivation for the development of HeuristicLab was to build a paradigm-independent, flexible, extensible, and comfortable environment for heuristic optimization on top of a state-of-the-art programming environment and by using modern programming concepts. As the
Microsoft .NET framework seemed to fulfill this requirements it was chosen as the development environment and
C# as programming language.
The first officially available version of HeuristicLab was 1.0 released in 2004 with an improved version 1.1 released in 2005. Development on the next version of HeuristicLab started in the same year. Among many things it was decided that HeuristicLab 2.0 should provide an entirely new user experience and lift the burden of programming off of the user. Therefore, HeuristicLab 2.0 was the first version featuring graphical tools for creating algorithms, however due to the complexity of the user interface HeuristicLab 2.0 was never released to the public. In the summer of 2007 it was decided that a new iteration of HeuristicLab was needed which should combine the usability of version 1.1 with the algorithm modeling concepts of version 2.0. HeuristicLab 3.0 was released internally in the beginning of 2008. In the next 2 years HeuristicLab was gradually improved which led to the release of version 3.3 in summer 2010 as
open source software
Open-source software (OSS) is computer software that is released under a license in which the copyright holder grants users the rights to use, study, change, and distribute the software and its source code to anyone and for any purpose. Open ...
.
Features
; ''Algorithm Designer''
: One of the features that distinguishes HeuristicLab from many other metaheuristic software frameworks is the algorithm designer. HeuristicLab allows to model algorithms in a graphical way without having to write any source code. Algorithms in HeuristicLab are a composition of operators which are chained together. This sequence of operators is called the operator graph and can be viewed and edited for any algorithm in HeuristicLab. HeuristicLab also offers a so called Programmable Operator that can include source code which can be written from within HeuristicLab. Seeing how other algorithms work allows to try out new ideas by starting from an existing algorithm and incrementally modifying it. Of course new algorithms can also be created by writing code.
; ''Experiment Designer''
: In HeuristicLab's Experiment Designer different algorithms with different parameter settings and problems can be composed, executed and analyzed. This is very useful for parameter tuning tasks where different parameterizations have to be executed and compared. HeuristicLab offerers a number of tools for graphically analyzing the results.
; ''Plugin Infrastructure''
: Every functionality in HeuristicLab is available as a plugin. Developers can create and reuse plugins to integrate new features and extend the functionality of HeuristicLab.
; ''Some other features''
:
* Genetic programming models can be simplified. The genetic programming trees can be exported to MATLAB, LaTeX, Excel or other formats.
* Algorithms, problems, experiments, and results can be saved. Algorithms can be executed, pause, saved, restored, and continued.
* Algorithms and experiments can be executed in parallel on multi-core and distributed computing systems.
* Charts can be customized and exported to various image formats.
* Results and other data can be copied to and from Microsoft Excel or other applications.
* Write and solve MIP/LP models with integrated Google OR-Tools
* HeuristicLab can be coupled with external applications, such as simulation models, to optimize their parameters.
* Support for distributed computing (HeuristicLab Hive) based on a
master-slave model similar to e.g.
Boinc
The Berkeley Open Infrastructure for Network Computing (BOINC, pronounced – rhymes with "oink") is an open-source middleware system for volunteer computing (a type of distributed computing). Developed originally to support SETI@home, it beca ...
Supported algorithms
The following list gives an overview of the algorithms supported by HeuristicLab:
*Genetic algorithm-related
**
Genetic Algorithm
** Age-layered Population Structure (ALPS)
**
Genetic Programming
In artificial intelligence, genetic programming (GP) is a technique of evolving programs, starting from a population of unfit (usually random) programs, fit for a particular task by applying operations analogous to natural genetic processes to t ...
**
Evolution strategy
In computer science, an evolution strategy (ES) is an optimization technique based on ideas of evolution. It belongs to the general class of evolutionary computation or artificial evolution methodologies.
History
The 'evolution strategy' optimizat ...
**
CMA-ES Covariance matrix adaptation evolution strategy (CMA-ES) is a particular kind of strategy for numerical optimization. Evolution strategies (ES) are stochastic, derivative-free methods for numerical optimization of non-linear or non-convex continu ...
** Island Genetic Algorithm
** Island Offspring Selection Genetic Algorithm
**
RAPGA
** SASEGASA
** Offspring Selection Evolution Strategy (OSES)
** Offspring Selection Genetic Algorithm
**
Non-dominated Sorting Genetic Algorithm II
*
Ensemble Modeling
*
Gaussian Process Regression and Classification
* Gradient Boosted Trees
* Gradient Boosted Regression
*
Local Search
*
Particle Swarm Optimization
* Parameter-less population pyramid (P3)
* Robust Taboo Search
* Scatter Search
*
Simulated Annealing
Simulated annealing (SA) is a probabilistic technique for approximating the global optimum of a given function. Specifically, it is a metaheuristic to approximate global optimization in a large search space for an optimization problem. ...
*
Tabu Search Tabu search is a metaheuristic search method employing local search methods used for mathematical optimization. It was created by Fred W. Glover in 1986
and formalized in 1989.
Local (neighborhood) searches take a potential solution to a pro ...
* Variable Neighborhood Search
* Performance Benchmarks
*
Cross Validation
*
k-Means
''k''-means clustering is a method of vector quantization, originally from signal processing, that aims to partition ''n'' observations into ''k'' clusters in which each observation belongs to the cluster with the nearest mean (cluster centers o ...
*
Linear Discriminant Analysis
*
Linear Regression
*
Nonlinear Regression
In statistics, nonlinear regression is a form of regression analysis in which observational data are modeled by a function which is a nonlinear combination of the model parameters and depends on one or more independent variables. The data are fi ...
*
Multinomial Logit Classification
*
Nearest Neighbor Regression and Classification
* Neighborhood Components Analysis
* Neural Network Regression and Classification
*
Random Forest Regression and Classification
*
Support Vector Regression and Classification
*
Elastic-Net
* Kernel Ridge Regression
* Decision Tree Regression
*
Barnes-Hut t-SNE
* User-Defined Algorithm: Allows to model algorithms within HeuristicLab's graphical modeling tools.
Supported problems
The following list gives an overview of the problems supported by HeuristicLab:
* Artificial Ant
* Classification
* Clusterin
* Deceptive trap (step)
* Even Parity
* HIFF
*
Knapsack
A backpack—also called knapsack, schoolbag, rucksack, rucksac, pack, sackpack, booksack, bookbag or backsack—is, in its simplest frameless form, a fabric sack carried on one's back and secured with two straps that go over the shoulders ...
*
Bin Packing
*
Graph Coloring
* Koza-style Symbolic Regression
* Lawn Mower
* Multiplexer
* NK
,QLandscapes
* OneMax
*
Quadratic Assignment
*
Job Shop Scheduling Job-shop scheduling, the job-shop problem (JSP) or job-shop scheduling problem (JSSP) is an optimization problem in computer science and operations research. It is a variant of optimal job scheduling. In a general job scheduling problem, we are give ...
* Orienteering
* Regression
*
Robocode
* Single-Objective Test Functions
* Multi-Objective Test Functions
* Symbolic Classification
*
Symbolic Regression
Symbolic regression (SR) is a type of regression analysis that searches the space of mathematical expressions to find the model that best fits a given dataset, both in terms of accuracy and simplicity.
No particular model is provided as a start ...
* Time Series Prognosis
* Trading
*
Grammatical Evolution
*
Traveling Salesman
* Probabilistic Traveling Salesman
*
Vehicle Routing
The vehicle routing problem (VRP) is a combinatorial optimization and integer programming problem which asks "What is the optimal set of routes for a fleet of vehicles to traverse in order to deliver to a given set of customers?" It generalises t ...
* User-defined Problem: A problem which can be defined with HeuristicLab's graphical modelling tools.
* External Evaluation Problem (single- and multi-objective): Allows to use external programs for evaluating solution candidates. This is useful for e.g. simulation-based optimization. Natively supported applications include e.g.
MATLAB
MATLAB (an abbreviation of "MATrix LABoratory") is a proprietary multi-paradigm programming language and numeric computing environment developed by MathWorks. MATLAB allows matrix manipulations, plotting of functions and data, implementa ...
and
Scilab.
See also
*
Metaheuristic
In computer science and mathematical optimization, a metaheuristic is a higher-level procedure or heuristic designed to find, generate, or select a heuristic (partial search algorithm) that may provide a sufficiently good solution to an optimizati ...
s
*
Genetic Algorithms
*
Genetic Programming
In artificial intelligence, genetic programming (GP) is a technique of evolving programs, starting from a population of unfit (usually random) programs, fit for a particular task by applying operations analogous to natural genetic processes to t ...
*
ECJ
The European Court of Justice (ECJ, french: Cour de Justice européenne), formally just the Court of Justice, is the supreme court of the European Union in matters of European Union law. As a part of the Court of Justice of the European Un ...
, A toolkit to implement Evolutionary Algorithms
*
ParadisEO, A metaheuristics framework
References
{{Reflist
External links
HeuristicLab HomepageHEAL Homepage
Heuristic algorithms