HOME

TheInfoList



OR:

In
computer science Computer science is the study of computation, automation, and information. Computer science spans theoretical disciplines (such as algorithms, theory of computation, information theory, and automation) to practical disciplines (includi ...
and
operations research Operations research ( en-GB, operational research) (U.S. Air Force Specialty Code: Operations Analysis), often shortened to the initialism OR, is a discipline that deals with the development and application of analytical methods to improve decis ...
, the ant colony optimization
algorithm In mathematics and computer science, an algorithm () is a finite sequence of rigorous instructions, typically used to solve a class of specific problems or to perform a computation. Algorithms are used as specifications for performing ...
(ACO) is a probabilistic technique for solving computational problems which can be reduced to finding good paths through
graph Graph may refer to: Mathematics *Graph (discrete mathematics), a structure made of vertices and edges **Graph theory, the study of such graphs and their properties *Graph (topology), a topological space resembling a graph in the sense of discre ...
s. Artificial ants stand for multi-agent methods inspired by the behavior of real
ant Ants are eusocial insects of the family Formicidae and, along with the related wasps and bees, belong to the order Hymenoptera. Ants evolved from vespoid wasp ancestors in the Cretaceous period. More than 13,800 of an estimated total of ...
s. The pheromone-based communication of biological ants is often the predominant paradigm used. Combinations of artificial ants and local search algorithms have become a method of choice for numerous optimization tasks involving some sort of
graph Graph may refer to: Mathematics *Graph (discrete mathematics), a structure made of vertices and edges **Graph theory, the study of such graphs and their properties *Graph (topology), a topological space resembling a graph in the sense of discre ...
, e.g.,
vehicle routing The vehicle routing problem (VRP) is a combinatorial optimization and integer programming problem which asks "What is the optimal set of routes for a fleet of vehicles to traverse in order to deliver to a given set of customers?" It generalises t ...
and internet routing. As an example, ant colony optimization is a class of
optimization Mathematical optimization (alternatively spelled ''optimisation'') or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. It is generally divided into two subfi ...
algorithm In mathematics and computer science, an algorithm () is a finite sequence of rigorous instructions, typically used to solve a class of specific problems or to perform a computation. Algorithms are used as specifications for performing ...
s modeled on the actions of an ant colony. Artificial 'ants' (e.g. simulation agents) locate optimal solutions by moving through a
parameter space The parameter space is the space of possible parameter values that define a particular mathematical model, often a subset of finite-dimensional Euclidean space. Often the parameters are inputs of a function, in which case the technical term for th ...
representing all possible solutions. Real ants lay down
pheromone A pheromone () is a secreted or excreted chemical factor that triggers a social response in members of the same species. Pheromones are chemicals capable of acting like hormones outside the body of the secreting individual, to affect the behavio ...
s directing each other to resources while exploring their environment. The simulated 'ants' similarly record their positions and the quality of their solutions, so that in later simulation iterations more ants locate better solutions. One variation on this approach is the bees algorithm, which is more analogous to the foraging patterns of the
honey bee A honey bee (also spelled honeybee) is a eusocial flying insect within the genus ''Apis'' of the bee clade, all native to Afro-Eurasia. After bees spread naturally throughout Africa and Eurasia, humans became responsible for the current cosm ...
, another social insect. This algorithm is a member of the ant colony algorithms family, in swarm intelligence methods, and it constitutes some
metaheuristic In computer science and mathematical optimization, a metaheuristic is a higher-level procedure or heuristic designed to find, generate, or select a heuristic (partial search algorithm) that may provide a sufficiently good solution to an optimizati ...
optimizations. Initially proposed by
Marco Dorigo Marco Dorigo (born 26 August 1961, in Milan, Italy) is a research director for the Belgian Funds for Scientific Research and a co-director of ''IRIDIA'', the artificial intelligence lab of the Université Libre de Bruxelles. He received a PhD in ...
in 1992 in his PhD thesis,M. Dorigo, ''Optimization, Learning and Natural Algorithms'', PhD thesis, Politecnico di Milano, Italy, 1992. the first algorithm was aiming to search for an optimal path in a graph, based on the behavior of
ants Ants are Eusociality, eusocial insects of the Family (biology), family Formicidae and, along with the related wasps and bees, belong to the Taxonomy (biology), order Hymenoptera. Ants evolved from Vespoidea, vespoid wasp ancestors in the Creta ...
seeking a path between their
colony In modern parlance, a colony is a territory subject to a form of foreign rule. Though dominated by the foreign colonizers, colonies remain separate from the administration of the original country of the colonizers, the '' metropolitan state' ...
and a source of food. The original idea has since diversified to solve a wider class of numerical problems, and as a result, several problems have emerged, drawing on various aspects of the behavior of ants. From a broader perspective, ACO performs a model-based search and shares some similarities with
estimation of distribution algorithm ''Estimation of distribution algorithms'' (EDAs), sometimes called ''probabilistic model-building genetic algorithms'' (PMBGAs), are stochastic optimization methods that guide the search for the optimum by building and sampling explicit probabilis ...
s.


Overview

In the natural world, ants of some species (initially) wander
random In common usage, randomness is the apparent or actual lack of pattern or predictability in events. A random sequence of events, symbols or steps often has no order and does not follow an intelligible pattern or combination. Individual ra ...
ly, and upon finding food return to their colony while laying down
pheromone A pheromone () is a secreted or excreted chemical factor that triggers a social response in members of the same species. Pheromones are chemicals capable of acting like hormones outside the body of the secreting individual, to affect the behavio ...
trails. If other ants find such a path, they are likely not to keep travelling at random, but instead to follow the trail, returning and reinforcing it if they eventually find food (see Ant communication). Over time, however, the pheromone trail starts to evaporate, thus reducing its attractive strength. The more time it takes for an ant to travel down the path and back again, the more time the pheromones have to evaporate. A short path, by comparison, gets marched over more frequently, and thus the pheromone density becomes higher on shorter paths than longer ones. Pheromone evaporation also has the advantage of avoiding the convergence to a locally optimal solution. If there were no evaporation at all, the paths chosen by the first ants would tend to be excessively attractive to the following ones. In that case, the exploration of the solution space would be constrained. The influence of pheromone evaporation in real ant systems is unclear, but it is very important in artificial systems. The overall result is that when one ant finds a good (i.e., short) path from the colony to a food source, other ants are more likely to follow that path, and
positive feedback Positive feedback (exacerbating feedback, self-reinforcing feedback) is a process that occurs in a feedback loop which exacerbates the effects of a small disturbance. That is, the effects of a perturbation on a system include an increase in th ...
eventually leads to many ants following a single path. The idea of the ant colony algorithm is to mimic this behavior with "simulated ants" walking around the graph representing the problem to solve.


Ambient networks of intelligent objects

New concepts are required since “intelligence” is no longer centralized but can be found throughout all minuscule objects. Anthropocentric concepts have been known to lead to the production of IT systems in which data processing, control units and calculating forces are centralized. These centralized units have continually increased their performance and can be compared to the human brain. The model of the brain has become the ultimate vision of computers.
Ambient networks Ambient networks is a network integration design that seeks to solve problems relating to switching between networks to maintain contact with the outside world. This project aims to develop a network software-driven infrastructure that will run on ...
of intelligent objects and, sooner or later, a new generation of information systems that are even more diffused and based on nanotechnology, will profoundly change this concept. Small devices that can be compared to insects do not dispose of a high intelligence on their own. Indeed, their intelligence can be classed as fairly limited. It is, for example, impossible to integrate a high performance calculator with the power to solve any kind of mathematical problem into a biochip that is implanted into the human body or integrated in an intelligent tag which is designed to trace commercial articles. However, once those objects are interconnected they dispose of a form of intelligence that can be compared to a colony of ants or bees. In the case of certain problems, this type of intelligence can be superior to the reasoning of a centralized system similar to the brain. Nature offers several examples of how minuscule organisms, if they all follow the same basic rule, can create a form of collective intelligence on the macroscopic level. Colonies of social insects perfectly illustrate this model which greatly differs from human societies. This model is based on the co-operation of independent units with simple and unpredictable behavior. They move through their surrounding area to carry out certain tasks and only possess a very limited amount of information to do so. A colony of ants, for example, represents numerous qualities that can also be applied to a network of ambient objects. Colonies of ants have a very high capacity to adapt themselves to changes in the environment as well as an enormous strength in dealing with situations where one individual fails to carry out a given task. This kind of flexibility would also be very useful for mobile networks of objects which are perpetually developing. Parcels of information that move from a computer to a digital object behave in the same way as ants would do. They move through the network and pass from one knot to the next with the objective of arriving at their final destination as quickly as possible.


Artificial pheromone system

Pheromone-based communication is one of the most effective ways of communication which is widely observed in nature. Pheromone is used by social insects such as bees, ants and termites; both for inter-agent and agent-swarm communications. Due to its feasibility, artificial pheromones have been adopted in multi-robot and swarm robotic systems. Pheromone-based communication was implemented by different means such as chemical or physical (RFID tags, light, sound) ways. However, those implementations were not able to replicate all the aspects of pheromones as seen in nature. Using projected light was presented in an 2007 IEEE paper by Garnier, Simon, et al. as an experimental setup to study pheromone-based communication with micro autonomous robots. Another study presented a system in which pheromones were implemented via a horizontal LCD screen on which the robots moved, with the robots having downward facing light sensors to register the patterns beneath them.


Algorithm and formula

In the ant colony optimization algorithms, an artificial ant is a simple computational agent that searches for good solutions to a given optimization problem. To apply an ant colony algorithm, the optimization problem needs to be converted into the problem of finding the
shortest path In graph theory, the shortest path problem is the problem of finding a path between two vertices (or nodes) in a graph such that the sum of the weights of its constituent edges is minimized. The problem of finding the shortest path between ...
on a weighted graph. In the first step of each iteration, each ant stochastically constructs a solution, i.e. the order in which the edges in the graph should be followed. In the second step, the paths found by the different ants are compared. The last step consists of updating the pheromone levels on each edge. procedure ACO_MetaHeuristic is while not terminated do generateSolutions() daemonActions() pheromoneUpdate() repeat end procedure


Edge selection

Each ant needs to construct a solution to move through the graph. To select the next edge in its tour, an ant will consider the length of each edge available from its current position, as well as the corresponding pheromone level. At each step of the algorithm, each ant moves from a state x to state y, corresponding to a more complete intermediate solution. Thus, each ant k computes a set A_k(x) of feasible expansions to its current state in each iteration, and moves to one of these in probability. For ant k, the probability p_^k of moving from state x to state y depends on the combination of two values, the ''attractiveness'' \eta_ of the move, as computed by some heuristic indicating the ''a priori'' desirability of that move and the ''trail level'' \tau_ of the move, indicating how proficient it has been in the past to make that particular move. The ''trail level'' represents a posteriori indication of the desirability of that move. In general, the kth ant moves from state x to state y with probability : p_^k = \frac where \tau_ is the amount of pheromone deposited for transition from state x to y, 0 ≤ \alpha is a parameter to control the influence of \tau_, \eta_ is the desirability of state transition xy (''a priori'' knowledge, typically 1/d_, where d is the distance) and \beta ≥ 1 is a parameter to control the influence of \eta_. \tau_ and \eta_ represent the trail level and attractiveness for the other possible state transitions.


Pheromone update

Trails are usually updated when all ants have completed their solution, increasing or decreasing the level of trails corresponding to moves that were part of "good" or "bad" solutions, respectively. An example of a global pheromone updating rule is : \tau_ \leftarrow (1-\rho)\tau_ + \sum_^\Delta \tau^_ where \tau_ is the amount of pheromone deposited for a state transition xy, \rho is the ''pheromone evaporation coefficient'', m is the number of ants and \Delta \tau^_ is the amount of pheromone deposited by kth ant, typically given for a TSP problem (with moves corresponding to arcs of the graph) by : \Delta \tau^_ = \begin Q/L_k & \mboxk\mboxxy\mbox \\ 0 & \mbox \end where L_k is the cost of the kth ant's tour (typically length) and Q is a constant.


Common extensions

Here are some of the most popular variations of ACO algorithms.


Ant system (AS)

The ant system is the first ACO algorithm. This algorithm corresponds to the one presented above. It was developed by Dorigo.


Ant colony system (ACS)

In the ant colony system algorithm, the original ant system was modified in three aspects: # The edge selection is biased towards exploitation (i.e. favoring the probability of selecting the shortest edges with a large amount of pheromone); # While building a solution, ants change the pheromone level of the edges they are selecting by applying a local pheromone updating rule; # At the end of each iteration, only the best ant is allowed to update the trails by applying a modified global pheromone updating rule.M. Dorigo et L.M. Gambardella,
Ant Colony System : A Cooperative Learning Approach to the Traveling Salesman Problem
', IEEE Transactions on Evolutionary Computation, volume 1, numéro 1, pages 53-66, 1997.


Elitist ant system

In this algorithm, the global best solution deposits pheromone on its trail after every iteration (even if this trail has not been revisited), along with all the other ants. The elitist strategy has as its objective directing the search of all ants to construct a solution to contain links of the current best route.


Max-min ant system (MMAS)

This algorithm controls the maximum and minimum pheromone amounts on each trail. Only the global best tour or the iteration best tour are allowed to add pheromone to its trail. To avoid stagnation of the search algorithm, the range of possible pheromone amounts on each trail is limited to an interval maxmin All edges are initialized to τmax to force a higher exploration of solutions. The trails are reinitialized to τmax when nearing stagnation.T. Stützle et H.H. Hoos, ''MAX MIN Ant System'', Future Generation Computer Systems, volume 16, pages 889-914, 2000


Rank-based ant system (ASrank)

All solutions are ranked according to their length. Only a fixed number of the best ants in this iteration are allowed to update their trials. The amount of pheromone deposited is weighted for each solution, such that solutions with shorter paths deposit more pheromone than the solutions with longer paths.


Parallel ant colony optimization (PACO)

An ant colony system (ACS) with communication strategies is developed. The artificial ants are partitioned into several groups. Seven communication methods for updating the pheromone level between groups in ACS are proposed and work on the traveling salesman problem.


Continuous orthogonal ant colony (COAC)

The pheromone deposit mechanism of COAC is to enable ants to search for solutions collaboratively and effectively. By using an orthogonal design method, ants in the feasible domain can explore their chosen regions rapidly and efficiently, with enhanced global search capability and accuracy. The orthogonal design method and the adaptive radius adjustment method can also be extended to other optimization algorithms for delivering wider advantages in solving practical problems.


Recursive ant colony optimization

It is a recursive form of ant system which divides the whole search domain into several sub-domains and solves the objective on these subdomains. The results from all the subdomains are compared and the best few of them are promoted for the next level. The subdomains corresponding to the selected results are further subdivided and the process is repeated until an output of desired precision is obtained. This method has been tested on ill-posed geophysical inversion problems and works well.


Convergence

For some versions of the algorithm, it is possible to prove that it is convergent (i.e., it is able to find the global optimum in finite time). The first evidence of convergence for an ant colony algorithm was made in 2000, the graph-based ant system algorithm, and later on for the ACS and MMAS algorithms. Like most
metaheuristic In computer science and mathematical optimization, a metaheuristic is a higher-level procedure or heuristic designed to find, generate, or select a heuristic (partial search algorithm) that may provide a sufficiently good solution to an optimizati ...
s, it is very difficult to estimate the theoretical speed of convergence. A performance analysis of a continuous ant colony algorithm with respect to its various parameters (edge selection strategy, distance measure metric, and pheromone evaporation rate) showed that its performance and rate of convergence are sensitive to the chosen parameter values, and especially to the value of the pheromone evaporation rate. In 2004, Zlochin and his colleaguesM. Zlochin, M. Birattari, N. Meuleau, et M. Dorigo, ''Model-based search for combinatorial optimization: A critical survey'', Annals of Operations Research, vol. 131, pp. 373-395, 2004. showed that COAC-type algorithms could be assimilated methods of stochastic gradient descent, on the
cross-entropy In information theory, the cross-entropy between two probability distributions p and q over the same underlying set of events measures the average number of bits needed to identify an event drawn from the set if a coding scheme used for the set i ...
and
estimation of distribution algorithm ''Estimation of distribution algorithms'' (EDAs), sometimes called ''probabilistic model-building genetic algorithms'' (PMBGAs), are stochastic optimization methods that guide the search for the optimum by building and sampling explicit probabilis ...
. They proposed these
metaheuristic In computer science and mathematical optimization, a metaheuristic is a higher-level procedure or heuristic designed to find, generate, or select a heuristic (partial search algorithm) that may provide a sufficiently good solution to an optimizati ...
s as a " research-based model".


Applications

Ant colony optimization algorithms have been applied to many
combinatorial optimization Combinatorial optimization is a subfield of mathematical optimization that consists of finding an optimal object from a finite set of objects, where the set of feasible solutions is discrete or can be reduced to a discrete set. Typical combi ...
problems, ranging from quadratic assignment to
protein Proteins are large biomolecules and macromolecules that comprise one or more long chains of amino acid residues. Proteins perform a vast array of functions within organisms, including catalysing metabolic reactions, DNA replication, res ...
folding or routing vehicles and a lot of derived methods have been adapted to dynamic problems in real variables, stochastic problems, multi-targets and
parallel Parallel is a geometric term of location which may refer to: Computing * Parallel algorithm * Parallel computing * Parallel metaheuristic * Parallel (software), a UNIX utility for running programs in parallel * Parallel Sysplex, a cluster of ...
implementations. It has also been used to produce near-optimal solutions to the
travelling salesman problem The travelling salesman problem (also called the travelling salesperson problem or TSP) asks the following question: "Given a list of cities and the distances between each pair of cities, what is the shortest possible route that visits each cit ...
. They have an advantage over
simulated annealing Simulated annealing (SA) is a probabilistic technique for approximating the global optimum of a given function. Specifically, it is a metaheuristic to approximate global optimization in a large search space for an optimization problem. ...
and genetic algorithm approaches of similar problems when the graph may change dynamically; the ant colony algorithm can be run continuously and adapt to changes in real time. This is of interest in
network routing Routing is the process of selecting a path for traffic in a network or between or across multiple networks. Broadly, routing is performed in many types of networks, including circuit-switched networks, such as the public switched telephone netw ...
and urban transportation systems. The first ACO algorithm was called the ant systemM. Dorigo, V. Maniezzo, et A. Colorni,
Ant system: optimization by a colony of cooperating agents
', IEEE Transactions on Systems, Man, and Cybernetics--Part B , volume 26, numéro 1, pages 29-41, 1996.
and it was aimed to solve the travelling salesman problem, in which the goal is to find the shortest round-trip to link a series of cities. The general algorithm is relatively simple and based on a set of ants, each making one of the possible round-trips along the cities. At each stage, the ant chooses to move from one city to another according to some rules: # It must visit each city exactly once; # A distant city has less chance of being chosen (the visibility); # The more intense the pheromone trail laid out on an edge between two cities, the greater the probability that that edge will be chosen; # Having completed its journey, the ant deposits more pheromones on all edges it traversed, if the journey is short; # After each iteration, trails of pheromones evaporate.


Scheduling problem

* Sequential ordering problem (SOP) *
Job-shop scheduling Job-shop scheduling, the job-shop problem (JSP) or job-shop scheduling problem (JSSP) is an optimization problem in computer science and operations research. It is a variant of optimal job scheduling. In a general job scheduling problem, we are give ...
problem (JSP) *
Open-shop scheduling Open-shop scheduling or open-shop scheduling problem (OSSP) is an optimization problem in computer science and operations research. It is a variant of optimal job scheduling. In a general job-scheduling problem, we are given ''n'' jobs ''J''1,  ...
problem (OSP) *Permutation flow shop problem (PFSP) *Single machine total tardiness problem (SMTTP) *Single machine total weighted tardiness problem (SMTWTP) *Resource-constrained project scheduling problem (RCPSP) *Group-shop scheduling problem (GSP) *Single-machine total tardiness problem with sequence dependent setup times (SMTTPDST) *Multistage flowshop scheduling problem (MFSP) with sequence dependent setup/changeover times *Assembly Sequence Planning (ASP) problems


Vehicle routing problem

*Capacitated vehicle routing problem (CVRP) *Multi-depot vehicle routing problem (MDVRP) *Period vehicle routing problem (PVRP) *Split delivery vehicle routing problem (SDVRP) *Stochastic vehicle routing problem (SVRP) *Vehicle routing problem with pick-up and delivery (VRPPD) *Vehicle routing problem with time windows (VRPTW)L.M. Gambardella, E. Taillard, G. Agazzi, "MACS-VRPTW: A Multiple Ant Colony System for Vehicle Routing Problems with Time Windows", In D. Corne, M. Dorigo and F. Glover, editors, New Ideas in Optimization, McGraw-Hill, London, UK, pp. 63-76, 1999. *Time dependent vehicle routing problem with time windows (TDVRPTW) *Vehicle routing problem with time windows and multiple service workers (VRPTWMS)


Assignment problem

*
Quadratic assignment problem The quadratic assignment problem (QAP) is one of the fundamental combinatorial optimization problems in the branch of optimization or operations research in mathematics, from the category of the facilities location problems first introduced by Ko ...
(QAP) * Generalized assignment problem (GAP) * Frequency assignment problem (FAP) * Redundancy allocation problem (RAP)


Set problem

*
Set cover problem The set cover problem is a classical question in combinatorics, computer science, operations research, and complexity theory. It is one of Karp's 21 NP-complete problems shown to be NP-complete in 1972. Given a set of elements (called the un ...
(SCP) *
Partition problem In number theory and computer science, the partition problem, or number partitioning, is the task of deciding whether a given multiset ''S'' of positive integers can be partitioned into two subsets ''S''1 and ''S''2 such that the sum of the numbers ...
(SPP) *Weight constrained graph tree partition problem (WCGTPP) *Arc-weighted l-cardinality tree problem (AWlCTP) *Multiple knapsack problem (MKP) *Maximum independent set problem (MIS)


Device sizing problem in nanoelectronics physical design

* Ant colony optimization (ACO) based optimization of 45 nm CMOS-based sense amplifier circuit could converge to optimal solutions in very minimal time. * Ant colony optimization (ACO) based reversible circuit synthesis could improve efficiency significantly.


Antennas optimization and synthesis

To optimize the form of antennas, ant colony algorithms can be used. As example can be considered antennas RFID-tags based on ant colony algorithms (ACO), loopback and unloopback vibrators 10×10


Image processing

The ACO algorithm is used in image processing for image
edge detection Edge detection includes a variety of mathematical methods that aim at identifying edges, curves in a digital image at which the image brightness changes sharply or, more formally, has discontinuities. The same problem of finding discontinuitie ...
and edge linking. * Edge detection: The graph here is the 2-D image and the ants traverse from one pixel depositing pheromone. The movement of ants from one pixel to another is directed by the local variation of the image's intensity values. This movement causes the highest density of the pheromone to be deposited at the edges. The following are the steps involved in edge detection using ACO: ''Step 1: Initialization.'' Randomly place K ants on the image I_ where K= (M_1*M_2)^\tfrac . Pheromone matrix \tau_ are initialized with a random value. The major challenge in the initialization process is determining the heuristic matrix. There are various methods to determine the heuristic matrix. For the below example the heuristic matrix was calculated based on the local statistics: the local statistics at the pixel position (i,j). :\eta_= \tfrac*Vc*I_, where I is the image of size M_1*M_2, :Z =\sum_ \sum_ Vc(I_) is a normalization factor, and :\beginVc(I_) = &f \left( \left\vert I_ - I_ \right\vert + \left\vert I_ - I_ \right\vert \right. \\ & +\left\vert I_ - I_ \right\vert + \left\vert I_ - I_ \right\vert\\ & +\left\vert I_ - I_ \right\vert + \left\vert I_ - I_ \right\vert\\ & + \left. \left\vert I_ - I_ \right\vert + \left\vert I_ - I_ \right\vert \right) \end f(\cdot) can be calculated using the following functions: :f(x) = \lambda x, \quad \text :f(x) = \lambda x^2, \quad \text :f(x) = \begin \sin(\frac), & \text \lambda \text \\ 0, & \text \end :f(x) = \begin \pi x \sin(\frac), & \text \lambda \text \\ 0, & \text \end The parameter \lambda in each of above functions adjusts the functions’ respective shapes. ''Step 2: Construction process.'' The ant's movement is based on 4-connected
pixel In digital imaging, a pixel (abbreviated px), pel, or picture element is the smallest addressable element in a raster image, or the smallest point in an all points addressable display device. In most digital display devices, pixels are the ...
s or 8-connected
pixel In digital imaging, a pixel (abbreviated px), pel, or picture element is the smallest addressable element in a raster image, or the smallest point in an all points addressable display device. In most digital display devices, pixels are the ...
s. The probability with which the ant moves is given by the probability equation P_ ''Step 3 and Step 5: Update process.'' The pheromone matrix is updated twice. in step 3 the trail of the ant (given by \tau_ ) is updated where as in step 5 the evaporation rate of the trail is updated which is given by: : \tau_ \leftarrow (1-\psi)\tau_ + \psi \tau_ , where \psi is the pheromone decay coefficient 0< \tau <1 ''Step 7: Decision process.'' Once the K ants have moved a fixed distance L for N iteration, the decision whether it is an edge or not is based on the threshold T on the pheromone matrixτ. Threshold for the below example is calculated based on Otsu's method. Image edge detected using ACO: The images below are generated using different functions given by the equation (1) to (4). * Edge linking: ACO has also proven effective in edge linking algorithms.


Other applications

*
Bankruptcy prediction Bankruptcy prediction is the art of predicting bankruptcy and various measures of financial distress of public firms. It is a vast area of finance and accounting research. The importance of the area is due in part to the relevance for creditors ...
* ClassificationD. Martens, M. De Backer, R. Haesen, J. Vanthienen, M. Snoeck, B. Baesens,
Classification with Ant Colony Optimization
, IEEE Transactions on Evolutionary Computation, volume 11, number 5, pages 651—665, 2007.
* Connection-oriented
network routing Routing is the process of selecting a path for traffic in a network or between or across multiple networks. Broadly, routing is performed in many types of networks, including circuit-switched networks, such as the public switched telephone netw ...
* Connectionless network routing * Data mining * Discounted cash flows in project scheduling *
Distributed Distribution may refer to: Mathematics *Distribution (mathematics), generalized functions used to formulate solutions of partial differential equations *Probability distribution, the probability of a particular value or value range of a varia ...
information retrieval * Energy and electricity network design * Grid workflow scheduling problem * Inhibitory peptide design for protein protein interactions * Intelligent testing system * Power
electronic circuit design Electronic circuit design comprises the analysis and synthesis of electronic circuits. Methods To design any electrical circuit, either analog or digital, electrical engineers need to be able to predict the voltages and currents at all places with ...
*
Protein folding Protein folding is the physical process by which a protein chain is translated to its native three-dimensional structure, typically a "folded" conformation by which the protein becomes biologically functional. Via an expeditious and reproduc ...
* System identification


Definition difficulty

With an ACO algorithm, the shortest path in a graph, between two points A and B, is built from a combination of several paths. It is not easy to give a precise definition of what algorithm is or is not an ant colony, because the definition may vary according to the authors and uses. Broadly speaking, ant colony algorithms are regarded as populated
metaheuristics In computer science and mathematical optimization, a metaheuristic is a higher-level procedure or heuristic designed to find, generate, or select a heuristic (partial search algorithm) that may provide a sufficiently good solution to an optimiza ...
with each solution represented by an ant moving in the search space. Ants mark the best solutions and take account of previous markings to optimize their search. They can be seen as probabilistic multi-agent algorithms using a probability distribution to make the transition between each
iteration Iteration is the repetition of a process in order to generate a (possibly unbounded) sequence of outcomes. Each repetition of the process is a single iteration, and the outcome of each iteration is then the starting point of the next iteration. ...
. In their versions for combinatorial problems, they use an iterative construction of solutions. According to some authors, the thing which distinguishes ACO algorithms from other relatives (such as algorithms to estimate the distribution or particle swarm optimization) is precisely their constructive aspect. In combinatorial problems, it is possible that the best solution eventually be found, even though no ant would prove effective. Thus, in the example of the Travelling salesman problem, it is not necessary that an ant actually travels the shortest route: the shortest route can be built from the strongest segments of the best solutions. However, this definition can be problematic in the case of problems in real variables, where no structure of 'neighbours' exists. The collective behaviour of social insects remains a source of inspiration for researchers. The wide variety of algorithms (for optimization or not) seeking self-organization in biological systems has led to the concept of " swarm intelligence", which is a very general framework in which ant colony algorithms fit.


Stigmergy algorithms

There is in practice a large number of algorithms claiming to be "ant colonies", without always sharing the general framework of optimization by canonical ant colonies. In practice, the use of an exchange of information between ants via the environment (a principle called "
stigmergy Stigmergy ( ) is a mechanism of indirect coordination, through the environment, between agents or actions. The principle is that the trace left in the environment by an individual action stimulates the performance of a succeeding action by the sam ...
") is deemed enough for an algorithm to belong to the class of ant colony algorithms. This principle has led some authors to create the term "value" to organize methods and behavior based on search of food, sorting larvae, division of labour and cooperative transportation.


Related methods

; Genetic algorithms (GA) : These maintain a pool of solutions rather than just one. The process of finding superior solutions mimics that of evolution, with solutions being combined or mutated to alter the pool of solutions, with solutions of inferior quality being discarded. ;
Estimation of distribution algorithm ''Estimation of distribution algorithms'' (EDAs), sometimes called ''probabilistic model-building genetic algorithms'' (PMBGAs), are stochastic optimization methods that guide the search for the optimum by building and sampling explicit probabilis ...
(EDA) :An
evolutionary algorithm In computational intelligence (CI), an evolutionary algorithm (EA) is a subset of evolutionary computation, a generic population-based metaheuristic optimization algorithm. An EA uses mechanisms inspired by biological evolution, such as reproduct ...
that substitutes traditional reproduction operators by model-guided operators. Such models are learned from the population by employing machine learning techniques and represented as probabilistic graphical models, from which new solutions can be sampled or generated from guided-crossover. ;
Simulated annealing Simulated annealing (SA) is a probabilistic technique for approximating the global optimum of a given function. Specifically, it is a metaheuristic to approximate global optimization in a large search space for an optimization problem. ...
(SA) :A related global optimization technique which traverses the search space by generating neighboring solutions of the current solution. A superior neighbor is always accepted. An inferior neighbor is accepted probabilistically based on the difference in quality and a temperature parameter. The temperature parameter is modified as the algorithm progresses to alter the nature of the search. ;Reactive search optimization :Focuses on combining machine learning with optimization, by adding an internal feedback loop to self-tune the free parameters of an algorithm to the characteristics of the problem, of the instance, and of the local situation around the current solution. ;
Tabu search Tabu search is a metaheuristic search method employing local search methods used for mathematical optimization. It was created by Fred W. Glover in 1986 and formalized in 1989. Local (neighborhood) searches take a potential solution to a pro ...
(TS) :Similar to simulated annealing in that both traverse the solution space by testing mutations of an individual solution. While simulated annealing generates only one mutated solution, tabu search generates many mutated solutions and moves to the solution with the lowest fitness of those generated. To prevent cycling and encourage greater movement through the solution space, a tabu list is maintained of partial or complete solutions. It is forbidden to move to a solution that contains elements of the tabu list, which is updated as the solution traverses the solution space. ; Artificial immune system (AIS) :Modeled on vertebrate immune systems. ; Particle swarm optimization (PSO) :A swarm intelligence method. ; Intelligent water drops (IWD) :A swarm-based optimization algorithm based on natural water drops flowing in rivers ;Gravitational search algorithm (GSA) :A swarm intelligence method. ;Ant colony clustering method (ACCM) :A method that make use of clustering approach, extending the ACO. ; Stochastic diffusion search (SDS) :An agent-based probabilistic global search and optimization technique best suited to problems where the objective function can be decomposed into multiple independent partial-functions.


History

Chronology of ant colony optimization algorithms. * 1959,
Pierre-Paul Grassé Pierre-Paul Grassé (November 27, 1895 in Périgueux (Dordogne) – July 9, 1985) was a French zoologist, writer of over 300 publications including the influential 52-volume ''Traité de Zoologie''. He was an expert on termites and one of the las ...
invented the theory of
stigmergy Stigmergy ( ) is a mechanism of indirect coordination, through the environment, between agents or actions. The principle is that the trace left in the environment by an individual action stimulates the performance of a succeeding action by the sam ...
to explain the behavior of nest building in
termites Termites are small insects that live in colonies and have distinct castes (eusocial) and feed on wood or other dead plant matter. Termites comprise the infraorder Isoptera, or alternatively the epifamily Termitoidae, within the order Blattod ...
; * 1983, Deneubourg and his colleagues studied the collective behavior of
ants Ants are Eusociality, eusocial insects of the Family (biology), family Formicidae and, along with the related wasps and bees, belong to the Taxonomy (biology), order Hymenoptera. Ants evolved from Vespoidea, vespoid wasp ancestors in the Creta ...
; * 1988, and Moyson Manderick have an article on self-organization among ants;F. Moyson, B. Manderick, ''The collective behaviour of Ants : an Example of Self-Organization in Massive Parallelism'', Actes de AAAI Spring Symposium on Parallel Models of Intelligence, Stanford, Californie, 1988. * 1989, the work of Goss, Aron, Deneubourg and Pasteels on the collective behavior of Argentine ants, which will give the idea of ant colony optimization algorithms;S. Goss, S. Aron, J.-L. Deneubourg et J.-M. Pasteels,
Self-organized shortcuts in the Argentine ant
', Naturwissenschaften, volume 76, pages 579-581, 1989
* 1989, implementation of a model of behavior for food by Ebling and his colleagues; * 1991, M. Dorigo proposed the ant system in his doctoral thesis (which was published in 1992). A technical report extracted from the thesis and co-authored by V. Maniezzo and A. Colorni was published five years later; * 1994, Appleby and Steward of British Telecommunications Plc published the first application to
telecommunications Telecommunication is the transmission of information by various types of technologies over wire, radio, optical, or other electromagnetic systems. It has its origin in the desire of humans for communication over a distance greater than that fe ...
networks * 1995, Gambardella and Dorigo proposed ant-q, the preliminary version of ant colony system as first estension of ant system;. * 1996, Gambardella and Dorigo proposed ant colony system * 1996, publication of the article on ant system; * 1997, Dorigo and Gambardella proposed ant colony system hybridized with local search; * 1997, Schoonderwoerd and his colleagues published an improved application to
telecommunication Telecommunication is the transmission of information by various types of technologies over wire, radio, optical, or other electromagnetic systems. It has its origin in the desire of humans for communication over a distance greater than that fe ...
networks; * 1998, Dorigo launches first conference dedicated to the ACO algorithms; * 1998, Stützle proposes initial parallel implementations; *1999, Gambardella, Taillard and Agazzi proposed macs-vrptw, first multi ant colony system applied to vehicle routing problems with time windows, * 1999, Bonabeau, Dorigo and Theraulaz publish a book dealing mainly with artificial ants * 2000, special issue of the Future Generation Computer Systems journal on ant algorithms * 2000, Hoos and Stützle invent the max-min ant system; * 2000, first applications to the
scheduling A schedule or a timetable, as a basic time-management tool, consists of a list of times at which possible tasks, events, or actions are intended to take place, or of a sequence of events in the chronological order in which such things are ...
, scheduling sequence and the satisfaction of constraints; * 2000, Gutjahr provides the first evidence of
convergence Convergence may refer to: Arts and media Literature *''Convergence'' (book series), edited by Ruth Nanda Anshen *Convergence (comics), "Convergence" (comics), two separate story lines published by DC Comics: **A four-part crossover storyline that ...
for an algorithm of ant colonies * 2001, the first use of COA algorithms by companies
Eurobios
an
AntOptima
; * 2001, Iredi and his colleagues published the first multi-objective algorithm * 2002, first applications in the design of schedule, Bayesian networks; * 2002, Bianchi and her colleagues suggested the first algorithm for stochastic problem; * 2004, Dorigo and Stützle publish the Ant Colony Optimization book with MIT Press * 2004, Zlochin and Dorigo show that some algorithms are equivalent to the stochastic gradient descent, the
cross-entropy method The cross-entropy (CE) method is a Monte Carlo method for importance sampling and optimization. It is applicable to both combinatorial and continuous problems, with either a static or noisy objective. The method approximates the optimal importance ...
and algorithms to estimate distribution * 2005, first applications to
protein folding Protein folding is the physical process by which a protein chain is translated to its native three-dimensional structure, typically a "folded" conformation by which the protein becomes biologically functional. Via an expeditious and reproduc ...
problems. * 2012, Prabhakar and colleagues publish research relating to the operation of individual ants communicating in tandem without pheromones, mirroring the principles of computer network organization. The communication model has been compared to the
Transmission Control Protocol The Transmission Control Protocol (TCP) is one of the main protocols of the Internet protocol suite. It originated in the initial network implementation in which it complemented the Internet Protocol (IP). Therefore, the entire suite is common ...
. * 2016, first application to peptide sequence design. * 2017, successful integration of the multi-criteria decision-making method PROMETHEE into the ACO algorithm ( HUMANT algorithm).


References


Publications (selected)

* M. Dorigo, 1992. ''Optimization, Learning and Natural Algorithms'', PhD thesis, Politecnico di Milano, Italy. * M. Dorigo, V. Maniezzo & A. Colorni, 1996.
Ant System: Optimization by a Colony of Cooperating Agents
, IEEE Transactions on Systems, Man, and Cybernetics–Part B, 26 (1): 29–41. * M. Dorigo & L. M. Gambardella, 1997.
Ant Colony System: A Cooperative Learning Approach to the Traveling Salesman Problem
. IEEE Transactions on Evolutionary Computation, 1 (1): 53–66. * M. Dorigo, G. Di Caro & L. M. Gambardella, 1999.
Ant Algorithms for Discrete Optimization
. Artificial Life, 5 (2): 137–172. * E. Bonabeau, M. Dorigo et G. Theraulaz, 1999. ''Swarm Intelligence: From Natural to Artificial Systems'', Oxford University Press. * M. Dorigo & T. Stützle, 2004. ''Ant Colony Optimization'', MIT Press. * M. Dorigo, 2007
"Ant Colony Optimization"
Scholarpedia. * C. Blum, 2005
Ant colony optimization: Introduction and recent trends
. Physics of Life Reviews, 2: 353-373 * M. Dorigo, M. Birattari & T. Stützle, 2006
Ant Colony Optimization: Artificial Ants as a Computational Intelligence Technique
'. TR/IRIDIA/2006-023 * Mohd Murtadha Mohamad,"Articulated Robots Motion Planning Using Foraging Ant Strategy",Journal of Information Technology - Special Issues in Artificial Intelligence, Vol.20, No. 4 pp. 163–181, December 2008, . * N. Monmarché, F. Guinand & P. Siarry (eds), "Artificial Ants", August 2010 Hardback 576 pp. . * A. Kazharov, V. Kureichik, 2010.
Ant colony optimization algorithms for solving transportation problems
, Journal of Computer and Systems Sciences International, Vol. 49. No. 1. pp. 30–43. * C-M. Pintea, 2014
Advances in Bio-inspired Computing for Combinatorial Optimization Problem
Springer * K. Saleem, N. Fisal, M. A. Baharudin, A. A. Ahmed, S. Hafizah and S. Kamilah, "Ant colony inspired self-optimized routing protocol based on cross layer architecture for wireless sensor networks", WSEAS Trans. Commun., vol. 9, no. 10, pp. 669–678, 2010. * K. Saleem and N. Fisal, "Enhanced Ant Colony algorithm for self-optimized data assured routing in wireless sensor networks", Networks (ICON) 2012 18th IEEE International Conference on, pp. 422–427. * Abolmaali S, Roodposhti FR.
Portfolio Optimization Using Ant Colony Method a Case Study on Tehran Stock Exchange.
' Journal of Accounting. 2018 Mar;8(1).


External links


Scholarpedia Ant Colony Optimization pageAnt Colony Optimization Home Page"Ant Colony Optimization" - Russian scientific and research communityAntSim - Simulation of Ant Colony AlgorithmsMIDACO-Solver
General purpose optimization software based on ant colony optimization (Matlab, Excel, VBA, C/C++, R, C#, Java, Fortran and Python)
University of Kaiserslautern, Germany, AG Wehn: Ant Colony Optimization Applet
Visualization of Traveling Salesman solved by ant system with numerous options and parameters (Java Applet)
Ant Farm SimulatorJava Ant Colony System FrameworkAnt Colony Optimization Algorithm Implementation (Python Notebook)
{{DEFAULTSORT:Ant Colony Optimization Articles which contain graphical timelines Nature-inspired metaheuristics Optimization algorithms and methods