Convex Analysis
   HOME



picture info

Convex Analysis
Convex analysis is the branch of mathematics devoted to the study of properties of convex functions and convex sets, often with applications in convex optimization, convex minimization, a subdomain of optimization (mathematics), optimization theory. Convex sets A subset C \subseteq X of some vector space X is if it satisfies any of the following equivalent conditions: #If 0 \leq r \leq 1 is real and x, y \in C then r x + (1 - r) y \in C. #If 0 < r < 1 is real and x, y \in C with x \neq y, then r x + (1 - r) y \in C. Throughout, f : X \to [-\infty, \infty] will be a map valued in the Extended real number line, extended real numbers [-\infty, \infty] = \mathbb \cup \ with a Domain of a function, domain \operatorname f = X that is a convex subset of some vector space. The map f : X \to [-\infty, \infty] is a if holds for any real 0 < r < 1 and any x, y \in ...
[...More Info...]       [...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Proper Convex Function
In mathematical analysis, in particular the subfields of convex analysis and optimization, a proper convex function is an extended real-valued convex function with a non-empty domain, that never takes on the value -\infty and also is not identically equal to +\infty. In convex analysis and variational analysis, a point (in the domain) at which some given function f is minimized is typically sought, where f is valued in the extended real number line \infty, \infty= \mathbb \cup \. Such a point, if it exists, is called a of the function and its value at this point is called the () of the function. If the function takes -\infty as a value then -\infty is necessarily the global minimum value and the minimization problem can be answered; this is ultimately the reason why the definition of "" requires that the function never take -\infty as a value. Assuming this, if the function's domain is empty or if the function is identically equal to +\infty then the minimization problem once ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


picture info

Separated Space
In topology and related branches of mathematics, a Hausdorff space ( , ), T2 space or separated space, is a topological space where distinct points have disjoint neighbourhoods. Of the many separation axioms that can be imposed on a topological space, the "Hausdorff condition" (T2) is the most frequently used and discussed. It implies the uniqueness of limits of sequences, nets, and filters. Hausdorff spaces are named after Felix Hausdorff, one of the founders of topology. Hausdorff's original definition of a topological space (in 1914) included the Hausdorff condition as an axiom. Definitions Points x and y in a topological space X can be ''separated by neighbourhoods'' if there exists a neighbourhood U of x and a neighbourhood V of y such that U and V are disjoint (U\cap V=\varnothing). X is a Hausdorff space if any two distinct points in X are separated by neighbourhoods. This condition is the third separation axiom (after T0 and T1), which is why Hausdorff spaces ar ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Dual Pair
Dual or Duals may refer to: Paired/two things * Dual (mathematics), a notion of paired concepts that mirror one another ** Dual (category theory), a formalization of mathematical duality *** see more cases in :Duality theories * Dual number, a number system used in automatic differentiation * Dual (grammatical number), a grammatical category used in some languages * Dual county, a Gaelic games county which competes in both Gaelic football and hurling * Dual diagnosis, a psychiatric diagnosis of co-occurrence of substance abuse and a mental problem * Dual fertilization, simultaneous application of a P-type and N-type fertilizer * Dual impedance, electrical circuits that are the dual of each other * Dual SIM cellphone supporting use of two SIMs * Aerochute International Dual a two-seat Australian powered parachute design Acronyms and other uses * Dual (brand), a manufacturer of Hifi equipment * DUAL (cognitive architecture), an artificial intelligence design model * DUA ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Duality (optimization)
In mathematical optimization theory, duality or the duality principle is the principle that optimization problems may be viewed from either of two perspectives, the primal problem or the dual problem. If the primal is a minimization problem then the dual is a maximization problem (and vice versa). Any feasible solution to the primal (minimization) problem is at least as large as any feasible solution to the dual (maximization) problem. Therefore, the solution to the primal is an upper bound to the solution of the dual, and the solution of the dual is a lower bound to the solution of the primal. This fact is called weak duality. In general, the optimal values of the primal and dual problems need not be equal. Their difference is called the duality gap. For convex optimization problems, the duality gap is zero under a constraint qualification condition. This fact is called strong duality. Dual problem Usually the term "dual problem" refers to the ''Lagrangian dual problem'' but o ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  




Fenchel–Moreau Theorem
In convex analysis, the Fenchel–Moreau theorem (named after Werner Fenchel and Jean Jacques Moreau) or Fenchel biconjugation theorem (or just biconjugation theorem) is a theorem which gives necessary and sufficient conditions for a function to be equal to its biconjugate. This is in contrast to the general property that for any function f^ \leq f. This can be seen as a generalization of the bipolar theorem. It is used in duality theory to prove strong duality (via the perturbation function). Statement Let (X,\tau) be a Hausdorff locally convex space, for any extended real valued function f: X \to \mathbb \cup \ it follows that f = f^ if and only if one of the following is true # f is a proper, lower semi-continuous, and convex function In mathematics, a real-valued function is called convex if the line segment between any two distinct points on the graph of a function, graph of the function lies above or on the graph between the two points. Equivalently, a funct ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


picture info

Lower Semi-continuous
In mathematical analysis, semicontinuity (or semi-continuity) is a property of extended real-valued functions that is weaker than continuity. An extended real-valued function f is upper (respectively, lower) semicontinuous at a point x_0 if, roughly speaking, the function values for arguments near x_0 are not much higher (respectively, lower) than f\left(x_0\right). Briefly, a function on a domain X is lower semi-continuous if its epigraph \ is closed in X\times\R, and upper semi-continuous if -f is lower semi-continuous. A function is continuous if and only if it is both upper and lower semicontinuous. If we take a continuous function and increase its value at a certain point x_0 to f\left(x_0\right) + c for some c>0, then the result is upper semicontinuous; if we decrease its value to f\left(x_0\right) - c then the result is lower semicontinuous. The notion of upper and lower semicontinuous function was first introduced and studied by René Baire in his thesis in 1899. ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


If And Only If
In logic and related fields such as mathematics and philosophy, "if and only if" (often shortened as "iff") is paraphrased by the biconditional, a logical connective between statements. The biconditional is true in two cases, where either both statements are true or both are false. The connective is biconditional (a statement of material equivalence), and can be likened to the standard material conditional ("only if", equal to "if ... then") combined with its reverse ("if"); hence the name. The result is that the truth of either one of the connected statements requires the truth of the other (i.e. either both statements are true, or both are false), though it is controversial whether the connective thus defined is properly rendered by the English "if and only if"—with its pre-existing meaning. For example, ''P if and only if Q'' means that ''P'' is true whenever ''Q'' is true, and the only case in which ''P'' is true is if ''Q'' is also true, whereas in the case of ''P if Q ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Perturbation Function
In mathematical optimization, the perturbation function is any function which relates to primal and dual problems. The name comes from the fact that any such function defines a perturbation of the initial problem. In many cases this takes the form of shifting the constraints. In some texts the value function is called the perturbation function, and the perturbation function is called the bifunction. Definition Given two dual pairs of separated locally convex spaces \left(X,X^*\right) and \left(Y,Y^*\right). Then given the function f: X \to \mathbb \cup \, we can define the primal problem by :\inf_ f(x). \, If there are constraint conditions, these can be built into the function f by letting f \leftarrow f + I_\mathrm where I is the characteristic function. Then F: X \times Y \to \mathbb \cup \ is a ''perturbation function'' if and only if F(x,0) = f(x). Use in duality The duality gap is the difference of the right and left hand side of the inequality :\sup_ -F^*(0,y^*) ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Weak Duality
In applied mathematics, weak duality is a concept in optimization which states that the duality gap is always greater than or equal to 0. This means that for any minimization problem, called the ''primal problem'', the solution to the primal problem is always greater than or equal to the solution to the dual maximization problem. Alternatively, the solution to a primal maximization problem is always less than or equal to the solution to the dual minimization problem. So, in short: weak duality states that any solution feasible for the dual problem is an upper bound to the solution of the primal problem. Weak duality is in contrast to strong duality, which states that the primal optimal objective and the dual optimal objective are ''equal''. Strong duality only holds in certain cases. Uses Many primal-dual approximation algorithms are based on the principle of weak duality.. Weak duality theorem Consider a linear programming problem, whe ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  




Strong Duality
Strong duality is a condition in mathematical optimization in which the primal optimal objective and the dual optimal objective are equal. By definition, strong duality holds if and only if the duality gap is equal to 0. This is opposed to weak duality (the primal problem has optimal value smaller than or equal to the dual problem, in other words the duality gap is greater than or equal to zero). Sufficient conditions Each of the following conditions is sufficient for strong duality to hold: * F = F^ where F is the perturbation function relating the primal and dual problems and F^ is the biconjugate of F (follows by construction of the duality gap) * F is convex and lower semi-continuous (equivalent to the first point by the Fenchel–Moreau theorem) * the primal problem is a linear optimization problem * Slater's condition for a convex optimization problem. Strong duality and computational complexity Under certain conditions (called "constraint qualification"), if a ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Dual Norm
In functional analysis, the dual norm is a measure of size for a continuous function, continuous linear function defined on a normed vector space. Definition Let X be a normed vector space with norm \, \cdot\, and let X^* denote its continuous dual space. The dual norm of a continuous linear functional f belonging to X^* is the non-negative real number defined by any of the following equivalent formulas: \begin \, f \, &= \sup &&\ \\ &= \sup &&\ \\ &= \inf &&\ \\ &= \sup &&\ \\ &= \sup &&\ \;\;\;\text X \neq \ \\ &= \sup &&\bigg\ \;\;\;\text X \neq \ \\ \end where \sup and \inf denote the supremum and infimum, respectively. The constant 0 map is the origin of the vector space X^* and it always has norm \, 0\, = 0. If X = \ then the only linear functional on X is the constant 0 map and moreover, the sets in the last two rows will both be empty and consequently, their supremums will equal \sup \varnothing = - \infty instead of the corre ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]