Knaster–Tarski theorem

In the mathematical areas of order and lattice theory, the Knaster–Tarski theorem, named after Bronisław Knaster and Alfred Tarski, states the following:

Let (L, ≤) be a complete lattice and let f : L → L be an order-preserving (monotonic) function w.r.t. ≤ . Then the set of fixed points of f in L forms a complete lattice under ≤ .

It was Tarski who stated the result in its most general form,^[1] and so the theorem is often known as Tarski's fixed-point theorem. Some time earlier, Knaster and Tarski established the result for the special case where L is the lattice of subsets of a set, the power set lattice.^[2]

The theorem has important applications in formal semantics of programming languages and abstract interpretation, as well as in game theory.

A kind of converse of this theorem was proved by Anne C. Davis: If every order-preserving function f : L → L on a lattice L has a fixed point, then L is a complete lattice.^[3]

Consequences: least and greatest fixed points

Since complete lattices cannot be empty (they must contain a supremum and infimum of the empty set), the theorem in particular guarantees the existence of at least one fixed point of f, and even the existence of a least fixed point (or greatest fixed point). In many practical cases, this is the most important implication of the theorem.

The least fixpoint of f is the least element x such that f(x) = x, or, equivalently, such that f(x) ≤ x; the dual holds for the greatest fixpoint, the greatest element x such that f(x) = x.

If f(lim x_n) = lim f(x_n) for all ascending sequences x_n, then the least fixpoint of f is lim fⁿ(0) where 0 is the least element of L, thus giving a more "constructive" version of the theorem. (See: Kleene fixed-point theorem.) More generally, if f is monotonic, then the least fixpoint of f is the stationary limit of f^α(0), taking α over the ordinals, where f^α is defined by transfinite induction: f^α+1 = f (f^α) and f^γ for a limit ordinal γ is the least upper bound of the f^β for all β ordinals less than γ.^[4] The dual theorem holds for the greatest fixpoint.

For example, in theoretical computer science, least fixed points of monotonic functions are used to define program semantics, see Least fixed point § Denotational semantics for an example. Often a more specialized version of the theorem is used, where L is assumed to be the lattice of all subsets of a certain set ordered by subset inclusion. This reflects the fact that in many applications only such lattices are considered. One then usually is looking for the smallest set that has the property of being a fixed point of the function f. Abstract interpretation makes ample use of the Knaster–Tarski theorem and the formulas giving the least and greatest fixpoints.

The Knaster–Tarski theorem can be used to give a simple proof of the Cantor–Bernstein–Schroeder theorem.^[5]^[6]

Weaker versions of the theorem

Weaker versions of the Knaster–Tarski theorem can be formulated for ordered sets, but involve more complicated assumptions. For example:^{[citation needed]}

Let L be a partially ordered set with a least element (bottom) and let f : L → L be an monotonic function. Further, suppose there exists u in L such that f(u) ≤ u and that any chain in the subset $\{x\in L\mid x\leq f(x),x\leq u\}$ has a supremum. Then f admits a least fixed point.

This can be applied to obtain various theorems on invariant sets, e.g. the Ok's theorem:

For the monotone map F : P(X ) → P(X ) on the family of (closed) nonempty subsets of X, the following are equivalent: (o) F admits A in P(X ) s.t. $A\subseteq F(A)$ , (i) F admits invariant set A in P(X ) i.e. $A=F(A)$ , (ii) F admits maximal invariant set A, (iii) F admits the greatest invariant set A.

In particular, using the Knaster-Tarski principle one can develop the theory of global attractors for noncontractive discontinuous (multivalued) iterated function systems. For weakly contractive iterated function systems the Kantorovich theorem (known also as Tarski-Kantorovich fixpoint principle) suffices.

Other applications of fixed-point principles for ordered sets come from the theory of differential, integral and operator equations.

Proof

Let us restate the theorem.

For a complete lattice $\langle L,\leq \rangle$ and a monotone function $f\colon L\rightarrow L$ on L, the set of all fixpoints of f is also a complete lattice $\langle P,\leq \rangle$ , with:

$\bigvee P=\bigvee \{x\in L\mid x\leq f(x)\}$ as the greatest fixpoint of f
$\bigwedge P=\bigwedge \{x\in L\mid x\geq f(x)\}$ as the least fixpoint of f.

Proof. We begin by showing that P has both a least element and a greatest element. Let $D = {x | x \leq f (x)}$ and $x \in D$ (we know that at least 0_L belongs to D). Then because f is monotone we have $f (x) \leq f (f (x))$ , that is $f (x) \in D$ .

Now let $u=\bigvee D$ (u exists because $D \subseteq L$ and L is a complete lattice). Then for all $x \in D$ it is true that $x \leq u$ and $f (x) \leq f (u)$ , so $x \leq f (x) \leq f (u)$ . Therefore, f(u) is an upper bound of D, but u is the least upper bound, so $u \leq f (u)$ , i.e. $u \in D$ . Then $f (u) \in D$ (because $f (u) \leq f (f (u)))$ and so $f (u) \leq u$ from which follows f(u) = u. Because every fixpoint is in D we have that u is the greatest fixpoint of f.

The function f is monotone on the dual (complete) lattice $\langle L^{op},\geq \rangle$ . As we have just proved, its greatest fixpoint exists. It is the least fixpoint of L, so P has least and greatest elements, that is more generally, every monotone function on a complete lattice has a least fixpoint and a greatest fixpoint.

For a, b in L we write [a, b] for the closed interval with bounds a and $b : {x \in L | a \leq x \leq b}$ . If a ≤ b, then ⟨[a, b], ≤⟩ is a complete lattice.

It remains to be proven that P is a complete lattice. Let $1_{L}=\bigvee L$ , $W \subseteq P$ and $w=\bigvee W$ . We show that $f ([w, 1 L]) \subseteq [w, 1 L]$ . Indeed, for every $x \in W$ we have x = f(x) and since w is the least upper bound of W, $x \leq f (w)$ . In particular $w \leq f (w)$ . Then from $y \in [w, 1 L]$ follows that $w \leq f (w) \leq f (y)$ , giving $f (y) \in [w, 1 L]$ or simply $f ([w, 1 L]) \subseteq [w, 1 L]$ . This allows us to look at f as a function on the complete lattice [w, 1_L]. Then it has a least fixpoint there, giving us the least upper bound of W. We've shown that an arbitrary subset of P has a supremum, that is, P is a complete lattice.

Computing a Tarski fixed-point

Chang, Lyuu and Ti^[7] present an algorithm for finding a Tarski fixed-point in a totally-ordered lattice, when the order-preserving function is given by a value oracle. Their algorithm requires $O(\log L)$ queries, where L is the number of elements in the lattice. In contrast, for a general lattice (given as an oracle), they prove a lower bound of $\Omega (L)$ queries.

Deng, Qi and Ye^[8] present several algorithms for finding a Tarski fixed-point. They consider two kinds of lattices: componentwise ordering and lexicographic ordering. They consider two kinds of input for the function f: value oracle, or a polynomial function. Their algorithms have the following runtime complexity (where d is the number of dimensions, and N_i is the number of elements in dimension i):

Input Lattice	Polynomial function	Value oracle
Componentwise	$O(\operatorname {poly} (\log L)\cdot \log N_{1}\cdots \log N_{d})$	$O(\log N_{1}\cdots \log N_{d})\approx O(\log ^{d}L)$
Lexicographic	$O(\operatorname {poly} (\log L)\cdot \log L)$	$O(\log L)$

The algorithms are based on binary search. On the other hand, determining whether a given fixed point is unique is computationally hard:

Input Lattice	Polynomial function	Value oracle
Componentwise	coNP-complete	$\Theta (N_{1}+\cdots +N_{d})$
Lexicographic	coNP-complete	$\Theta (L)$

For d=2, for componentwise lattice and a value-oracle, the complexity of $O(\log ^{2}L)$ is optimal.^[9] But for d>2, there are faster algorithms:

Fearnley, Palvolgyi and Savani^[10] presented an algorithm using only $O(\log ^{2\lceil d/3\rceil }L)$ queries. In particular, for d=3, only $O(\log ^{2}L)$ queries are needed.
Chen and Li^[11] presented an algorithm using only $O(\log ^{\lceil (d+1)/2\rceil }L)$ queries.

Application in game theory

Tarski's fixed-point theorem has applications to supermodular games.^[8] A supermodular game (also called a game of strategic complements^[12]) is a game in which the utility function of each player has increasing differences, so the best response of a player is a weakly-increasing function of other players' strategies. For example, consider a game of competition between two firms. Each firm has to decide how much money to spend on research. In general, if one firm spends more on research, the other firm's best response is to spend more on research too. Some common games can be modeled as supermodular games, for example Cournot competition, Bertrand competition and Investment Games.

Because the best-response functions are monotone, Tarski's fixed-point theorem can be used to prove the existence of a pure-strategy Nash equilibrium (PNE) in a supermodular game. Moreover, Topkis^[13] showed that the set of PNE of a supermodular game is a complete lattice, so the game has a "smallest" PNE and a "largest" PNE.

Echenique^[14] presents an algorithm for finding all PNE in a supermodular game. His algorithm first uses best-response sequences to find the smallest and largest PNE; then, he removes some strategies and repeats, until all PNE are found. His algorithm is exponential in the worst case, but runs fast in practice. Deng, Qi and Ye^[8] show that a PNE can be computed efficiently by finding a Tarski fixed-point of an order-preserving mapping associated with the game.

Notes

^ Alfred Tarski (1955). "A lattice-theoretical fixpoint theorem and its applications". Pacific Journal of Mathematics. 5 (2): 285–309. doi:10.2140/pjm.1955.5.285.
^ B. Knaster (1928). "Un théorème sur les fonctions d'ensembles". Ann. Soc. Polon. Math. 6: 133–134. With A. Tarski.
^ Anne C. Davis (1955). "A characterization of complete lattices". Pacific Journal of Mathematics. 5 (2): 311–319. doi:10.2140/pjm.1955.5.311.
^ Cousot, Patrick; Cousot, Radhia (1979). "Constructive versions of tarski's fixed point theorems". Pacific Journal of Mathematics. 82: 43–57. doi:10.2140/pjm.1979.82.43.
^ Uhl, Roland. "Tarski's Fixed Point Theorem". MathWorld. Example 3.
^ Davey, Brian A.; Priestley, Hilary A. (2002). Introduction to Lattices and Order (2nd ed.). Cambridge University Press. pp. 63, 4. ISBN 9780521784511.
^ Chang, Ching-Lueh; Lyuu, Yuh-Dauh; Ti, Yen-Wu (2008-07-23). "The complexity of Tarski's fixed point theorem". Theoretical Computer Science. 401 (1): 228–235. doi:10.1016/j.tcs.2008.05.005. ISSN 0304-3975.
^ ^a ^b ^c Dang, Chuangyin; Qi, Qi; Ye, Yinyu (2020-05-01). Computations and Complexities of Tarski's Fixed Points and Supermodular Games (Report). arXiv.org.
^ Etessami, Kousha; Papadimitriou, Christos; Rubinstein, Aviad; Yannakakis, Mihalis (2020). Vidick, Thomas (ed.). "Tarski's Theorem, Supermodular Games, and the Complexity of Equilibria". 11th Innovations in Theoretical Computer Science Conference (ITCS 2020). Leibniz International Proceedings in Informatics (LIPIcs). 151. Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik: 18:1–18:19. doi:10.4230/LIPIcs.ITCS.2020.18. ISBN 978-3-95977-134-4. S2CID 202538977.
^ Fearnley, John; Pálvölgyi, Dömötör; Savani, Rahul (2022-10-11). "A Faster Algorithm for Finding Tarski Fixed Points". ACM Transactions on Algorithms. 18 (3): 23:1–23:23. arXiv:2010.02618. doi:10.1145/3524044. ISSN 1549-6325. S2CID 222141645.
^ Chen, Xi; Li, Yuhao (2022-07-13). "Improved Upper Bounds for Finding Tarski Fixed Points". Proceedings of the 23rd ACM Conference on Economics and Computation. EC '22. New York, NY, USA: Association for Computing Machinery. pp. 1108–1118. arXiv:2202.05913. doi:10.1145/3490486.3538297. ISBN 978-1-4503-9150-4. S2CID 246823965.
^ Vives, Xavier (1990-01-01). "Nash equilibrium with strategic complementarities". Journal of Mathematical Economics. 19 (3): 305–321. doi:10.1016/0304-4068(90)90005-T. ISSN 0304-4068.
^ Topkis, Donald M. (1979-11-01). "Equilibrium Points in Nonzero-Sum n -Person Submodular Games". SIAM Journal on Control and Optimization. 17 (6): 773–787. doi:10.1137/0317054. ISSN 0363-0129.
^ Echenique, Federico (2007-07-01). "Finding all equilibria in games of strategic complements". Journal of Economic Theory. 135 (1): 514–532. doi:10.1016/j.jet.2006.06.001. ISSN 0022-0531.

References

Andrzej Granas and James Dugundji (2003). Fixed Point Theory. Springer-Verlag, New York. ISBN 978-0-387-00173-9.
Forster, T. (2003-07-21). Logic, Induction and Sets. Cambridge University Press. ISBN 978-0-521-53361-4.

External links

J. B. Nation, Notes on lattice theory.
An application to an elementary combinatorics problem: Given a book with 100 pages and 100 lemmas, prove that there is some lemma written on the same page as its index

[1] Alfred Tarski (1955). "A lattice-theoretical fixpoint theorem and its applications". Pacific Journal of Mathematics. 5 (2): 285–309. doi:10.2140/pjm.1955.5.285.

[2] B. Knaster (1928). "Un théorème sur les fonctions d'ensembles". Ann. Soc. Polon. Math. 6: 133–134. With A. Tarski.

[3] Anne C. Davis (1955). "A characterization of complete lattices". Pacific Journal of Mathematics. 5 (2): 311–319. doi:10.2140/pjm.1955.5.311.

[4] Cousot, Patrick; Cousot, Radhia (1979). "Constructive versions of tarski's fixed point theorems". Pacific Journal of Mathematics. 82: 43–57. doi:10.2140/pjm.1979.82.43.

[5] Uhl, Roland. "Tarski's Fixed Point Theorem". MathWorld. Example 3.

[6] Davey, Brian A.; Priestley, Hilary A. (2002). Introduction to Lattices and Order (2nd ed.). Cambridge University Press. pp. 63, 4. ISBN 9780521784511.

[7] Chang, Ching-Lueh; Lyuu, Yuh-Dauh; Ti, Yen-Wu (2008-07-23). "The complexity of Tarski's fixed point theorem". Theoretical Computer Science. 401 (1): 228–235. doi:10.1016/j.tcs.2008.05.005. ISSN 0304-3975.

[:0-8] Dang, Chuangyin; Qi, Qi; Ye, Yinyu (2020-05-01). Computations and Complexities of Tarski's Fixed Points and Supermodular Games (Report). arXiv.org.

[9] Etessami, Kousha; Papadimitriou, Christos; Rubinstein, Aviad; Yannakakis, Mihalis (2020). Vidick, Thomas (ed.). "Tarski's Theorem, Supermodular Games, and the Complexity of Equilibria". 11th Innovations in Theoretical Computer Science Conference (ITCS 2020). Leibniz International Proceedings in Informatics (LIPIcs). 151. Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik: 18:1–18:19. doi:10.4230/LIPIcs.ITCS.2020.18. ISBN 978-3-95977-134-4. S2CID 202538977.

[10] Fearnley, John; Pálvölgyi, Dömötör; Savani, Rahul (2022-10-11). "A Faster Algorithm for Finding Tarski Fixed Points". ACM Transactions on Algorithms. 18 (3): 23:1–23:23. arXiv:2010.02618. doi:10.1145/3524044. ISSN 1549-6325. S2CID 222141645.

[11] Chen, Xi; Li, Yuhao (2022-07-13). "Improved Upper Bounds for Finding Tarski Fixed Points". Proceedings of the 23rd ACM Conference on Economics and Computation. EC '22. New York, NY, USA: Association for Computing Machinery. pp. 1108–1118. arXiv:2202.05913. doi:10.1145/3490486.3538297. ISBN 978-1-4503-9150-4. S2CID 246823965.

[12] Vives, Xavier (1990-01-01). "Nash equilibrium with strategic complementarities". Journal of Mathematical Economics. 19 (3): 305–321. doi:10.1016/0304-4068(90)90005-T. ISSN 0304-4068.

[13] Topkis, Donald M. (1979-11-01). "Equilibrium Points in Nonzero-Sum n -Person Submodular Games". SIAM Journal on Control and Optimization. 17 (6): 773–787. doi:10.1137/0317054. ISSN 0363-0129.

[14] Echenique, Federico (2007-07-01). "Finding all equilibria in games of strategic complements". Journal of Economic Theory. 135 (1): 514–532. doi:10.1016/j.jet.2006.06.001. ISSN 0022-0531.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]