- Ackermann function
In

recursion theory , the**Ackermann function**or**Ackermann-Péter function**is a simple example of a general recursive function that is not primitive recursive. General recursive functions are also known ascomputable function s. The set of primitive recursive functions is asubset of the set of general recursive functions. Ackermann's function is an example that shows that the former is astrict subset of the latter.It takes two

natural number s as arguments and yields another natural number, using the notation A(m,n). Its value grows rapidly; even for small inputs, for example A("4,2") [*[*] and A("4,3"), the results are*http://www.kosara.net/thoughts/ackermann42.html Decimal expansion of A(4,2)*] contains 19729 decimal digitslarge numbers . These large numbers in the m=4 row can also be expressed usingtetration s.**History**In the late 1920s, the mathematicians

Gabriel Sudan andWilhelm Ackermann , students ofDavid Hilbert , were studying the foundations of computation. Sudan is credited with inventing the lesser-knownSudan function , the first published function that is recursive but not primitive recursive. Shortly afterwards and independently, in 1928, Ackermann published his own recursive but not primitive recursive function. [*cite journal | author=Cristian Calude,*]Solomon Marcus and Ionel Tevy | journal = Historia Math. | title=The first example of a recursive function which is not primitive recursive | month=November | year=1979 | pages=380–84 | volume=6 | issue=4 | doi=10.1016/0315-0860(79)90024-7 Summarized in cite newsgroup | title=Ackermann vs. Sudan | author=Bill Dubuque | newsgroup=sci.logic|date=1997-09-12 | url=http://groups.google.com/group/sci.logic/browse_thread/thread/86b29649768bed6b/2b445d3be80dae72

accessdate = 2006-06-13 | id=y8zoh5yn377.fsf@berne.ai.mit.eduAckermann originally considered a function "A"("m", "n", "p") of three variables, the "p"-fold iterated exponentiation of "m" with "n", or "m" → "n" → "p" as expressed using the

Conway chained arrow notation . When "p" = 1, this is "m"^{"n"}, which is "m" multiplied by itself "n" times. When "p" = 2, it is a tower of exponents $$m^m}^cdot}^cdot}^cdot}^m with "n" levels, or "m" raised "n" times to the power "m" also written as^{"n"}"m", the tetration of "m" with "n". This can be generalized indefinitely as "p" becomes larger.Ackermann proved that "A" is a recursive function, a function that a computer with unbounded memory can calculate, but it is not a

primitive recursive function , a class of functions including almost all familiar functions such as addition andfactorial .In "On the Infinite", David Hilbert hypothesized that the Ackermann function was not primitively recursive, but it was Ackermann, Hilbert’s personal secretary and former student, who actually proved the hypothesis in his paper "On Hilbert’s Construction of the Real Numbers". "On the Infinite" was Hilbert’s most important paper on the foundations of mathematics, serving as the heart of

Hilbert's program to secure the foundation of transfinite numbers by basing them on finite methods. [*cite journal | author=Wilhelm Ackermann | journal=*] [Mathematische Annalen | title="Zum Hilbertschen Aufbau der reellen Zahlen" | year=1928 | volume=99 | pages=118–133 | doi=10.1007/BF01459088*von Heijenoort. [*]*http://mathgate.info/cebrown/notes/vonHeijenoort.php From Frege To Gödel*] , 1967.A similar function of only two variables was later defined by

Rózsa Péter andRaphael Robinson ; its definition is given below. The numbers, except in the first few rows, are three less than powers of two. For the exact relation between the two functions, see below. [*cite journal | author=Raphael M. Robinson | title=Recursion and Double Recursion | journal=*]Bulletin of the American Mathematical Society | year=1948 | volume=54 | pages=987–93 | doi=10.1090/S0002-9904-1948-09121-2**Definition and properties**The Ackermann function is defined recursively for non-negative integers "m" and "n" as follows (this presentation is due to

Rózsa Péter )::$A(m,\; n)\; =\; egin\{cases\}\; n+1\; mbox\{if\; \}\; m\; =\; 0\; \backslash \; A(m-1,\; 1)\; mbox\{if\; \}\; m\; 0\; mbox\{\; and\; \}\; n\; =\; 0\; \backslash \; A(m-1,\; A(m,\; n-1))\; mbox\{if\; \}\; m\; 0\; mbox\{\; and\; \}\; n\; 0.\; end\{cases\}$

It may not be immediately obvious that the evaluation of these functions always terminates. The recursion is bounded because in each recursive application either "m" decreases, or "m" remains the same and "n" decreases. Each time that "n" reaches zero, "m" decreases, so "m" eventually reaches zero as well. (Expressed more technically, in each case the pair ("m", "n") decreases in the

lexicographic order , which preserves thewell-order ing of the non-negative integers.) However, when "m" decreases there is no upper bound on how much "n" can increase — and it will often increase greatly.The Ackermann function can also be expressed nonrecursively using:

*Conway chained arrow notation:::"A"("m", "n") = (2 → ("n"+3) → "(m" − 2)) − 3 for "m" > 2:hence::2 → "n" → "m" = "A"("m"+2,"n"-3) + 3 for "n">2:("n"=1 and "n"=2 would correspond with "A"("m",−2) = −1 and "A"("m",−1) = 1, which could logically be added.)*

hyper operator s:::"A"("m", "n") = hyper(2, m, n + 3) − 3*the indexed version of

Knuth's up-arrow notation :::"A"("m", "n") = $2uparrow^\{m-2\}\; (n+3)\; -\; 3$:The part of the definition "A"("m", 0) = A("m"-1, 1) corresponds to $2uparrow^\{m+1\}\; 3=2uparrow^m\; 4$.For small values of "m" like 1, 2, or 3, the Ackermann function grows relatively slowly with respect to "n" (at most exponentially). For "m" ≥ 4, however, it grows much more quickly; even "A"(4, 2) is about 2×10

^{19728}, and the decimal expansion of "A"(4, 3) is very large by any typical measure.If we define the function "f" ("n") = "A"("n", "n"), which increases both "m" and "n" at the same time, we have a function of one variable that dwarfs every primitive recursive function, including very fast-growing functions such as the

exponential function , the factorial function, multi- andsuperfactorial functions, and even functions defined using Knuth's up-arrow notation (except when the indexed up-arrow is used).This extreme growth can be exploited to show that "f", which is obviously computable on a machine with infinite memory such as a

Turing machine and so is acomputable function , grows faster than any primitive recursive function and is therefore not primitive recursive. Though the Ackermann function is often used to debunk the hypothesis that all useful or simple functions are primitive recursive, one should not confuse the "primitive recursive" functions with those definable by "primitive recursion" (it is this latter class that is of interest to programming language theorists because programs written using only primitive recursion are guaranteed to terminate). In a category with exponentials, using the isomorphism $A\; imes\; B\; ightarrow\; C\; cong\; A\; ightarrow\; (B\; ightarrow\; C)$, the Ackermann function may be defined via primitive recursion over higher-order functionals as follows::$egin\{array\}\{lcl\}Ack(0)\; =\; Succ\; \backslash Ack(m+1)\; =\; Iter(Ack(m))end\{array\}$

where "Succ" is the usual successor function and "Iter" is defined by primitive recursion as well:

:$egin\{array\}\{lcl\}Iter(f)(0)\; =\; f(1)\; \backslash Iter(f)(n+1)\; =\; f(Iter(f)(n)).end\{array\}$

One interesting aspect of the Ackermann function is that the only arithmetic operations it ever uses are addition and subtraction of 1. Its properties come solely from the power of unlimited

recursion . This also implies that its running time is at least proportional to its output, and so is also extremely huge. In actuality, for most cases the running time is far larger than the output; see below.**Table of values**Computing the Ackermann function can be restated in terms of an infinite table. We place the natural numbers along the top row. To determine a number in the table, take the number immediately to the left, then look up the required number in the previous row, at the position given by the number just taken. If there is no number to its left, simply look at column 1 in the previous row. Here is a small upper-left portion of the table:

The numbers listed here in a recursive reference are very large and cannot be easily notated in some other form.

Despite the large values occurring in this early section of the table, some even larger numbers have been defined, such as

Graham's number , which cannot be written with any small number of Knuth arrows. This number is constructed with a technique similar to applying the Ackermann function to itself recursively.This is a repeat of the above table, but with the values replaced by the relevant expression from the function definition to show the pattern clearly:

**Extension**The first three of Ackermann functions can be expressed through

elementary function s; they allow straightforwardanalytic extension for complex values of the second argument. In these sense, A(1,z), A(2,z), A(3,z) are analytic functions in the whole z-plane.No such extension is yet established for A(m,z) at integer m>3. The sketch in Fig.8 represents the possible realization of such extension, that remains limited at $pm\; i\; infty$. The drawing indicates that, perhaps, the extension of A(4,z), analytic in the whole z-plane, is not possible; the analytic extension should have

singularity at z=-5 and cut at the real axis for z<-5. Such cut and singularities seem to be typical also for thetetration function.**Expansion**To see how the Ackermann function grows so quickly, it helps to expand out some simple expressions using the rules in the original definition. For example, we can fully evaluate $A(1,\; 2)$ in the following way:

:$egin\{align\}A(1,2)\; =\; A(0,\; A(1,\; 1))\; \backslash \; =\; A(0,\; A(0,\; A(1,\; 0)))\; \backslash \; =\; A(0,\; A(0,\; A(0,\; 1)))\; \backslash \; =\; A(0,\; A(0,\; 2))\; \backslash \; =\; A(0,\; 3)\; \backslash \; =\; 4.end\{align\}$

To demonstrate how $A(4,\; 3)$'s computation results in many steps and in a large number::$egin\{align\}A(4,\; 3)\; =\; A(3,\; A(4,\; 2))\; \backslash \; =\; A(3,\; A(3,\; A(4,\; 1)))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(4,\; 0))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(3,\; 1))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(3,\; 0)))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(2,\; 1)))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(1,\; A(2,\; 0))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(1,\; A(1,\; 1))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(1,\; A(0,\; A(1,\; 0)))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(1,\; A(0,\; A(0,\; 1)))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(1,\; A(0,\; 2))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(1,\; 3)))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(0,\; A(1,\; 2))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(0,\; A(0,\; A(1,\; 1)))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(0,\; A(0,\; A(0,\; A(1,\; 0))))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(0,\; A(0,\; A(0,\; A(0,\; 1))))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(0,\; A(0,\; A(0,\; 2))))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(0,\; A(0,\; 3)))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; A(0,\; 4)))))\; \backslash \; =\; A(3,\; A(3,\; A(3,\; A(2,\; 5))))\; \backslash \; =\; ...\; \backslash \; =\; A(3,\; A(3,\; A(3,\; 13)))\; \backslash \; =\; ...\; \backslash \; =\; A(3,\; A(3,\; 65533))\; \backslash \; =\; ...\; \backslash \; =\; A(3,\; 2^\{65536\}\; -\; 3)\; \backslash \; =\; ...\; \backslash \; =\; 2^\{2^\{\; overset\{65536\}\{\}$ - 3 \end{align}

Written as a power of 10, this is roughly equivalent to 10

^{1019727.78}**Inverse**Since the function "f" ("n") = "A"("n", "n") considered above grows very rapidly, its

inverse function , "f"^{−1}, grows very slowly. This**inverse Ackermann function**"f"^{−1}is usually denoted by α. In fact, α(n) is less than 5 for any conceivable input size "n", since A(4, 4) is on the order of $2^\{2^\{10^\{19729\}$. "For all practical purposes", α("n") can be regarded as being a constant.This inverse appears in the time complexity of some

algorithm s, such as thedisjoint-set data structure and Chazelle's algorithm forminimum spanning tree s. Sometimes Ackermann's original function or other variations are used in these settings, but they all grow at similarly high rates. In particular, some modified functions simplify the expression by eliminating the "−3" and similar terms.A two-parameter variation of the inverse Ackermann function can be defined as follows::$alpha(m,n)\; =\; min\{i\; geq\; 1\; :\; A(i,lfloor\; m/n\; floor)\; geq\; log\_2\; n\}.$This function arises in more precise analyses of the algorithms mentioned above, and gives a more refined time bound. In the disjoint-set data structure, "m" represents the number of operations while "n" represents the number of elements; in the minimum spanning tree algorithm, "m" represents the number of edges while "n" represents the number of vertices.Several slightly different definitions of α("m", "n") exist; for example, log

_{2}"n" is sometimes replaced by "n", and thefloor function is sometimes replaced by a ceiling.Other studies might define an inverse function of one where m is set to a constant, such that the inverse applies to a particular row. [

*[*]*http://cat.inist.fr/?aModele=afficheN&cpsidt=15618233 An inverse-Ackermann style lower bound for the online minimum spanning tree verification problem*] November 2002**Use as benchmark**The Ackermann function, due to its definition in terms of extremely deep recursion, can be used as a benchmark of a

compiler 's ability to optimize recursion. The first use of Ackermann's function in this way was by Yngve Sundblad, "The Ackermann function. A Theoretical, computational and formula manipulative study." (BIT 11 (1971), 107119).This seminal paper was taken up by Brian Wichmann (co-author of the Whetstone benchmark) in a trilogy of papers written between 1975 and 1982. [

*cite web | title=Ackermann's Function: A Study In The Efficiency Of Calling Procedures | year = 1975 | url=http://history.dcs.ed.ac.uk/archive/docs/Imp_Benchmarks/ack.pdf*] [*cite web | title=How to Call Procedures, or Second Thoughts on Ackermann's Function | year = 1977 | url=http://history.dcs.ed.ac.uk/archive/docs/Imp_Benchmarks/ackpe.pdf*] [*cite web | title=Latest results from the procedure calling test, Ackermann's function | year = 1982 | url=http://history.dcs.ed.ac.uk/archive/docs/Imp_Benchmarks/acklt.pdf*]A more recent use of Ackermann's function as a compiler benchmark is in [

*http://shootout.alioth.debian.org/ The Computer Language Shootout*] which compares the time required to evaluate this function for fixed arguments in many different programming language implementations. [*cite web | title=Gentoo: Intel Pentium 4 Computer Language Shootout | year=2006 | url=http://shootout.alioth.debian.org/gp4/benchmark.php?test=recursive&lang=all | accessdate=2006-06-13*] [*[*]*http://www.xgc.com/benchmarks/benchmarks.htm Benchmarks*] XGC, May 11, 2005For example, a compiler which, in analyzing the computation of "A"(3, 30), is able to save intermediate values like the "A"(3, "n") and "A"(2, "n") in that calculation rather than recomputing them, can speed up computation of "A"(3, 30) by a factor of hundreds of thousands. Also, if "A"(2, "n") is computed directly rather than as a recursive expansion of the form "A"(1, "A"(1, "A"(1,..."A"(1, 0)...))), this will save significant amounts of time. Computing "A"(1, "n") takes linear time in "n". Computing "A"(2, "n") requires quadratic time, since it expands to O("n") nested calls to "A"(1, "i") for various "i". Computing "A"(3, "n") requires time proportionate to 4

^{"n"+1}. The computation of "A"(3, 1) in the example above takes 16 (4^{2}) steps."A"(4, 2), which appears as a decimal expansion in several web pages, cannot possibly be computed by simple recursive application of the Ackermann function in any tractable amount of time. Instead, shortcut formulas such as "A"(3, "n") = 8×2

^{"n"}−3 are used as an optimization to complete some of the recursive calls.A practical method of computing functions similar to Ackermann's is to use

memoization of intermediate results. A compiler could apply this technique to a function automatically usingDonald Michie 's "memo functions". [*[*] Fact|date=February 2007*http://www.gtoal.com/plsql/ackerman-memo.pls.html Example: Explicit memo function version of Ackermann's function*] implemented in PL/SQL**Implementations**The first implementation in a programming language was written in the Fortran programming language in 1964, see H. Gordon Rice [

*The author of*] , "Recursion and iteration", Commun. ACM, 8(2), 1965, pp. 114--115.)Rice's theorem !In the C programming language, it can be implemented like this:

In the Haskell language, it can be implemented like this:

ack 0 n = n+1 ack (m+1) 0 = ack m 1 ack (m+1) (n+1) = ack m (ack (m+1) n)

**Ackermann numbers**Related to the Ackermann function but in fact different are the Ackermann numbers, a

sequence where the n^{th}term equals::$egin\{matrix\}\; n\; underbrace\{uparrowdotsuparrow\}\; n\; \backslash \; n\; end\{matrix\}$

in the

Knuth's up-arrow notation , or

*$n\; o\; n\; o\; n$in the

Conway chained arrow notation . [*[*]*http://mathworld.wolfram.com/AckermannNumber.html Ackermann Number*]For instance, the first three Ackermann numbers are:*1$uparrow$1,:*2$uparrowuparrow$2:*3$uparrowuparrowuparrow$3which equal the following::*1

^{1}= 1:*$\{\; ^\{2\}2\}$ = 4:*$\{\; ^\{^\{^3\}3\}3\}\; =\; 3uparrowuparrow3uparrowuparrow3\; =\; egin\{matrix\}\; underbrace\{qquadquad3^\{3^\{3^\{3^\{3^\{3^\{.^\{.^\{.^\{3\}qquadquad\}\; \backslash \; 3^\{27\}\{\; m\; or\; \}\; 7625597484987\{\; m\; threes\}end\{matrix\}$An attempt to express the fourth Ackermann number, 4$uparrowuparrowuparrowuparrow$4, using iterated

exponentiation as above would become extremely complicated. However, it can be expressed using tetration in three nested layers as shown below. Explanation: in the middle layer, there is a tower of tetration whose full length is $^\{^\{^\{^4\}4\}4\}4$ and the final result is the top layer of tetrated 4's whose full length equals the calculation of the middle layer. Note that by way of size comparison, the simple expression $^\{^4\}4$ already exceeds agoogolplex , so the fourth Ackermann number is quite large.:$egin\{matrix\}\; underbrace\{egin\{matrix\}\; underbrace\{^\{^\{^\{^\{^\{^\{^\{4\}.\}.\}.\}4\}4\}4\}4\}\; \backslash \; ^\{^\{^\{^\{^\{^\{^\{4\}.\}.\}.\}4\}4\}4\}4\; end\{matrix\; \backslash \; ^\{^\{^\{^4\}4\}4\}4\; end\{matrix\}$

**In popular culture**Randall Munroe has mentioned the Ackermann function in his popular web-comicxkcd . [*cite web|title="What xkcd Means"|url=http://xkcd.com/c207.html|accessdate=2007-06-25*] In the comic, Munroe makes reference to the Ackermann function withGraham's number as the arguments. At the time, he considered this to be the largest number ever concisely defined and named it "The xkcd number". [*cite web|title="The Clarkkkkson vs. the xkcd Number"|url=http://blag.xkcd.com/2007/01/11/the-clarkkkkson-vs-the-xkcd-number/|accessdate=2007-06-25*]A question involving this function was posed at the

International Mathematical Olympiad , the most significant mathematics competition for school age students, in 1981.cite web|title="International Mathematics Olympiad Problems, Year 1981"|url=http://www.imo-official.org/year_info.aspx?year=1981|accessdate=2008-10-06**ee also***

Computability theory (computer science)

*Charity (programming language)

*Recursion (computer science) **Notes and references****External links***mathworld | urlname = AckermannFunction | title = Ackermann function

*DADS|Ackermann's function|ackermann

*Scott Aaronson, " [*http://www.scottaaronson.com/writings/bignumbers.html Who can name the biggest number?*] " (1999)

* [*http://www-users.cs.york.ac.uk/~susan/cyc/a/ackermnn.htm Ackermann function's*] . Includes a table of some values.

* [*http://forum.wolframscience.com/showthread.php?s=&threadid=579 Hyper-operations: Ackermann's Function and New Arithmetical Operation*]

* [*http://www.mrob.com/pub/math/largenum.html Robert Munafo's Large Numbers*] describes several variations on the definition of "A".

*Gabriel Nivasch, [*http://www.yucs.org/~gnivasch/alpha/index.html Inverse Ackermann without pain*] on the inverse Ackermann function.

*Raimund Seidel, " [*http://cgi.di.uoa.gr/~ewcg06/invited/Seidel.pdf Understanding the inverse Ackermann function*] " (PDF presentation).

*Wikimedia Foundation.
2010.*