Normalization property (abstract rewriting)
In mathematical logic and theoretical computer science, a rewrite system has the (strong) normalization property or is terminating if every term is strongly normalizing; that is, if every sequence of rewrites eventually terminates with an irreducible term, also called a normal form. A rewrite system may also have the weak normalization property, meaning that for every term, there exists at least one particular sequence of rewrites that eventually yields a normal form, i.e., an irreducible term.
Untyped lambda calculus
The pure untyped lambda calculus does not satisfy the strong normalization property, and not even the weak normalization property. Consider the term . It has the following rewrite rule: For any term ,
But consider what happens when we apply to itself:
Therefore the term is neither strongly nor weakly normalizing.
Typed lambda calculus
A lambda calculus system with the normalization property can be viewed as a programming language with the property that every program terminates. Although this is a very useful property, it has a drawback: a programming language with the normalization property cannot be Turing complete. That means that there are computable functions that cannot be defined in the simply typed lambda calculus (and similarly there are computable functions that cannot be computed in the calculus of constructions or System F). As an example, it is impossible to define a self-interpreter in any of the calculi cited above .
- Typed lambda calculus
- Total functional programming
- Barendregt–Geuvers–Klop conjecture
- Newman's lemma
- Normalization by evaluation
- University of Rochester, 
- (in the sense that it forces the language to be untyped or not to be a total language); assume "eval" is the function that interprets language TLC (typed lambda calculus) and it takes the "code" as its argument , it is impossible semantically to type "eval" correctly (that is to define its type) either cause you can't type all possible TLC code fragments (since there are uncountably infinite number of them (Diagonal Argument), or if you made it take type like "string" type, the parse it you covered the problem in terms of implementation but not in terms of semantical correctness (assume another function "evil" which does the following (evil = 1 + eval([evil's code goes here]) and that escapes Normalization property ("evil" will never normalize, and that is because it breaks some of the Strong Normalization Proof assumptions (cause it implies dependent data types) ) ) ).
- Conor McBride (May 2003), "on termination" (posted to the Haskell-Cafe mailing list).
- Andrej Bauer (June 2014), Answer to: A total language that only a Turing complete language can interpret (posted to the Theoretical Computer Science StackExchange site)