Left recursion

From Wikipedia, the free encyclopedia
Jump to: navigation, search

In the formal language theory of computer science, left recursion is a special case of recursion where a string is recognized as part of a language by the fact that it decomposes into a string from that same language (on the left) and a suffix (on the right). For instance, 1+2+3 can be recognized as a sum because it can be broken into 1+2, also a sum, and {}+3, a suitable suffix.

In terms of context-free grammar, a nonterminal is left-recursive if the leftmost symbol in one of its productions is itself (in the case of direct left recursion) or can be made itself by some sequence of substitutions (in the case of indirect left recursion).

Definition[edit]

A grammar is left-recursive if and only if there exists a nonterminal symbol A that can derive to a sentential form with itself as the leftmost symbol.[1] Symbolically,

 A \Rightarrow^+ A\alpha,

where \Rightarrow^+ indicates the operation of making one or more substitutions, and \alpha is any sequence of terminal and nonterminal symbols.

Direct left recursion[edit]

Direct left recursion occurs when the definition can be satisfied with only one substitution. It requires a rule of the form

A \to A\alpha

where \alpha is a sequence of nonterminals and terminals. For example, the rule

\mathit{Expression} \to \mathit{Expression} + \mathit{Term}

is directly left-recursive. A left-to-right recursive descent parser for this rule might look like

function Expression()
{
    Expression();  match('+');  Term();
}

and such code would fall into infinite recursion when executed.

Indirect left recursion[edit]

Indirect left recursion occurs when the definition is satisfied via several substitutions. It entails a set of rules following the pattern

A_0 \to \beta_0A_1\alpha_0
A_1 \to \beta_1A_2\alpha_1
\cdots
A_n \to \beta_nA_0\alpha_n

where \beta_0, \beta_1, \ldots, \beta_n are sequences that can each yield the empty string, while \alpha_0, \alpha_1, \ldots, \alpha_n may be any sequences at all. The derivation

A_0\Rightarrow\beta_0A_1\alpha_0\Rightarrow^+ A_1\alpha_0\Rightarrow\beta_1A_2\alpha_1\alpha_0\Rightarrow^+\cdots\Rightarrow^+ A_0\alpha_n\dots\alpha_1\alpha_0

then gives A_0 as leftmost in its final sentential form.

Removing left recursion[edit]

Left recursion often poses problems for parsers, either because it leads them into infinite recursion (as in the case of most top-down parsers) or because they expect rules in a normal form that forbids it (as in the case of many bottom-up parsers, including the CYK algorithm). Therefore a grammar is often preprocessed to eliminate the left recursion.

Removing direct left recursion[edit]

The general algorithm to remove direct left recursion follows. Several improvements to this method have been made.[2] For a left-recursive nonterminal A, discard any rules of the form A\rightarrow A and consider those that remain:

A \rightarrow A\alpha_1 \mid \ldots \mid A\alpha_n \mid \beta_1 \mid \ldots \mid \beta_m

where:

  • each \alpha is a nonempty sequence of nonterminals and terminals, and
  • each \beta is a sequence of nonterminals and terminals that does not start with A.

Replace these with two sets of productions, one set for A:

A \rightarrow \beta_1A^\prime \mid \ldots \mid \beta_mA^\prime

and another set for the fresh nonterminal A' (often called the "tail" or the "rest"):

A^\prime \rightarrow \alpha_1A^\prime \mid \ldots \mid \alpha_nA^\prime \mid \epsilon

Repeat this process until no direct left recursion remains.

As an example, consider the rule set

\mathit{Expression} \rightarrow \mathit{Expression}+\mathit{Expression} \mid \mathit{Integer} \mid \mathit{String}

This could be rewritten to avoid left recursion as

\mathit{Expression} \rightarrow \mathit{Integer}\,\mathit{Expression}' \mid \mathit{String}\,\mathit{Expression}'
\mathit{Expression}' \rightarrow {}+\mathit{Expression}\,\mathit{Expression}' \mid \epsilon

Removing all left recursion[edit]

By establishing a topological ordering on nonterminals, the above process can be extended to also eliminate indirect left recursion:

Inputs A grammar: a set of nonterminals A_1,\ldots,A_n and their productions
Output A modified grammar generating the same language but without left recursion
  1. For each nonterminal A_i:
    1. Repeat until an iteration leaves the grammar unchanged:
      1. For each rule A_i\rightarrow\alpha_i, \alpha_i being a sequence of terminals and nonterminals:
        1. If \alpha_i begins with a nonterminal A_j and j<i:
          1. Let \beta_i be \alpha_i without its leading A_j.
          2. Remove the rule A_i\rightarrow\alpha_i.
          3. For each rule A_j\rightarrow\alpha_j:
            1. Add the rule A_i\rightarrow\alpha_j\beta_i.
    2. Remove direct left recursion for A_i as described above.

Note that this algorithm is highly sensitive to the nonterminal ordering; optimizations often focus on choosing this ordering well.

Pitfalls[edit]

Although the above transformations preserve the language generated by a grammar, they may change the parse trees that witness strings' recognition. With suitable bookkeeping, tree rewriting can recover the originals, but if this step is omitted, the differences may change the semantics of a parse.

Associativity is particularly vulnerable; left-associative operators typically appear in right-associative-like arrangements under the new grammar. For example, starting with this grammar:

\mathit{Expression} \rightarrow \mathit{Expression}\,-\,\mathit{Term} \mid \mathit{Term}
\mathit{Term} \rightarrow \mathit{Term}\,*\,\mathit{Factor} \mid \mathit{Factor}
\mathit{Factor} \rightarrow (\mathit{Expression}) \mid \mathit{Integer}

the standard transformations to remove left recursion yield the following:

\mathit{Expression} \rightarrow \mathit{Term}\ \mathit{Expression}'
\mathit{Expression}' \rightarrow {} - \mathit{Term}\ \mathit{Expression}' \mid \epsilon
\mathit{Term} \rightarrow \mathit{Factor}\ \mathit{Term}'
\mathit{Term}' \rightarrow {} * \mathit{Factor}\ \mathit{Term}' \mid \epsilon
\mathit{Factor} \rightarrow (\mathit{Expression}) \mid \mathit{Integer}

Parsing the string "1 - 2 - 3" with the first grammar in an LALR parser (which can handle left-recursive grammars) would have resulted in the parse tree:

Left-recursive parsing of a double subtraction

This parse tree groups the terms on the left, giving the correct semantics (1 - 2) - 3.

Parsing with the second grammar gives

Right-recursive parsing of a double subtraction

which, properly interpreted, signifies 1 + (-2 + (-3)), also correct, but less faithful to the input and much harder to implement for some operators. Notice how terms to the right appear deeper in the tree, much as a right-recursive grammar would arrange them for 1 - (2 - 3).

Accommodating left recursion in top-down parsing[edit]

A formal grammar that contains left recursion cannot be parsed by a LL(k)-parser or other naive recursive descent parser unless it is converted to a weakly equivalent right-recursive form. In contrast, left recursion is preferred for LALR parsers because it results in lower stack usage than right recursion. However, more sophisticated top-down parsers can implement general context-free grammars by use of curtailment. In 2006, Frost and Hafiz described an algorithm which accommodates ambiguous grammars with direct left-recursive production rules.[3] That algorithm was extended to a complete parsing algorithm to accommodate indirect as well as direct left recursion in polynomial time, and to generate compact polynomial-size representations of the potentially exponential number of parse trees for highly ambiguous grammars by Frost, Hafiz and Callaghan in 2007.[4] The authors then implemented the algorithm as a set of parser combinators written in the Haskell programming language.[5]

See also[edit]

References[edit]

  1. ^ Notes on Formal Language Theory and Parsing, James Power, Department of Computer Science National University of Ireland, Maynooth Maynooth, Co. Kildare, Ireland.JPR02
  2. ^ Moore, Robert C. (May 2000). "Removing Left Recursion from Context-Free Grammars" (PDF). 6th Applied Natural Language Processing Conference: 249–255. 
  3. ^ Frost, R.; R. Hafiz (2006). "A New Top-Down Parsing Algorithm to Accommodate Ambiguity and Left Recursion in Polynomial Time.". ACM SIGPLAN Notices 41 (5): 46–54. doi:10.1145/1149982.1149988. , available from the author at http://hafiz.myweb.cs.uwindsor.ca/pub/p46-frost.pdf
  4. ^ Frost, R.; R. Hafiz; P. Callaghan (June 2007). "Modular and Efficient Top-Down Parsing for Ambiguous Left-Recursive Grammars." (PDF). 10th International Workshop on Parsing Technologies (IWPT), ACL-SIGPARSE (Prague): 109–120. 
  5. ^ Frost, R.; R. Hafiz; P. Callaghan (January 2008). "Parser Combinators for Ambiguous Left-Recursive Grammars" (PDF). 10th International Symposium on Practical Aspects of Declarative Languages (PADL), ACM-SIGPLAN. Lecture Notes in Computer Science 4902 (2008): 167–181. doi:10.1007/978-3-540-77442-6_12. ISBN 978-3-540-77441-9. 

External links[edit]