Extended Euclidean algorithm

In arithmetic and computer programming, the extended Euclidean algorithm is an extension to the Euclidean algorithm, which computes, besides the greatest common divisor of integers a and b, the coefficients of Bézout's identity, that is integers x and y such that

ax+by=\gcd(a,b).

It allows to compute also, with almost no extra cost, the quotients of a and b by their greatest common divisor.

Extended Euclidean algorithm refers also to a very similar algorithm for computing the polynomial greatest common divisor and the coefficients of Bézout's identity of two univariate polynomials.

The extended Euclidean algorithm is particularly useful when a and b are coprime, since x is the modular multiplicative inverse of a modulo b, and y is the modular multiplicative inverse of b modulo a. Similarly, the polynomial extended Euclidean algorithm allows to compute the multiplicative inverse in algebraic field extensions and, in particular in finite fields of non prime order. It follows that both extended Euclidean algorithms are widely used in cryptography. In particular, the computation of the modular multiplicative inverse is an essential step in RSA public-key encryption method.

Description of the algorithm

The standard Euclidean algorithm proceeds by a succession of Euclidean divisions whose quotients are not used, only the remainders are kept. For the extended algorithm, the successive quotient are used. More precisely, the standard Euclidean algorithm with a and b as input, consists in computing sequence $q_{1},\ldots ,q_{k}$ of quotients and a sequence $r_{0},\ldots ,r_{k+1}$ of remainders such that

{\begin{array}{l}r_{0}=a\\r_{1}=b\\\ldots \\r_{i+1}=r_{i-1}-q_{i}r_{i}\quad {\text{and}}\quad 0\leq r_{i+1}<|r_{i}|\\\ldots \end{array}}

It is the main property of Euclidean division that the inequalities on the right define uniquely $r_{i+1}$ from $r_{i-1}$ and $r_{i}.$

The computation stops when one reaches a remainder $r_{k+1}$ which is zero; the greatest common divisor is then the last non zero remainder $r_{k}.$

The extended Euclidean algorithm proceeds similarly, but adds two other sequences defined by

{\begin{array}{l}s_{0}=1\qquad s_{1}=0\\t_{0}=0\qquad t_{1}=1\\\ldots \\s_{i+1}=s_{i-1}-q_{i}s_{i}\\t_{i+1}=t_{i-1}-q_{i}t_{i}\\\ldots \end{array}}

The computation stops also when $r_{k+1}=0$ and gives

$r_{k}$ is the greatest common divisor of the input $a=r_{0}$ and $b=r_{1}.$
The Bézout coefficients are $s_{k}$ and $t_{k},$ that is $GCD(a,b)=r_{k}=as_{k}+bt_{k}$
The quotients of a and b by their greatest common divisor are given by $s_{k+1}=\pm {\frac {b}{GCD(a,b)}}$ and $t_{k+1}=\pm {\frac {a}{GCD(a,b)}}$

Moreover, if a and b are both positive, we have

|s_{k}|<{\frac {b}{GCD(a,b)}}\quad {\text{and}}\quad |t_{k}|<{\frac {a}{GCD(a,b)}}.

This means that the pair of Bézout's coefficients provided by the extended Euclidean algorithm is one of the two minimal pairs of Bézout coefficients.

Example

The following table shows how the extended Euclidean algorithm proceeds with input $240$ and $46$ . The greatest common divisor is the last non zero entry, $2$ in the column "remainder". The computation stops at row 6, because the remainder in it is $0$ . Bézout coefficients appear in the last two entries of the second-to-last row. In fact, it is easy to verify that $-9 \times 240 + 47 \times 46 = 2$ . Finally the last two entries $23$ and $-120$ of the last row are, up to the sign, the quotients of the input $46$ and $240$ by the greatest common divisor 2.

index i	quotient q_i-1	Remainder r_i	s_i	t_i
0		240	1	0
1		46	0	1
2	240 ÷ 46 = 5	240 − 5 × 46 = 10	1 − 5 × 0 = 1	0 - 5 × 1 = -5
3	46 ÷ 10 = 4	46 − 4 × 10 = 6	0 − 4 × 1 = -4	1 - 4 × -5 = 21
4	10 ÷ 6 = 1	10 − 1 × 6 = 4	1 − 1 × -4 = 5	-5 - 1 × 21 = -26
5	6 ÷ 4 = 1	6 − 1 × 4 = 2	-4 − 1 × 5 = -9	21 - 1 × -26 = 47
6	4 ÷ 2 = 2	4 − 2 × 2 = 0	5 − 2 × -9 = 23	-26 - 2 × 47 = -120

Proof

Variant: As $0\leq r_{i+1}<|r_{i}|,$ the sequence of the $r_{i}$ is a decreasing sequence nonnegative integers (from i = 2 on). Thus is must stop with some $r_{k+1}=0.$ This proves that the algorithm stops eventually.

Invariant: As $r_{i+1}=r_{i-1}-r_{i}q_{i},$ the common divisors and the greatest one are the same for $(r_{i-1},r_{i})$ and $(r_{i},r_{i+1}).$ This shows that the greatest common divisor of the input $a=r_{0},b=r_{1}$ is the same as the one of $r_{k},r_{k+1}=0.$ This proves that $r_{k}$ is the greatest common divisor of a and b. Let us call it d(until this point, the proof is the same as that of the classical Euclidean algorithm).

Extended part:

Invariant: As $a=r_{0}$ and $b=r_{1},$ we have $as_{i}+bt_{i}=r_{i}$ for i = 0 and 1. A $r_{i},$ $s_{i}$ and $t_{i}$ satisfy the same linear recurrence relation, the relation $as_{i}+bt_{i}=r_{i}$ holds for every i and, in particular $as_{k}+bt_{k}=r_{k},$ showing that $(s_{k},t_{k})$ are Bézout coefficients.

Let us consider the matrix

A_{i}={\begin{pmatrix}s_{i-1}&s_{i}\\t_{i-1}&t_{i}\end{pmatrix}}\,.

The recurrence relation may be rewritten in matrix form

A_{i+1}=A_{i}\,.\,{\begin{pmatrix}0&1\\1&-q_{i}\end{pmatrix}}\,.

The matrix $A_{1}$ is the identity matrix and its determinant is one. The determinant of the rightmost matrix in the preceding formula is -1. It follows tha the determinant of $A_{i}$ is $(-1)^{i-1}.$ In particular, for i = k + 1, we have $s_{k}t_{k+1}-t_{k}s_{k+1}=(-1)^{k}.$ Viewing this as a Bézout's identity, this show that $s_{k+1}$ and $t_{k+1}$ are coprime. The relation $as_{k+1}+bt_{k+1}=0$ that has been proved above and Euclid's lemma show that $s_{k+1}$ divides b and $t_{k+1}$ divides a. As they are coprime, they are, up to their sign the quotients of b and a by their greatest common divisor.

Polynomial extended Euclidean algorithm

For univariate polynomials with coefficients in a field, everything works in a similar way, Euclidean division, Bézout's identity and extended Euclidean algorithm. The first difference is that, in the Euclidean division and the algorithm, the inequality $0\leq r_{i+1}<|r_{i}|$ has to be replaced by an inequality on the degrees $\deg r_{i+1}<\deg r_{i}.$ Otherwise, everything which precedes in this article remains the same, simply by replacing integers by polynomials.

A second difference lies in the bound on the size of the Bézout coefficients provided by the extended Euclidean algorithm, which is more accurate in the polynomial case: If a and b are two nonzero polynomials, then the extended Euclidean algorithm produces the unique pair of polynomials (s, t) such that

as+bt=\gcd(a,b)

and

\deg s<\deg b-\deg(\gcd(a,b)),\quad \deg t<\deg a-\deg(\gcd(a,b)).

(proof needed)

A third difference is that, in the polynomial case, the greatest common divisor is defined only up to the multiplication by a non zero constant. There are several ways to define the greatest common divisor unambiguously.

In mathematics, it is common to require that the greatest common divisor be a monic polynomial. To get this, it suffices to divide every element of the output by the leading coefficient of $r_{k}.$ This allows that, if a and b are coprime, one gets 1 in the right-hand side of Bézout's inequality. Otherwise, one may get any non-zero constant. In computer algebra, the polynomials have commonly integers coefficients, and this way of normalizing the greatest common divisor introduces too many fractions to be convenient.

The second way to normalize the greatest common divisor in the case of polynomials with integers coefficients is to divide every output by the content of $r_{k},$ to get a primitive greatest common divisor. If the input polynomials are coprime, this normalization provides also a greatest common divisor equal to 1. The drawback of this approach is that a lot of fractions should be computed and simplified during the computation.

A third approach consists in extending the algorithm of subresultant pseudo-remainder sequences in a way that is similar to the extension of the Euclidean algorithm to the extended Euclidean algorithm. This allows that, when starting with polynomials with integer coefficients, all polynomials that are computed have integer coefficients. Moreover, every computed remainder $r_{i}$ is a subresultant polynomial. In particular, if the input polynomials are coprime, then the Bézout's identity becomes

as+bt=\operatorname {Res} (a,b),

where $\operatorname {Res} (a,b)$ denotes the resultant of a and b. In this form of Bézout's identity there is no denominator in the formula. If one divides everything by the resultant one gets the classical Bézout's identity, with an explicit common denominator for the rational numbers that appear in it.

Pseudocode

To implement the algorithm that is described above, one should first remark that only the two last values of the indexed variables are needed at each step. Thus, for saving memory, each indexed variable must be replaced by only two variables.

For simplicity, the following algorithm (and the other algorithms in this article) uses parallel assignments. In a programming language which does not have this feature, the parallel assignments need to be simulated with an auxiliary variable. For example, the first one,

(old_r, r) := (r, old_r - quotient *r)

is equivalent with

prov := r;
r := old_r - quotient * prov;
old_r := prov;

and similarly for the other parallel assignments. This leads to the following code:

function extended_gcd(a, b)
    s := 0;    old_s := 1
    t := 1;    old_t := 0
    r := b;    old_r := a
    while r ≠ 0
        quotient := old_r div r
        (old_r, r) := (r, old_r - quotient *r)
        (old_s, s) := (s, old_s - quotient *s)
        (old_t, t) := (t, old_t - quotient *t)       
    output "Bézout coefficients:", (old_s, old_t)
    output "greatest common divisor:", old_r
    output "quotients by the gcd:", (t, s)

It should be noted that the quotients of a and b by their greatest common divisor, which are output, may have an incorrect sign. This is easy to correct at the end of the computation, but has not been done here for simplifying the code. Similarly, if either a or b is zero and the other is negative, the greatest common divisor that is output is negative, and all the signs of the output must be changed.

Simplification of fractions

A fraction ${\frac {a}{b}}$ is in canonical simplified form if $a$ and $b$ are coprime and $b$ is positive. This canonical simplified form can be obtained by replacing the three output lines of the preceding pseudo code by

if s = 0 then output "Division by zero"
if s = 1 then output  $-t$      (Optional line, for avoiding output like  ${\frac {-t}{1}}$ 
else if s > 0 then output  ${\frac {-t}{s}}$ 
else return   ${\frac {t}{-s}}$

The proof of this algorithm relies on the fact that s and t are two coprime integers such that as + bt = 0, and thus ${\frac {a}{b}}=-{\frac {t}{s}}$ . To get the canonical simplified form, it suffices to move the minus sign for having a positive denominator.

If b divides a evenly, the algorithm executes only one iteration, and we have s = 1 at the end of the algorithm. It the only case where the output is an integer.

Computing multiplicative inverses in modular structures

Extended Euclidean algorithm is the basic tool for computing multiplicative inverses in modular structures, typically the modular integers and the algebraic field extensions. An important instance of the latter case are the finite fields of non-prime order.

Modular integers

If $n$ is a positive integer, the ring $Z / n Z$ may be identified with the set ${0, 1, ..., n}$ of the remainders of Euclidean division by $n$ , the addition and the multiplication consisting in taking the remainder by $n$ of the result of the addition and the multiplication of integers. An element $a$ of $Z / n Z$ has a multiplicative inverse (that is, it is a unit) if it is coprime to $n$ . In particular, if $n$ is prime, $a$ has a multiplicative inverse if it is not zero (modulo $n$ ). Thus $Z / n Z$ is a field if and only if $n$ is prime.

Bézout's identity asserts that $a$ and $n$ are coprime if and only if there exist integers $s$ and $t$ such that

ns+at=1

Reducing this identity modulo $n$ gives

at=1\mod n.

Thus $t$ , or, more exactly, the remainder of the division of $t$ by $n$ , is the multiplicative inverse of $a$ modulo $n$ .

To adapt the extended Euclidean algorithm to this problem, one should remark that the Bézout coefficient of $n$ is not needed, and thus does not need to be computed. Also, for getting a result which is positive and lower than n, one may use the fact that the integer $t$ provided by the algorithm satisfies $| t | < n$ . That is, if $t < 0$ , one must add $n$ to it at the end. This results in the pseudocode, in which the input n is an integer larger than 1.

function inverse(a, n)
    t := 0;     newt := 1;    
    r := n;     newr := a;    
    while newr ≠ 0
        quotient := r div newr
        (t, newt) := (newt, t - quotient * newt) 
        (r, newr) := (newr, r - quotient * newr)
    if r > 1 then return "a is not invertible"
    if t < 0 then t := t + n
    return t

Simple algebraic field extensions

Extended Euclidean algorithm is also the main tool for computing multiplicative inverses in simple algebraic field extensions. An important case, widely used in cryptography and coding theory is that of finite fields of non-prime order. In fact, if $p$ is a prime number, and $q = p d$ , the field of order $q$ is a simple algebraic extension of the prime field of $p$ elements, generated by a root of an irreducible polynomial of degree $d$ .

A simple algebraic extension $L$ of a field $K$ , generated by the root of an irreducible polynomial $p$ of degree $d$ may be identified to the quotient ring $K[X]/\langle p\rangle ,$ , and its elements are in bijective correspondence with the polynomials of degree less than $d$ . The addition in $L$ is the addition of polynomials. The multiplication in $L$ is the remainder of the Euclidean division by $p$ of the product of polynomials. Thus, to complete the arithmetic in $L$ , it remains only to define how to compute multiplicative inverses. This is done by the extended Euclidean algorithm.

The algorithm is very similar to that provided above for computing the modular multiplicative inverse. There are two main differences: firstly the last but one line is not needed, because the Bézout coefficient that is provided has always a degree less than $d$ . Secondly, the greatest common divisor which is provided, when the input polynomials are coprime, may be any non zero element of $K$ ; this Bézout coefficient (a polynomial generally of positive degree) has thus to be multiplied by the inverse of this element of $K$ . In the pseudocode which follows, $p$ is a polynomial of degree greater than one, and $a$ is a polynomial. Moreover, div is an auxiliary function that computes the quotient of the Euclidean division.

function inverse(a, p)
    t := 0;     newt := 1;    
    r := p;     newr := a;    
    while newr ≠ 0
        quotient := r div newr
        (r, newr) := (newr, r - quotient * newr)
        (t, newt) := (newt, t - quotient * newt) 
    if degree(r) > 0 then 
        return "Either p is not irreducible or a is a multiple of p"
    return (1/r) * t

Example

For example, if the polynomial used to define the finite field GF(2⁸) is p = x⁸ + x⁴ + x³ + x + 1, and a = x⁶ + x⁴ + x + 1 is the element whose inverse is desired, then performing the algorithm results in the computation described in the following table. Let us recall that in fields of order 2ⁿ, one has -z = z and z + z = 0 for every element z in the field). Note also that 1 being the only nonzero element of GF(2), the adjustment in the last line of the pseudocode is not needed.

step	quotient	r, newr	t, newt
		p = x⁸ + x⁴ + x³ + x + 1	0
		a = x⁶ + x⁴ + x + 1	1
1	x² + 1	x² = p - a (x² + 1)	x² + 1 = 0 - 1 × (x² + 1)
2	x⁴ + x²	x + 1 = a - x² (x⁴ + x²)	x⁶ + x² + 1 = 1 - (x⁴ + x²) (x² + 1)
3	x + 1	1 = x² - (x + 1) (x + 1)	x⁷ + x⁶ + x³ + x = (x² + 1) - (x + 1) (x⁶ + x² + 1)
4	x + 1	0 = (x + 1) - 1 × (x + 1)

Thus, the inverse is x⁷ + x⁶ + x³ + x, as can be confirmed by multiplying the two elements together, and taking the remainder by $p$ of the result.

The case of more than two numbers

One can handle the case of more than two numbers iteratively. First we show that $\gcd(a,b,c)=\gcd(\gcd(a,b),c)$ . To prove this let $d=\gcd(a,b,c)$ . By definition of gcd $d$ is a divisor of $a$ and $b$ . Thus $\gcd(a,b)=kd$ for some $k$ . Similarly $d$ is a divisor of $c$ so $c=jd$ for some $j$ . Let $u=\gcd(k,j)$ . By our construction of $u$ , $ud|a,b,c$ but since $d$ is the greatest divisor $u$ is a unit. And since $ud=\gcd(gcd(a,b),c)$ the result is proven.

So if $na+mb=\gcd(a,b)$ then there are $x$ and $y$ such that $x\gcd(a,b)+yc=\gcd(a,b,c)$ so the final equation will be

x(na+mb)+yc=(xn)a+(xm)b+yc=\gcd(a,b,c).\,

So then to apply to n numbers we use induction

\gcd(a_{1},a_{2},\dots ,a_{n})=\gcd(a_{1},\,\gcd(a_{2},\,\gcd(a_{3},\dots ,\gcd(a_{n-1}\,,a_{n})))\dots ),

with the equations following directly.

References

Knuth, Donald. The Art of Computer Programming. Addison-Wesley. Volume 2, Chapter 4.
Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, and Clifford Stein. Introduction to Algorithms, Second Edition. MIT Press and McGraw-Hill, 2001. ISBN 0-262-03293-7. Pages 859–861 of section 31.2: Greatest common divisor.

External links

Source for the form of the algorithm used to determine the multiplicative inverse in GF(2^8)

v t e Number-theoretic algorithms
Primality tests	AKS APR Baillie–PSW Elliptic curve Pocklington Fermat Lucas Lucas–Lehmer Lucas–Lehmer–Riesel Proth's theorem Pépin's Quadratic Frobenius Solovay–Strassen Miller–Rabin
Prime-generating	Sieve of Atkin Sieve of Eratosthenes Sieve of Pritchard Sieve of Sundaram Wheel factorization
Integer factorization	Continued fraction (CFRAC) Dixon's Lenstra elliptic curve (ECM) Euler's Pollard's rho p − 1 p + 1 Quadratic sieve (QS) General number field sieve (GNFS) Special number field sieve (SNFS) Rational sieve Fermat's Shanks's square forms Trial division Shor's
Multiplication	Ancient Egyptian Long Karatsuba Toom–Cook Schönhage–Strassen Fürer's
Euclidean division	Binary Chunking Fourier Goldschmidt Newton-Raphson Long Short SRT
Discrete logarithm	Baby-step giant-step Pollard rho Pollard kangaroo Pohlig–Hellman Index calculus Function field sieve
Greatest common divisor	Binary Euclidean Extended Euclidean Lehmer's
Modular square root	Cipolla Pocklington's Tonelli–Shanks Berlekamp Kunerth
Other algorithms	Chakravala Cornacchia Exponentiation by squaring Integer square root Integer relation (LLL; KZ) Modular exponentiation Montgomery reduction Schoof Trachtenberg system
Italics indicate that algorithm is for numbers of special forms

Description of the algorithm

Example

Proof

Polynomial extended Euclidean algorithm

Pseudocode

Simplification of fractions

Computing multiplicative inverses in modular structures

Modular integers

Simple algebraic field extensions

Example

The case of more than two numbers

See also

References

External links