Cyclic code

From Wikipedia, the free encyclopedia
Jump to: navigation, search

In coding theory, a cyclic code is a block code, where the circular shifts of each codeword gives another word that belongs to the code. They are error-correcting codes that have algebraic properties that are convenient for efficient error detection and correction.

If 00010111 is a valid codeword, applying a right circular shift gives the string 10001011. If the code is cyclic, then 10001011 is again a valid codeword. In general, applying a right circular shift moves the least significant bit (LSB) to the leftmost position, so that it becomes the most significant bit (MSB); the other positions are shifted by 1 to the right.

Definition[edit]

Let \mathcal{C} be a linear code over a finite field GF(q) of block length n. \mathcal{C} is called a cyclic code if, for every codeword c=(c1,...,cn) from C, the word (cn,c1,...,cn-1) in GF(q)^n obtained by a cyclic right shift of components is again a codeword. Because one cyclic right shift is equal to n − 1 cyclic left shifts, a cyclic code may also be defined via cyclic left shifts. Therefore the linear code \mathcal{C} is cyclic precisely when it is invariant under all cyclic shifts.

Cyclic Codes have some additional structural constraint on the codes. They are based on Galois fields and because of their structural properties they are very useful for error controls. Their structure is strongly related to Galois fields because of which the encoding and decoding algorithms for cyclic codes are computationally efficient.

Algebraic structure[edit]

Cyclic codes can be linked to ideals in certain rings. Let R = A[x] / (x^n-1) be a polynomial ring over the finite field A = GF(q). Identify the elements of the cyclic code C with polynomials in R such that  ( c_0, \ldots, c_{n-1} ) maps to the polynomial  c_0 + c_1x +\cdots+c_{n-1} x^{n-1} : thus multiplication by x corresponds to a cyclic shift. Then C is an ideal in R, and hence principal, since R is a principal ideal ring. The ideal is generated by the unique monic element in C of minimum degree, the generator polynomial g.[1] This must be a divisor of x^n-1. It follows that every cyclic code is a polynomial code. If the generator polynomial g has degree d then the rank of the code C is n-d.

The idempotent of C is a codeword e such that e2 = e (that is, e is an idempotent element of C) and e is an identity for the code, that is e c = c for every codeword c. If n and q are coprime such a word always exists and is unique;[2] it is a generator of the code.

An irreducible code is a cyclic code in which the code, as an ideal, is maximal in R, so that its generator is an irreducible polynomial.

Examples[edit]

For example, if A=\mathbb{F}_2 and n=3, the set of codewords contained in the (1,1,0)-cyclic code is precisely

((0,0,0), (1,1,0), (0,1,1), (1,0,1))\,.

It corresponds to the ideal in \mathbb{F}_2[x]/(x^3-1) generated by (1+x).

Note that (1+x) is an irreducible polynomial in the polynomial ring, and hence the code is an irreducible code.

The idempotent of this code is the polynomial x + x^2, corresponding to the codeword (1,1,0).

Trivial examples[edit]

Trivial examples of cyclic codes are An itself and the code containing only the zero codeword. These correspond to generators 1 and x^n-1 respectively: these two polynomials must always be factors of x^n-1.

Over GF(2) the parity bit code, consisting of all words of even weight, corresponds to generator x+1. Again over GF(2) this must always be a factor of x^n-1.

Quasi-cyclic codes and shortened codes[edit]

Before delving into the details of cyclic codes first we will discuss quasi-cyclic and shortened codes which are closely related to the cyclic codes and they all can be converted into each other.

Definition[edit]

Quasi-cyclic codes: An (n,k) quasi-cyclic code is a linear block code such that, for some b coprime with n, the polynomial x^bc(x) \pmod {x^n-1} is a codeword polynomial whenever c(x) is a codeword polynomial.

Here codeword polynomial is a linear code whose code words are polynomials that are divisible by a polynomial of shorter length called generator polynomial. Note that every codeword polynomial can be expressed in the form c(x) = a(x)g(x). For any codeword (c_0,..,c_{n-1}) codeword polynomial corresponds to the \sum_{i=0}^{n-1} c_i*x^i .

Definition[edit]

Shortened codes: An [n,k] linear code is called a proper shortened cyclic code if it can be obtained by deleting b positions from an (n+b, k+b) cyclic code.

In shortened codes information symbols are deleted to obtain a desired blocklength smaller than the design blocklength. The missing information symbols are usually imagined to be at the beginning of the codeword and are considered to be 0. Therefore, nk is fixed, and then k is decreased which eventually decreases n. Note that it is not necessary to delete the starting symbols. Depending on the application sometimes consecutive positions are considered as 0 and are deleted.

All the symbols which are dropped need not be transmitted and at the receiving end can be reinserted. To convert (n,k) cyclic code to (n-b,k-b) shortened code, set b symbols to zero and drop them from each codeword. Any cyclic code can be converted to quasi-cyclic codes by dropping every bth symbol where b is a factor of n. If the dropped symbols are not check symbols then this cyclic code is also a shortened code.

Cyclic codes for correcting errors[edit]

Now, we will begin the discussion of cyclic codes explicitly with error detection and correction. Cyclic codes can be used to correct errors, like Hamming codes as a cyclic codes can be used for correcting single error. Likewise, they are also used to correct double errors and burst errors. All types of error corrections are covered briefly in the further subsections.

The (7,4) Hamming code has a generator polynomial g(x) = x^3 + x +1. This polynomial has a zero in Galois extension field GF(8) at the primitive element \alpha, and all codewords satisfy \mathcal{C}(\alpha)=0. Cyclic codes can also be used to correct double errors over the field GF(2). Blocklength will be n equal to 2^m -1 and primitive elements \alpha and \alpha^3 as zeros in the GF(2^m) because we are considering the case of two errors here, so each will represent one error.

The received word is a polynomial of degree n - 1 given as v(x) = a(x)g(x) + e(x)

where e(x) can have at most two nonzero coefficients corresponding to 2 errors.

We define the Syndrome Polynomial, S(x) as the remainder of polynomial v(x) when divided by the generator polynomial g(x) i.e.

S(x) = v(x)\mod g(x) = (a(x)g(x) + e(x))\mod g(x) = e(x)\mod g(x) as (a(x)g(x))\mod g(x) is zero.

For correcting two errors[edit]

Let the field elements X_1 and X_2 be the two error location numbers. If only one error occurs then X_2 is equal to zero and if none occurs both are zero.

Let S_1 = {v}(\alpha) and S_3 = {v}(\alpha^3).

These field elements are called "syndromes". Now because g(x) is zero at primitive elements \alpha and \alpha^3, so we can write S_1 = e(\alpha) and S_3 = e(\alpha^3). If say two errors occur, then

S_1 = \alpha^{i} + \alpha^{i'} and S_3 = \alpha^{3i} + \alpha^{3i'}.

And these two can be considered as two pair of equations in GF(2^m) with two unknowns and hence we can write

S_1 = X_1 + X_2 and S_3 = (X_1)^3 + (X_2)^3.

Hence if the two pair of nonlinear equations can be solved cyclic codes can used to correct two errors.

Hamming code[edit]

The Hamming(7,4) code may be written as a cyclic code over GF(2) with generator 1+x+x^3. In fact, any binary Hamming code of the form Ham(r, 2) is equivalent to a cyclic code,[3] and any Hamming code of the form Ham(r,q) with r and q-1 relatively prime is also equivalent to a cyclic code.[4] Given a Hamming code of the form Ham(r,2) with r \ge 3, the set of even codewords forms a cyclic [2^{r}-1,2^{r}-r-2,4]-code.[5]

Hamming code for correcting single errors[edit]

A code whose minimum distance is at least 3, have a check matrix all of whose columns are distinct and non zero. If a check matrix for a binary code has m rows, then each column is an m-bit binary number. There are 2^m-1 possible columns. Therefore if a check matrix of a binary code with d_{min} at least 3 has m rows, then it can only have 2^m-1 columns, not more than that. This defines a (2^m-1, 2^m-1-m) code, called Hamming code.

It is easy to define Hamming codes for large alphabets of size q. We need to define one H matrix with linearly independent columns. For any word of size q there will be columns who are multiples of each other. So, to get linear independence all non zero m-tuples with one as a top most non zero element will be chosen as columns. Then two columns will never be linearly dependent because three columns could be linearly dependent with the minimum distance of the code as 3.

So, there are (q^m-1)/(q-1) nonzero columns with one as top most non zero element. Therefore, Hamming code is a [(q^m-1)/(q-1), (q^m-1)/(q-1)-m] code.

Now, for cyclic codes, Let \alpha be primitive element in GF(q^m), and let \beta = \alpha^{q-1}. Then \beta^{(q^m-1)/(q-1)} = 1 and thus \beta is a zero of the polynomial x^{(q^m-1)/(q-1)} - 1 and is a generator polynomial for the cyclic code of block length n = (q^m-1)/(q-1).

But for q = 2, \alpha = \beta. And the received word is a polynomial of degree n - 1 given as

v(x) = a(x)g(x) + e(x)

where, e(x) = 0 or  x^i where i represents the error locations.

But we can also use \alpha^i as an element of GF(2^m) to index error location. Because g(\alpha) = 0, we have v(\alpha) = \alpha^i and all powers of \alpha from 0 to 2^m-2 are distinct. Therefore we can easily determine error location i from \alpha^i unless v(\alpha) = 0 which represents no error. So, hamming code is a single error correcting code over GF(2) with n = 2^m-1 and k = n - m.

Cyclic codes for correcting burst errors[edit]

From Hamming distance concept, a code with minimum distance  2t + 1 can correct any t errors. But in many channels error pattern is not very arbitrary, it occurs within very short segment of the message. Such kind of errors are called burst errors. So, for correcting such errors we will get a more efficient code of higher rate because of the less constraints. Cyclic codes are used for correcting burst error. In fact, cyclic codes can also correct cyclic burst errors along with burst errors. Cyclic burst errors are defined as

A cyclic burst of length t is a vector whose nonzero components are among t (cyclically) consecutive components, the first and the last of which are nonzero.

In polynomial form cyclic burst of length t can be described as e(x)=x^ib(x)\mod (x^n -1) with b(x) as a polynomial of degree t - 1 with nonzero coefficient b_0. Here b(x) defines the pattern and x^i defines the starting point of error. Length of the pattern is given by degb(x) + 1. Syndrome poynomial is unique for each pattern and is given by

s(x) = e(x)\mod g(x)

A linear block code that corrects all burst errors of length t or less must have at least 2t check symbols. Proof: Because any linear code that can correct burst pattern of length t or less cannot have a burst of length 2t or less as a codeword because if it did then a burst of length t could change the codeword to burst pattern of length t, which also could be obtained by making a burst error of length t in all zero codeword. Now, any two vectors that are non zero in the first 2t components must be from different co-sets of an array to avoid their difference being a codeword of bursts of length 2t. Therefore number of such co-sets are equal to number of such vectors which are q^{2t}. Hence at least q^{2t} co-sets and hence at least 2t check symbol.

This property is also known as Rieger bound and it is similar to the singleton bound for random error correcting.

Fire codes as cyclic bounds[edit]

Fire code is a cyclic burst error correcting code over GF(q) with the generator polynomial

g(x)=(x^{2t-1}-1)p(x)

where p(x) is a prime polynomial with degree m not smaller than t and p(x) does not divide x^{2t-1}-1. Block length of the fire code is the smallest integer n such that g(x) divides x^n-1.

A fire code can correct all burst errors of length t or less if no two bursts b(x) and x^jb'(x) appear in the same co-set. This can be proved by contradiction. Suppose there are two distinct nonzero bursts b(x) and x^jb'(x) of length t or less and are in the same co-set of the code. So, their difference is a codeword. As the difference is a multiple of g(x) it is also a multiple of x^{2t-1}-1. Therefore,

b(x) = x^jb'(x)  \mod (x^{2t-1}-1).

This shows that j is a multiple of 2t - 1, So

b(x) = x^{l(2t-1)}b'(x)

for some l. Now, as l(2t-1) is less than t and l is less than q^m - 1 so (x^{l(2t - 1)} - 1)b(x) is a codeword. Therefore,

(x^{l(2t - 1)} - 1)b(x) = a(x)(x^{2t-1}- 1)p(x).

Since b(x) degree is less than degree of p(x),p(x) cannot divide b(x). If l is not zero, then p(x) also cannot divide x^{l(2t-1)} - 1 as l is less than q^m-1 and by definition of m, p(x) divides x^{l(2t-1)} - 1 for no l smaller than q^m-1. Therefore l and j equals to zero. That means both that both the bursts are same, contrary to assumption.

Fire codes are the best single burst correcting codes with high rate and they are constructed analytically. They are of very high rate and when m and t are equal, redundancy is least and is equal to 3t - 1. By using multiple fire codes longer burst errors can also be corrected.

For error detection cyclic codes are widely used and are called t - 1 cyclic redundancy codes.

Cyclic codes on Fourier transform[edit]

Applications of Fourier transform are widespread in signal processing. But their applications are not limited to the complex fields only; Fourier transforms also exist in the Galois field GF(q). Cyclic codes using Fourier transform can be described in a setting closer to the signal processing.

Fourier transform over finite fields[edit]

Fourier transform over finite fields

The discrete Fourier transform of vector v = v_0, v_1, ...., v_{n-1} is given by a vector V = V_0, V_1,....., V_{n-1} where,

V_k = \Sigma_{i=0}^{n-1} e^{-j2\pi n^{-1}ik}v_i where,

k = 0,....., n-1

where exp(-j2\pi /n) is an nth root of unity. Similarly in the finite field nth root of unity is element \omega of order n. Therefore

If v = (v_0, v_1, ...., v_{n-1}) is a vector over GF(q), and \omega be an element of GF(q) of order n, then Fourier transform of the vector v is the vector V = (V_0, V_1,....., V_{n-1}) and components are given by

V_j = \Sigma_{i=0}^{n-1}\omega^{ij} v_i where,

k = 0,....., n-1

Here i is time index, j is frequency and V is the spectrum. One important difference between Fourier transform in complex field and Galois field is that complex field \omega exists for every value of n while in Galois field \omega exists only if n divides q - 1. In case of extension fields, there will be a Fourier transform in the extension field GF(q^m) if n divides q^m - 1 for some m. In Galois field time domain vector v is over the field GF(q) but the spectrum V may be over the extension field GF(q^m).

Spectral description of cyclic codes[edit]

Any codeword of cyclic code of blocklength n can be represented by a polynomial c(x) of degree at most n - 1. Its encoder can be written as c(x) = a(x)g(x). Therefore in frequency domain encoder can be written as C_j = A_jG_j. Here codeword spectrum C_j has a value in GF(q^m) but all the components in the time domain are from GF(q). As the data spectrum A_j is arbitrary, the role of G_j is to specify those j where C_j will be zero.

Thus, cyclic codes can also be defined as

Given a set of spectral indices, A = (j_1,...., j_{n-k}), whose elements are called check frequencies, the cyclic code C is the set of words over GF(q) whose spectrum is zero in the components indexed by j_1,..., j_{n-k}. Any such spectrum C will have components of the form A_jG_j.

So, cyclic codes are vectors in the field GF(q) and the spectrum given by its inverse fourier transform is over the field GF(q^m) and are constrained to be zero at certain components. But note that every spectrum in the field GF(q^m) and zero at certain components may not have inverse transforms with components in the field GF(q). Such spectrum can not be used as cyclic codes.

Following are the few bounds on the spectrum of cyclic codes.

BCH bound[edit]

If n be a factor of (q^m - 1) for some m. The only vector in GF(q)^n of weight d - 1 or less that has d - 1 consecutive components of its spectrum equal to zero is all-zero vector.

Hartmann-Tzeng bound[edit]

If n be a factor of (q^m - 1) for some m, and b an integer that is coprime with n. The only vector v in GF(q)^n of weight d - 1 or less whose spectral components V_j equal zero for j = \ell_1 + \ell_2b (\mod n), where \ell_1 = 0,...., d - s - 1 and \ell_2 = 0,...., s - 1, is the all zero vector.

Roos bound[edit]

If n be a factor of q^m - 1 for some m and GCD(n,b) = 1. The only vector in GF(q)^n of weight d - 1 or less whose spectral components V_j equal to zero for j = l_1 + l_2b (\mod n), where l_1 = 0,..., d - s - 2 and l_2 takes at least s + 1 values in the range 0,...., d - 2, is the all-zero vector.

Quadratic residue codes[edit]

When the prime l is a quadratic residue modulo the prime p there is a quadratic residue code which is a cyclic code of length p, dimension (p+1)/2 and minimum weight at least \sqrt{p} over GF(l).

Generalizations[edit]

A constacyclic code is a linear code with the property that for some constant λ if (c1,c2,...,cn) is a codeword then so is (λcn,c1,...,cn-1). A negacyclic code is a constacyclic code with λ=-1.[6] A quasi-cyclic code has the property that for some s, any cyclic shift of a codeword by s places is again a codeword.[7] A double circulant code is a quasi-cyclic code of even length with s=2.[7]

See also[edit]

Notes[edit]

  1. ^ van Lint 1998, p. 76
  2. ^ van Lint 1998, p. 80
  3. ^ Hill 1993, pp. 159-160
  4. ^ Balahut 1983, Theorem 5.5.1
  5. ^ Hill 1993, pp. 162-163
  6. ^ van Lint 1998, p. 75
  7. ^ a b MacWilliams & Sloane 1977, p. 506

References[edit]

Further reading[edit]

External links[edit]

This article incorporates material from cyclic code on PlanetMath, which is licensed under the Creative Commons Attribution/Share-Alike License.