In physics, chemistry and related fields, a kinetic scheme is a network of states and connections between them representing the scheme of a dynamical process. Usually a kinetic scheme represents a Markovian process, while for non-Markovian processes generalized kinetic schemes are used. Figure 1 shows an illustration of a kinetic scheme.
A Markovian kinetic scheme
Description of the form of a kinetic scheme
A kinetic scheme is a network of states. Each state is special, usually, has a special number, representing a specific state in the system (although repetitions of states may occur and this depends on the system). Each pair of connected states has at least one rate; a rate is directional and connects states i with j. Indeed, when detailed balance exists in a system, the following relation holds, , for every connected states i and j. (The result represents the fact that any closed loop in a Markovian network in equilibrium does not have a net flow.)
The kinetic scheme is described with a master equation: a first-order differential equation for the probability of a system to occupy each one its states at time t; written in a matrix form, we see: , where is a column vector (where element i represents state i), and is the matrix of connections. In a Markovian kinetic scheme the connections are simply numbers (and any jumping time probability density function for state i is an exponential, with a rate equal the value of all the exiting connections). Matrix can also represent birth and death, meaning that probability is injected (birth) or taken from (death) the system, where then, the process is not in equilibrium. (These terms are different than a birth-death process, where there we have simply a linear kinetic scheme).
Specific Markovian kinetic schemes
- A birth-death process is a linear one-dimensional Markovian kinetic scheme.
- Michaelis–Menten kinetics are a type of a Markovian kinetic scheme when solved with the steady state assumption for the creation of intermediates in the reaction pathway.
Generalizations of Markovian kinetic schemes
- A kinetic scheme with time dependent rates: When the connections depend on the actual time (i.e. matrix depends on the time, ), the process is not Markovian, and the master equation obeys, . The reason for a time dependent rates is, for example, a time dependent external field applied on a Markovian kinetic scheme (thus making the process a not Markovian one).
- A semi-Markovian kinetic scheme: When the connections represent multi exponential jumping time probability density functions, the process is semi-Markovian, and the equation of motion is an integro-differential equation termed the generalized master equation: .
An example for such a process is a reduced dimensions form.
- The Fokker Planck equation: when expanding the master equation of the kinetic scheme in a continuous space coordinate, one finds the Fokker Planck equation.
- Markov process
- Continuous-time Markov process
- Master equation
- Detailed balance
- Graph theory
- Semi-Markov process
- van Kampen, N. G. (1981). Stochastic processes in physics and chemistry. North Holland. ISBN 978-0-444-52965-7.
- Erhan Cinlar (1975). Introduction to Stochastic Processes. Prentice Hall Inc, New Jesry. ISBN 978-0-486-49797-6.
- Risken, H. (1984). The Fokker-Planck Equation. Springer. ISBN 3-540-61530-X.