# Kuramoto model: Difference between revisions

The Kuramoto model (or Kuramoto-Daido model), first proposed by Yoshiki Kuramoto (蔵本 由紀 Kuramoto Yoshiki),[1][2] is a mathematical model used to describe synchronization. More specifically, it is a model for the behavior of a large set of coupled oscillators.[3][4] Its formulation was motivated by the behavior of systems of chemical and biological oscillators, and it has found widespread applications such as in neuroscience[5][6][7] and oscillating flame dynamics.[8][9] Kuramoto was quite surprised when the behavior of some physical systems, namely coupled arrays of Josephson junctions, followed his model.[10]

The model makes several assumptions, including that there is weak coupling, that the oscillators are identical or nearly identical, and that interactions depend sinusoidally on the phase difference between each pair of objects.

## Definition

Phase locking in the Kuramoto model

In the most popular version of the Kuramoto model, each of the oscillators is considered to have its own intrinsic natural frequency ${\displaystyle \omega _{i}}$, and each is coupled equally to all other oscillators. Surprisingly, this fully nonlinear model can be solved exactly, in the infinite-N limit, with a clever transformation and the application of self-consistency arguments.

The most popular form of the model has the following governing equations:

${\displaystyle {\frac {d\theta _{i}}{dt}}=\omega _{i}+{\frac {K}{N}}\sum _{j=1}^{N}\sin(\theta _{j}-\theta _{i}),\qquad i=1\ldots N}$,

where the system is composed of N limit-cycle oscillators, with phases ${\displaystyle \theta _{i}}$ and coupling K.

Noise can be added to the system. In that case, the original equation is altered to:

${\displaystyle {\frac {d\theta _{i}}{dt}}=\omega _{i}+\zeta _{i}+{\dfrac {K}{N}}\sum _{j=1}^{N}\sin(\theta _{j}-\theta _{i})}$,

where ${\displaystyle \zeta _{i}}$ is the fluctuation and a function of time. If we consider the noise to be white noise, then:

${\displaystyle \langle \zeta _{i}(t)\rangle =0}$ ,
${\displaystyle \langle \zeta _{i}(t)\zeta _{j}(t')\rangle =2D\delta _{ij}\delta (t-t')}$

with ${\displaystyle D}$ denoting the strength of noise.

## Transformation

The transformation that allows this model to be solved exactly (at least in the N → ∞ limit) is as follows:

Define the "order" parameters r and ψ as

${\displaystyle re^{i\psi }={\frac {1}{N}}\sum _{j=1}^{N}e^{i\theta _{j}}}$.

Here r represents the phase-coherence of the population of oscillators and ψ indicates the average phase. Multiplying this equation with ${\displaystyle e^{-i\theta _{i}}}$ and only considering the imaginary part gives:

${\displaystyle {\frac {d\theta _{i}}{dt}}=\omega _{i}+Kr\sin(\psi -\theta _{i})}$.

Thus the oscillators' equations are no longer explicitly coupled; instead the order parameters govern the behavior. A further transformation is usually done, to a rotating frame in which the statistical average of phases over all oscillators is zero (i.e. ${\displaystyle \psi =0}$). Finally, the governing equation becomes:

${\displaystyle {\frac {d\theta _{i}}{dt}}=\omega _{i}-Kr\sin(\theta _{i})}$.

## Large N limit

Now consider the case as N tends to infinity. Take the distribution of intrinsic natural frequencies as g(ω) (assumed normalized). Then assume that the density of oscillators at a given phase θ, with given natural frequency ω, at time t is ${\displaystyle \rho (\theta ,\omega ,t)}$. Normalization requires that

${\displaystyle \int _{-\pi }^{\pi }\rho (\theta ,\omega ,t)\,d\theta =1.}$

The continuity equation for oscillator density will be

${\displaystyle {\frac {\partial \rho }{\partial t}}+{\frac {\partial }{\partial \theta }}[\rho v]=0,}$

where v is the drift velocity of the oscillators given by taking the infinite-N limit in the transformed governing equation, such that

${\displaystyle {\frac {\partial \rho }{\partial t}}+{\frac {\partial }{\partial \theta }}[\rho \omega +\rho Kr\sin(\psi -\theta )]=0.}$

Finally, we must rewrite the definition of the order parameters for the continuum (infinite N) limit. ${\displaystyle \theta _{i}}$ must be replaced by its ensemble average (over all ${\displaystyle \omega }$) and the sum must be replaced by an integral, to give

${\displaystyle re^{i\psi }=\int _{-\pi }^{\pi }e^{i\theta }\int _{-\infty }^{\infty }\rho (\theta ,\omega ,t)g(\omega )\,d\omega \,d\theta .}$

## Solutions

The incoherent state with all oscillators drifting randomly corresponds to the solution ${\displaystyle \rho =1/(2\pi )}$. In that case ${\displaystyle r=0}$, and there is no coherence among the oscillators. They are uniformly distributed across all possible phases, and the population is in a statistical steady-state (although individual oscillators continue to change phase in accordance with their intrinsic ω).

When coupling K is sufficiently strong, a fully synchronized solution is possible. In the fully synchronized state, all the oscillators share a common frequency, although their phases can be different.

A solution for the case of partial synchronization yields a state in which only some oscillators (those near the ensemble's mean natural frequency) synchronize; other oscillators drift incoherently. Mathematically, the state has

${\displaystyle \rho =\delta \left(\theta -\psi -\arcsin \left({\frac {\omega }{Kr}}\right)\right)}$

for locked oscillators, and

${\displaystyle \rho ={\frac {\rm {normalization\;constant}}{(\omega -Kr\sin(\theta -\psi ))}}}$

for drifting oscillators. The cutoff occurs when ${\displaystyle |\omega |.

## Connection to Hamiltonian systems

The dissipative Kuramoto model is contained[11] in certain conservative Hamiltonian systems with Hamiltonian of the form:

${\displaystyle {\mathcal {H}}(q_{1},\ldots ,q_{N},p_{1},\ldots ,p_{N})=\sum _{i=1}^{N}{\frac {\omega _{i}}{2}}(q_{i}^{2}+p_{i}^{2})+{\frac {K}{4N}}\sum _{i,j=1}^{N}(q_{i}p_{j}-q_{j}p_{i})(q_{j}^{2}+p_{j}^{2}-q_{i}^{2}-p_{i}^{2})}$

After a canonical transformation to action-angle variables with actions ${\displaystyle I_{i}=\left(q_{i}^{2}+p_{i}^{2}\right)/2}$ and angles (phases) ${\displaystyle \phi _{i}=\mathrm {arctan2} \left(q_{i}/p_{i}\right)}$, exact Kuramoto dynamics emerges on invariant manifolds of constant ${\displaystyle I_{i}\equiv I}$. With the transformed Hamiltonian:

${\displaystyle {\mathcal {H'}}(I_{1},\ldots I_{N},\theta _{1}\ldots ,\theta _{N})=\sum _{i=1}^{N}\omega _{i}I_{i}-{\frac {K}{N}}\sum _{i=1}^{N}\sum _{j=1}^{N}{\sqrt {I_{j}I_{i}}}(I_{j}-I_{i})\sin(\phi _{j}-\phi _{i}),}$

Hamilton's equation of motion become:

${\displaystyle {\frac {dI_{i}}{dt}}=-{\frac {\partial {\mathcal {H}}'}{\partial \phi _{i}}}=-{\frac {2K}{N}}\sum _{k=1}^{N}{\sqrt {I_{k}I_{i}}}(I_{k}-I_{i})\cos(\phi _{k}-\phi _{i})}$

and

${\displaystyle {\frac {d\phi _{i}}{dt}}={\frac {\partial {\mathcal {H}}'}{\partial I_{i}}}=\omega _{i}+{\frac {K}{N}}\sum _{k=1}^{N}\left[2{\sqrt {I_{i}I_{k}}}\sin(\phi _{k}-\phi _{i})\right.\left.+{\sqrt {I_{k}/I_{i}}}(I_{k}-I_{i})\sin(\phi _{k}-\phi _{i})\right].}$

So the manifold with ${\displaystyle I_{j}=I}$ is invariant because ${\displaystyle {\frac {dI_{i}}{dt}}=0}$ and the phase dynamics ${\displaystyle {\frac {d\phi _{i}}{dt}}}$ becomes the dynamics of the Kuramoto model (with the same coupling constants for ${\displaystyle I=1/2}$). The class of Hamiltonian systems characterizes certain quantum-classical systems including Bose-Einstein condensates.

## Variations on the models

Distinct synchronization patterns in a two-dimensional array of Kuramoto-like oscillators with differing phase interaction functions and spatial coupling topologies. (A) Pinwheels. (B) Waves. (C) Chimeras. (D) Chimeras and waves combined. Color scale indicates oscillator phase.

There are two types of variations of models based on the original model presented above, one that deals with changing the topological structure of the model; the second are more related to models that are inspired by Kuramoto model but don't have the same functional form.

### Variations on topology

Beside the original model, which has an all-to-all topology, a sufficiently dense complex network-like topology is amenable to the mean-field treatment used in the solution of the original model [12] (see Transformation and Large N Limit above for more info). One also may ask for the behavior of models in which there are intrinsically local, like one-dimensional topologies which the chain and the ring are prototypical examples. In such topologies, in which the coupling is not scalable according to 1/N, it's not possible to apply the canonical mean-field approach, so one must rely upon case-by-case analysis, making use of symmetries whenever it is possible, which may give basis for abstraction of general principles of solutions.

Uniform synchrony, waves and spirals can readily be observed in two-dimensional Kuramoto networks with diffusive local coupling. The stability of waves in these models can be determined analytically using the methods of Turing stability analysis.[13] Uniform synchrony tends to be stable when the local coupling is everywhere positive whereas waves arise when the long-range connections are negative (inhibitory surround coupling). Waves and synchrony are connected by a topologically distinct branch of solutions known as ripple.[14] These are low-amplitude spatially-periodic deviations that emerge from the uniform state (or the wave state) via a Hopf birfurcation.[15] The existence of ripple solutions was predicted (but not observed) by Wiley, Strogatz and Girvan[16] who called them multi-twisted q-states.

The topology on which the Kuramoto Model is studied can be made adaptive [17] by use of fitness model showing enhancement of synchronization and percolation in a self-organised way.

### Variations on the phase interaction

Kuramoto approximated the phase interaction between any two oscillators by its first Fourier component, namely ${\displaystyle \Gamma (\phi )=\sin(\phi )}$, where ${\displaystyle \phi =\theta _{j}-\theta _{i}}$. Better approximations can be obtained by including higher-order Fourier components,

${\displaystyle \Gamma (\phi )=\sin(\phi )+a_{1}\sin(2\phi +b_{1})+...+a_{n}\sin(2n\phi +b_{n})}$,

where parameters ${\displaystyle a_{i}}$ and ${\displaystyle b_{i}}$ must be estimated. For example, synchronization among a network of weakly-coupled Hodgkin-Huxley neurons can be replicated using coupled oscillators that retain the first four Fourier components of the interaction function.[18] The introduction of higher-order phase interaction terms can also induce interesting synchronization phenomena such as heteroclinic cycles[19] and Chimeras.[20]

## Availability

• pyclustering library includes a Python and C++ implementation of the Kuramoto model and its modifications. Also the library consists of oscillatory networks (for cluster analysis, pattern recognition, graph coloring, image segmentation) that are based on the Kuramoto model and phase oscillator.

## References

1. ^ Kuramoto, Yoshiki (1975). H. Araki (ed.). Lecture Notes in Physics, International Symposium on Mathematical Problems in Theoretical Physics. 39. Springer-Verlag, New York. p. 420.
2. ^ Kuramoto Y (1984). Chemical Oscillations, Waves, and Turbulence. New York, NY: Springer-Verlag.
3. ^ Strogatz S (2000). "From Kuramoto to Crawford: Exploring the onset of synchronization in populations of coupled oscillators". Physica D. 143 (1–4): 1–20. Bibcode:2000PhyD..143....1S. doi:10.1016/S0167-2789(00)00094-4.
4. ^ Acebrón, Juan A.; Bonilla, L. L.; Vicente, Pérez; Conrad, J.; Ritort, Félix; Spigler, Renato (2005). "The Kuramoto model: A simple paradigm for synchronization phenomena" (PDF). Reviews of Modern Physics. 77: 137–185. Bibcode:2005RvMP...77..137A. doi:10.1103/RevModPhys.77.137.
5. ^ Cumin, D.; Unsworth, C. P. (2007). "Generalising the Kuromoto model for the study of neuronal synchronisation in the brain". Physica D. 226 (2): 181–196. Bibcode:2007PhyD..226..181C. doi:10.1016/j.physd.2006.12.004.
6. ^ Breakspear M, Heitmann S, Daffertshofer A (2010). "Generative models of cortical oscillations: Neurobiological implications of the Kuramoto model". Front Hum Neurosci. 4. doi:10.3389/fnhum.2010.00190. |article= ignored (help)
7. ^ Cabral J, Luckhoo H, Woolrich M, Joensson M, Mohseni H, Baker A, Kringelbach ML, Deco G (2014). "Exploring mechanisms of spontaneous functional connectivity in MEG: How delayed network interactions lead to structured amplitude envelopes of band-pass filtered oscillations". NeuroImage. 90: 423–435. doi:10.1016/j.neuroimage.2013.11.047. PMID 24321555.
8. ^ Sivashinsky, G.I. (1977). "Diffusional-thermal theory of cellular flames". Combust. Sci. and Tech. 15 (3–4): 137–146. doi:10.1080/00102207708946779.
9. ^ Forrester, D.M. (2015). "Arrays of coupled chemical oscillators". Scientific Reports. 5: 16994. arXiv:1606.01556. Bibcode:2015NatSR...516994F. doi:10.1038/srep16994.
10. ^ Steven Strogatz, Sync: The Emerging Science of Spontaneous Order, Hyperion, 2003.
11. ^ Witthaut, Dirk; Timme, Marc (2014). "Kuramoto Dynamics in Hamiltonian Systems". Phys. Rev. E. 90: 032917. arXiv:1305.1742. Bibcode:2014PhRvE..90c2917W. doi:10.1103/PhysRevE.90.032917.
12. ^ Rodrigues, F. A.; Peron, T.K.; Jie, P.; Kurths, J. (2016). "The Kuramoto model in complex networks". Physics Reports. 610 (1). arXiv:1511.07139. Bibcode:2016PhR...610....1R. doi:10.1016/j.physrep.2015.10.008.
13. ^ Kazanci, F.; Ermentrout, B. (2006). "Pattern formation in an array of oscillators with electrical and chemical coupling". SIAM J Appl Math. 67: 512–529. doi:10.1137/060661041.
14. ^ Heitmann, S.; Gong, P.; Breakspear, M (2012). "A computational role for bistability and traveling waves in motor cortex". Front Comput Neurosci. 6 (67). doi:10.3389/fncom.2012.00067.
15. ^ Heitmann, S.; Ermentrout, B. (2015). "Synchrony, waves and ripple in spatially coupled Kuramoto oscillators with Mexican hat connectivity". Biological Cybernetics. 109: 1–15. doi:10.1007/s00422-015-0646-6.
16. ^ Wiley, D.; Strogatz, S.; Girvan, M (2006). "The size of the sync basin". Chaos. 16 (1): 015103. Bibcode:2006Chaos..16a5103W. doi:10.1063/1.2165594.
17. ^ Eom, Y.-H.; Boccaletti, S.; Caldarelli, G (2016). "Concurrent enhancement of percolation and synchronization in adaptive networks". Scientific Repors. 7: 015103. doi:10.1038/srep27111.
18. ^ Hansel, D.; Mato, G.; Meunier, C (1993). "Phase Dynamics for Weakly Coupled Hodgkin-Huxley Neurons". Europhysics Letters. 23 (5): 367–372. Bibcode:1993EL.....23..367H. doi:10.1209/0295-5075/23/5/011.
19. ^ Hansel, D.; Mato, G.; Meunier, C (1993). "Clustering and slow switching in globally coupled phase oscillators". Physical Review E. 48 (5): 3470–3477. Bibcode:1993PhRvE..48.3470H. doi:10.1103/physreve.48.3470.
20. ^ Abrams, D.M.; Strogatz, S.H. (2004). "Chimera states for coupled oscillators". Physical Review Letters. 93 (17). arXiv:nlin/0407045. Bibcode:2004PhRvL..93q4102A. doi:10.1103/physrevlett.93.174102.