Scale-free network

A scale-free network is a noteworthy kind of complex network because many "real-world networks" fall into this category. For purposes of this article, "real-world" refers to any of various observable phenomena that exhibit network theoretic characteristics (see e.g., social network, computer network, neural network, epidemiology).

In scale-free networks, some nodes act as "highly connected hubs" (high degree), although most nodes are of low degree. Scale-free networks' structure and dynamics are independent of the system's size N, the number of nodes the system has. In other words, a network that is scale-free will have the same properties no matter what the number of its nodes is. Their defining characteristic is that their degree distribution follows the Yule-Simon distribution — a power law relationship defined by

\mathbf {P(k)\sim k^{-\gamma }} ,

where the probability P(k) that a node in the network connects with k other nodes was roughly proportional to k^−γ, and this function gave a roughly good fit to their observed data. The coefficient γ may vary approximately from 2 to 3 for most real networks, however, in some cases it can also take a value between 1 and 2 ^[1].

Highlights

Scale-free networks show a power law degree distribution like most real networks.
Network growth and preferential attachment have been shown to create networks with power law degree distributions.

History

Using a Web crawler, physicist Albert-László Barabási and his colleagues at the University of Notre Dame mapped the connectedness of the Web in 1999 (Barabási and Albert, 1999). To their surprise, the Web did not have an even distribution of connectivity (so-called "random connectivity"). Instead, some network nodes had many more connections than the average; seeking a simple categorical label, Barabási and his collaborators called such highly connected nodes "hubs". In physics, such right-skewed or heavy-tailed distributions often have the form of a power law, i.e., the probability P(k) that a node in the network connects with k other nodes was roughly proportional to k^−γ, and this function gave a roughly good fit to their observed data.

After finding that a few other networks, including some social and biological networks, also had heavy-tailed degree distributions, Barabási and collaborators coined the term "scale-free network" to describe the class of networks that exhibit a power-law degree distribution. Soon after, Amaral et al. showed that most of the real-world networks can be classified into two large categories according to the decay of P(k) for large k.

Barabási et al. then offered a simple generative mechanism called "preferential attachment" (see below) that created networks with a power-law degree distribution. The first analytic solution for this mechanism was presented in 2000 by Dorogovtsev, Mendes and Samukhin (Structure of Growing Networks: Exact Solution of the Barabási--Albert's Model), which was later confirmed by the mathematician Béla Bollobás. Notably, however, this mechanism only produces a specific subset of networks in the scale-free class, and many alternative mechanisms have been discovered since.

Although the scientific community is still debating the usefulness of the scale-free term in reference to networks, Li et al. (2005) recently offered a potentially more precise "scale-free metric". Briefly, let g be a graph with edge-set ε, and let the degree (number of edges) at a vertex i be $d_{i}$ . Define

s(g)=\sum _{(i,j)\in \epsilon }d_{i}d_{j}.

This is maximised when high-degree nodes are connected to other high-degree nodes. Now define

$S(g)={\frac {s(g)}{s_{max}}}$

where s_max is the maximum value of s(h) for h in the set of all graphs with an identical degree distribution to g. This gives a metric between 0 and 1, such that graphs with low S(g) are "scale-rich", and graphs with S(g) close to 1 are "scale-free". This definition captures the notion of self-similarity implied in the name "scale-free".

Characteristics and examples

As with all systems characterized by a power law distribution, the most notable characteristic in a scale-free network is the relative commonness of vertices with a degree that greatly exceeds the average. The highest-degree nodes are often called "hubs", and are thought to serve specific purposes in their networks, although this depends greatly on the domain.

The power law distribution highly influences the network topology. It turns out that the major hubs are closely followed by smaller ones. These ones, in turn, are followed by other nodes with an even smaller degree and so on. This hierarchy allows for a fault tolerant behavior. Since failures occur at random and the vast majority of nodes are those with small degree, the likelihood that a hub would be affected is almost negligible. Even if such event occurs, the network will not lose its connectedness, which is guaranteed by the remaining hubs. On the other hand, if we choose a few major hubs and take them out of the network, it simply falls apart and is turned into a set of rather isolated graphs. Thus hubs are both the strength of scale-free networks and their Achilles' heel.

Another important characteristic of scale-free networks is the clustering coefficient distribution, which decreases as the node degree increases. This distribution also follows a power law. That means that the low-degree nodes belong to very dense sub-graphs and those sub-graphs are connected to each other through hubs. Consider a social network in which nodes are people and links are acquaintance relationships between people. It is easy to see that people tend to form communities, i.e., small groups in which everyone knows everyone (one can think of such community as a complete graph). In addition, the members of a community also have a few acquaintance relationships to people outside that community. Some people, however, are so related to other people (e.g., celebrities, politicians) that they are connected to a large number of communities. Those people may be considered the hubs responsible for the small world phenomenon.

At present, the more specific characteristics of scale-free networks can only be discussed in either the context of the generative mechanism used to create them, or the context of a particular real-world network thought to be scale-free. For instance, networks generated by preferential attachment typically place the high-degree vertices in the middle of the network, connecting them together to form a core, with progressively lower-degree nodes making up the regions between the core and the periphery. Many interesting results are known for this subclass of scale-free networks. For instance, the random removal of even a large fraction of vertices impacts the overall connectedness of the network very little, suggesting that such topologies could be useful for security, while targeted attacks destroys the connectedness very quickly. Other scale-free networks, which place the high-degree vertices at the periphery, do not exhibit these properties; notably, the structure of the Internet is more like this latter kind of network than the kind built by preferential attachment. Indeed, many of the results about scale-free networks have been claimed to apply to the Internet, but are disputed by Internet researchers and engineers.

As with most disordered networks, such as the small world network model, the average distance between two vertices in the network is very small relative to a highly ordered network such as a lattice. The clustering coefficient of scale-free networks can vary significantly depending on other topological details, and there are now generative mechanisms that allow one to create such networks that have a high density of triangles.

It is interesting that Cohen and Havlin proved that uncorrelated power-law graph having 2 < γ < 3 will also have ultrasmall diameter d ~ ln ln N. So from the practical point of view, the diameter of a growing scale-free network might be considered almost constant.

Although many real-world networks are thought to be scale-free, the evidence remains inconclusive, primarily because the generative mechanisms proposed have not been rigorously validated against the real-world data. As such, it is too early to rule out alternative hypotheses. A few examples of networks claimed to be scale-free include:

Social networks, including collaboration networks. An example that has been studied extensively is the collaboration of movie actors in films.
Protein-Protein interaction networks.
Sexual partners in humans, which affects the dispersal of sexually transmitted diseases.
Many kinds of computer networks, including the World Wide Web.

Generative models

These scale-free networks do not arise by chance alone. Erdős and Rényi (1960) studied a model of growth for graphs in which, at each step, two nodes are chosen uniformly at random and a link is inserted between them. The properties of these random graphs are not consistent with the properties observed in scale-free networks, and therefore a model for this growth process is needed.

The scale-free properties of the Web have been studied, and its distribution of links is very close to a power law, because there are a few Web sites with huge numbers of links, which benefit from a good placement in search engines and an established presence on the Web. Those sites are the ones that attract more of the new links. This has been called the winners take all phenomenon.

The mostly widely known generative model for a subset of scale-free networks is Barabási and Albert's (1999) rich get richer generative model in which each new Web page creates links to existent Web pages with a probability distribution which is not uniform, but proportional to the current in-degree of Web pages. This model was originally discovered by Derek J. de Solla Price in 1965 under the term cumulative advantage, but did not reach popularity until Barabási rediscovered the results under its current name (BA Model). According to this process, a page with many in-links will attract more in-links than a regular page. This generates a power-law but the resulting graph differs from the actual Web graph in other properties such as the presence of small tightly connected communities. More general models and networks characteristics have been proposed and studied (for a review see the book by Dorogovtsev and Mendes).

A different generative model is the copy model studied by Kumar et al. (2000), in which new nodes choose an existent node at random and copy a fraction of the links of the existent node. This also generates a power law.

However, if we look at communities of interests in a specific topic, discarding the major hubs of the Web, the distribution of links is no longer a power law but resembles more a normal distribution, as observed by Pennock et al. (2002) in the communities of the home pages of universities, public companies, newspapers and scientists. Based on these observations, the authors propose a generative model that mixes preferential attachment with a baseline probability of gaining a link.

The growth of the networks (adding new nodes) is not a necessary condition for creating a scale-free topology. Dangalchev (2004) gives examples of generating static scale-free networks. Another possibility (Caldarelli et al. 2002) is to consider the structure as static and draw a link between vertices according to a particular property of the two vertices involved. Once specified the statistical distribution for these vertices properties (fitnesses), it turns out that in some circumstances also static networks develop scale-free properties.

Recently, Manev and Manev (Med. Hypotheses, 2005) proposed that small world networks may be operative in adult brain neurogenesis. Adult neurogenesis has been observed in mammalian brains, including those of humans, but a question remains: how do new neurons become functional in the adult brain? It is proposed that the random addition of only a few new neurons functions as a maintenance system for the brain's "small-world" networks. Randomly added to an orderly network, new links enhance signal propagation speed and synchronizability. Newly generated neurons are ideally suited to become such links: they are immature, form more new connections compared to mature ones, and their number but not their precise location may be maintained by continuous proliferation and dying off. Similarly, it is envisaged that the treatment of brain pathologies by cell transplantation would also create new random links in small-world networks and that even a small number of successfully incorporated new neurons may be functionally important.

References

Albert R. and Barabási A.-L., "Statistical mechanics of complex networks", Rev. Mod. Phys. 74, 47–97 (2002).
Amaral, LAN, Scala, A., Barthelemy, M., Stanley, HE., "Classes of behavior of small-world networks". Proceedings of the National Academy of Sciences (USA) 97:11149-11152 (2000).
Barabási, Albert-László Linked: How Everything is Connected to Everything Else, 2004 ISBN 0-452-28439-2
Barabási, Albert-László "Scale-Free Networks". Scientific American, 288:60-69, May 2003.
Barabási, Albert-László and Albert, Réka. "Emergence of scaling in random networks". Science, 286:509-512, October 15, 1999.
Dan Braha and Yaneer Bar-Yam, "Topology of Large-Scale Engineering Problem-Solving Networks" Phys. Rev. E 69, 016113 (2004)
Caldarelli G. "Scale-Free Networks" Oxford University Press, Oxford (2007).
Caldarelli G., Capocci A., De Los Rios P., Muñoz M.A., "Scale-free networks from varying vertex intrinsic fitness" Physical Review Letters 89, 258702 (2002).
Dangalchev, Ch., Generation models for scale-free networks, Physica A, 338,(2004)
Dorogovtsev, S.N. and Mendes, J.F.F., Evolution of Networks: from biological networks to the Internet and WWW, Oxford University Press, 2003, ISBN 0-19-851590-1
Dorogovtsev, S.N. and Mendes, J.F.F. and Samukhin, A.N., "Structure of Growing Networks: Exact Solution of the Barabási--Albert's Model", Phys. Rev. Lett. 85, 4633 (2000)
Dorogovtsev, S.N. and Mendes, J.F.F., Evolution of networks, Advances in Physics 51, 1079-1187 (2002)
Erdős, P. and Rényi, A. Random graphs. Publication of the Mathematical Institute of the Hungarian Academy of Science, 5, pages 17-61, 1960.
Faloutsos, M., Faloutsos, P. and Faloutsos, C., On power-law relationships of the internet topology Comp. Comm. rev. 29, 251, 1999.
Li, L., Alderson, D., Tanaka, R., Doyle, J.C., Willinger, W., Towards a Theory of Scale-Free Graphs: Definition, Properties, and Implications (Extended Version). Internet Mathematics, 2005.
Kumar, R., Raghavan, P., Rajagopalan, S., Sivakumar, D., Tomkins, A., and Upfal, E.: Stochastic models for the web graph. In Proceedings of the 41st Annual Symposium on Foundations of Computer Science (FOCS), pages 57-65, Redondo Beach, CA, USA. IEEE CS Press, 2000.
Manev R., Manev H.; Med. Hypotheses 2005;64(1):114-7 [1]
Matlis, Jan. Scale-Free Networks. ComputerWorld. November 4, 2002.
Newman, Mark E. J. The structure and function of complex networks, 2003.
Pastor-Satorras, R.,Vespignani, A.,"Evolution and Structure of the Internet: A Statistical Physics Approach",Cambridge University Press, 2004, ISBN 0521826985
Pennock, D. M., Flake, G. W., Lawrence, S., Glover, E. J., and Giles, C. L.: Winners don't take all: Characterizing the competition for links on the web. Proceedings of the National Academy of Sciences, 99(8):5207-5211, 2002.
Robb, John. Scale-Free Networks and Terrorism, 2004.
Keller, E.F. Revisiting "scale-free" networks, BioEssays 27(10) 1060-1068, 2005.
R. N. Onody and P. A. de Castro, Complex Network Study of Brazilian Soccer Player, Phys. Rev. E 70, 037103 (2004)
Reuven Cohen, Shlomo Havlin, "Scale-Free Networks are Ultrasmall" Phys. Rev. Lett. 90, 058701 (2003)

^ Seyed-allaei, Hamed (2006). "Scale-free networks with an exponent less than two". Physical Review E. 73: 046113. doi:10.1103/PhysRevE.73.046113. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)

Links

Social-circles network model - a more generalized generative model for many "real-world networks" of which the scale-free network is a special case

[1] Seyed-allaei, Hamed (2006). "Scale-free networks with an exponent less than two". Physical Review E. 73: 046113. doi:10.1103/PhysRevE.73.046113. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)

[1]