Gene regulatory network
A gene regulatory network or genetic regulatory network (GRN) is a collection of regulators interact with each other and with other substances in the cell to govern the gene expression levels of mRNA and proteins. The regulator can be DNA, RNA, protein and their complex. The interaction can be direct or indirect (through their transcribed RNA or translated protein). In general, each mRNA molecule goes on to make a specific protein (or set of proteins). In some cases this protein will be structural, and will accumulate at the cell membrane or within the cell to give it particular structural properties. In other cases the protein will be an enzyme, i.e., a micro-machine that catalyses a certain reaction, such as the breakdown of a food source or toxin. Some proteins though serve only to activate other genes, and these are the transcription factors that are the main players in regulatory networks or cascades. By binding to the promoter region at the start of other genes they turn them on, initiating the production of another protein, and so on. Some transcription factors are inhibitory.
In single-celled organisms, regulatory networks respond to the external environment, optimising the cell at a given time for survival in this environment. Thus a yeast cell, finding itself in a sugar solution, will turn on genes to make enzymes that process the sugar to alcohol. This process, which we associate with wine-making, is how the yeast cell makes its living, gaining energy to multiply, which under normal circumstances would enhance its survival prospects.
In multicellular animals the same principle has been put in the service of gene cascades that control body-shape. Each time a cell divides, two cells result which, although they contain the same genome in full, can differ in which genes are turned on and making proteins. Sometimes a 'self-sustaining feedback loop' ensures that a cell maintains its identity and passes it on. Less understood is the mechanism of epigenetics by which chromatin modification may provide cellular memory by blocking or allowing transcription. A major feature of multicellular animals is the use of morphogen gradients, which in effect provide a positioning system that tells a cell where in the body it is, and hence what sort of cell to become. A gene that is turned on in one cell may make a product that leaves the cell and diffuses[disambiguation needed] through adjacent cells, entering them and turning on genes only when it is present above a certain threshold level. These cells are thus induced into a new fate, and may even generate other morphogens that signal back to the original cell. Over longer distances morphogens may use the active process of signal transduction. Such signalling controls embryogenesis, the building of a body plan from scratch through a series of sequential steps. They also control and maintain adult bodies through feedback processes, and the loss of such feedback because of a mutation can be responsible for the cell proliferation that is seen in cancer. In parallel with this process of building structure, the gene cascade turns on genes that make structural proteins that give each cell the physical properties it needs.
It has been suggested that, because biological molecular interactions are intrinsically stochastic, gene networks are the result of cellular processes and not their cause (i.e. cellular Darwinism). However, recent experimental evidence has favored the attractor view of cell fates.
At one level, biological cells can be thought of as "partially mixed bags" of biological chemicals – in the discussion of gene regulatory networks, these chemicals are mostly the mRNAs and proteins that arise from gene expression. These mRNA and proteins interact with each other with various degrees of specificity. Some diffuse around the cell. Others are bound to cell membranes, interacting with molecules in the environment. Still others pass through cell membranes and mediate long range signals to other cells in a multi-cellular organism. These molecules and their interactions comprise a gene regulatory network. A typical gene regulatory network looks something like this:
The nodes of this network are proteins, their corresponding mRNAs, and protein/protein complexes. Nodes that are depicted as lying along vertical lines are associated with the cell/environment interfaces, while the others are free-floating and diffusible. Implied are genes, the DNA sequences which are transcribed into the mRNAs that translate into proteins. Edges between nodes represent individual molecular reactions, the protein/protein and protein/mRNA interactions through which the products of one gene affect those of another, though the lack of experimentally obtained information often implies that some reactions are not modeled at such a fine level of detail. These interactions can be inductive (the arrowheads), with an increase in the concentration of one leading to an increase in the other, or inhibitory (the filled circles), with an increase in one leading to a decrease in the other. A series of edges indicates a chain of such dependences, with cycles corresponding to feedback loops. The network structure is an abstraction of the system's chemical dynamics, describing the manifold ways in which one substance affects all the others to which it is connected. In practice, such GRNs are inferred from the biological literature on a given system and represent a distillation of the collective knowledge about a set of related biochemical reactions. To speed up the manual curation of GRNs, some recent efforts try to use text mining and information extraction technologies for this purpose. 
Genes can be viewed as nodes in the network, with input being proteins such as transcription factors, and outputs being the level of gene expression. The node itself can also be viewed as a function which can be obtained by combining basic functions upon the inputs (in the Boolean network described below these are Boolean functions, typically AND, OR, and NOT). These functions have been interpreted as performing a kind of information processing within the cell, which determines cellular behavior. The basic drivers within cells are concentrations of some proteins, which determine both spatial (location within the cell or tissue) and temporal (cell cycle or developmental stage) coordinates of the cell, as a kind of "cellular memory". The gene networks are only beginning to be understood, and it is a next step for biology to attempt to deduce the functions for each gene "node", to help understand the behavior of the system in increasing levels of complexity, from gene to signaling pathway, cell or tissue level (see systems biology).
Mathematical models of GRNs have been developed to capture the behavior of the system being modeled, and in some cases generate predictions corresponding with experimental observations. In some other cases, models have proven to make accurate novel predictions, which can be tested experimentally, thus suggesting new approaches to explore in an experiment that sometimes wouldn't be considered in the design of the protocol of an experimental laboratory. The most common modeling technique involves the use of coupled ordinary differential equations (ODEs). Several other promising modeling techniques have been used, including Boolean networks, Petri nets, Bayesian networks, graphical Gaussian models, Stochastic, and Process Calculi. Conversely, techniques have been proposed for generating models of GRNs that best explain a set of time series observations.Recently it has been shown that ChIP-seq signal of Histone modification are more correlated with transcription factor motifs at promoters in comparison to RNA level. Hence it is proposed that time-series histone modification ChIP-seq could provide more reliable inference of gene-regulatory networks in comparison to methods based on expression levels.
It is common to model such a network with a set of coupled ordinary differential equations (ODEs) or stochastic ODEs, describing the reaction kinetics of the constituent parts. Suppose that our regulatory network has nodes, and let represent the concentrations of the corresponding substances at time . Then the temporal evolution of the system can be described approximately by
where the functions express the dependence of on the concentrations of other substances present in the cell. The functions are ultimately derived from basic principles of chemical kinetics or simple expressions derived from these e.g. Michaelis-Menten enzymatic kinetics. Hence, the functional forms of the are usually chosen as low-order polynomials or Hill functions that serve as an ansatz for the real molecular dynamics. Such models are then studied using the mathematics of nonlinear dynamics. System-specific information, like reaction rate constants and sensitivities, are encoded as constant parameters.
By solving for the fixed point of the system:
for all , one obtains (possibly several) concentration profiles of proteins and mRNAs that are theoretically sustainable (though not necessarily stable). Steady states of kinetic equations thus correspond to potential cell types, and oscillatory solutions to the above equation to naturally cyclic cell types. Mathematical stability of these attractors can usually be characterized by the sign of higher derivatives at critical points, and then correspond to biochemical stability of the concentration profile. Critical points and bifurcations in the equations correspond to critical cell states in which small state or parameter perturbations could switch the system between one of several stable differentiation fates. Trajectories correspond to the unfolding of biological pathways and transients of the equations to short-term biological events. For a more mathematical discussion, see the articles on nonlinearity, dynamical systems, bifurcation theory, and chaos theory.
The following example illustrates how a Boolean network can model a GRN together with its gene products (the outputs) and the substances from the environment that affect it (the inputs). Stuart Kauffman was amongst the first biologists to use the metaphor of Boolean networks to model genetic regulatory networks.
- Each gene, each input, and each output is represented by a node in a directed graph in which there is an arrow from one node to another if and only if there is a causal link between the two nodes.
- Each node in the graph can be in one of two states: on or off.
- For a gene, "on" corresponds to the gene being expressed; for inputs and outputs, "off" corresponds to the substance being present.
- Time is viewed as proceeding in discrete steps. At each step, the new state of a node is a Boolean function of the prior states of the nodes with arrows pointing towards it.
The validity of the model can be tested by comparing simulation results with time series observations. A partial validation of a Boolean network model can also come from testing the predicted existence of a yet unknown regulatory connection between two particular transcription factors that each are nodes of the model. 
Continuous network models of GRNs are an extension of the boolean networks described above. Nodes still represent genes and connections between them regulatory influences on gene expression. Genes in biological systems display a continuous range of activity levels and it has been argued that using a continuous representation captures several properties of gene regulatory networks not present in the Boolean model. Formally most of these approaches are similar to an artificial neural network, as inputs to a node are summed up and the result serves as input to a sigmoid function, e.g., but proteins do often control gene expression in a synergistic, i.e. non-linear, way. However there is now a continuous network model that allows grouping of inputs to a node thus realizing another level of regulation. This model is formally closer to a higher order recurrent neural network. The same model has also been used to mimic the evolution of cellular differentiation and even multicellular morphogenesis.
Stochastic gene networks
Recent experimental results  have demonstrated that gene expression is a stochastic process. Thus, many authors are now using the stochastic formalism, after the work by. Works on single gene expression and small synthetic genetic networks, such as the genetic toggle switch of Tim Gardner and Jim Collins, provided additional experimental data on the phenotypic variability and the stochastic nature of gene expression. The first versions of stochastic models of gene expression involved only instantaneous reactions and were driven by the Gillespie algorithm.
Since some processes, such as gene transcription, involve many reactions and could not be correctly modeled as an instantaneous reaction in a single step, it was proposed to model these reactions as single step multiple delayed reactions in order to account for the time it takes for the entire process to be complete.
From here, a set of reactions were proposed that allow generating GRNs. These are then simulated using a modified version of the Gillespie algorithm, that can simulate multiple time delayed reactions (chemical reactions where each of the products is provided a time delay that determines when will it be released in the system as a "finished product").
For example, basic transcription of a gene can be represented by the following single-step reaction (RNAP is the RNA polymerase, RBS is the RNA ribosome binding site, and Pro i is the promoter region of gene i):
Furthermore, there seems to be a trade-off between the noise in gene expression, the speed with which genes can switch, and the metabolic cost associated their functioning. More specifically, for any given level of metabolic cost, there is an optimal trade-off between noise and processing speed and increasing the metabolic cost leads to better speed-noise trade-offs.
A recent work proposed a simulator (SGNSim, Stochastic Gene Networks Simulator), that can model GRNs where transcription and translation are modeled as multiple time delayed events and its dynamics is driven by a stochastic simulation algorithm (SSA) able to deal with multiple time delayed events. The time delays can be drawn from several distributions and the reaction rates from complex functions or from physical parameters. SGNSim can generate ensembles of GRNs within a set of user-defined parameters, such as topology. It can also be used to model specific GRNs and systems of chemical reactions. Genetic perturbations such as gene deletions, gene over-expression, insertions, frame shift mutations can also be modeled as well.
The GRN is created from a graph with the desired topology, imposing in-degree and out-degree distributions. Gene promoter activities are affected by other genes expression products that act as inputs, in the form of monomers or combined into multimers and set as direct or indirect. Next, each direct input is assigned to an operator site and different transcription factors can be allowed, or not, to compete for the same operator site, while indirect inputs are given a target. Finally, a function is assigned to each gene, defining the gene's response to a combination of transcription factors (promoter state). The transfer functions (that is, how genes respond to a combination of inputs) can be assigned to each combination of promoter states as desired.
In other recent work, multiscale models of gene regulatory networks have been developed that focus on synthetic biology applications. Simulations have been used that model all biomolecular interactions in transcription, translation, regulation, and induction of gene regulatory networks, guiding the design of synthetic systems.
Other work has focused on predicting the gene expression levels in a gene regulatory network. The approaches used to model gene regulatory networks have been constrained to be interpretable and, as a result, are generally simplified versions of the network. For example, Boolean networks have been used due to their simplicity and ability to handle noisy data but lose data information by having a binary representation of the genes. Also, artificial neural networks omit using a hidden layer so that they can be interpreted, losing the ability to model higher order correlations in the data. Using a model that is not constrained to be interpretable, a more accurate model can be produced. Being able to predict gene expressions more accurately provides a way to explore how drugs affect a system of genes as well as for finding which genes are interrelated in a process. This has been encouraged by the DREAM competition which promotes a competition for the best prediction algorithms. Some other recent work has used artificial neural networks with a hidden layer.
Structure and evolution
Gene regulatory networks are generally thought to be made up of a few highly connected nodes (hubs) and many poorly connected nodes nested within a hierarchical regulatory regime. Thus gene regulatory networks approximate a hierarchical scale free network topology. This is consistent with the view that most genes have limited pleiotropy and operate within regulatory modules. This structure is thought to evolve due to the preferential attachment of duplicated genes to more highly connected genes. Recent work has also shown that natural selection tends to favor networks with sparse connectivity.
There are primarily two ways that networks can evolve, both of which can occur simultaneously. The first is that network topology can be changed by the addition or subtraction of nodes (genes) or parts of the network (modules) may be expressed in different contexts. The Drosophila Hippo signaling pathway provides a good example. The Hippo signaling pathway controls both mitotic growth and post-mitotic cellular differentiation. Recently it was found that the network the Hippo signaling pathway operates in differs between these two functions which in turn changes the behavior of the Hippo signaling pathway. This suggests that the Hippo signaling pathway operates as a conserved regulatory module that can be used for multiple functions depending on context. Thus, changing network topology can allow a conserved module to serve multiple functions and alter the final output of the network. The second way networks can evolve is by changing the strength of interactions between nodes, such as how strongly a transcription factor may bind to a cis-regulatory element. Such variation in strength of network edges has been shown to underlie between species variation in vulva cell fate patterning of Caenorhabditis worms.
Bacterial regulatory networks
Regulatory networks allow bacteria to adapt to almost every environmental niche on earth. A network of interactions among diverse types of molecules including DNA, RNA, proteins and metabolites, is utilised by the bacteria to achieve regulation of gene expression. In bacteria, the principal function of regulatory networks is to control the response to environmental changes, for example nutritional status and environmental stress. A complex organization of networks permits the microorganism to coordinate and integrate multiple environmental signals.
- Body plan
- Cis-regulatory module
- Genenetwork (database)
- Systems biology
- Weighted gene co-expression network analysis
- "Transcriptional Regulatory Networks in Saccharomyces cerevisiae". Young Lab.
- Davidson E, Levin M; Levin (April 2005). "Gene regulatory networks". Proc. Natl. Acad. Sci. U.S.A. 102 (14): 4935. doi:10.1073/pnas.0502024102. PMC 556010. PMID 15809445.
- Florian Leitner, Martin Krallinger, Sushil Tripathi, Martin Kuiper, Astrid Lægreid and Alfonso Valencia, Mining cis-Regulatory Transcription Networks from Literature, Proceedings of BioLINK Special Interest Group, 5-12, ISBM/ECCB, 2013
- Vibhor Kumar, Masafumi Muratani, Nirmala Arul Rayan, Petra Kraus, Thomas Lufkin, Huck Hui Ng and Shyam Prabhakar, Uniform, optimal signal processing of mapped deep-sequencing data, Nature biotechnology, 2013
- Chu D, Zabet NR, Mitavskiy B; Zabet; Mitavskiy (April 2009). "Models of transcription factor binding: sensitivity of activation functions to model assumptions". J. Theor. Biol. 257 (3): 419–29. doi:10.1016/j.jtbi.2008.11.026. PMID 19121637.
- Kauffman, Stuart (1993). The Origins of Order. ISBN 0-19-505811-9.
- Kauffman SA (1969). "Metabolic stability and epigenesis in randomly constructed genetic nets" (PDF). Journal of Theoretical Biology 22 (3): 437–467. doi:10.1016/0022-5193(69)90015-0. PMID 5803332.
- Lovrics A, Gao Y, Juhász B, Bock I, Byrne HM, Dinnyés A, Kovács KA (November 2014). "Boolean modelling reveals new regulatory connections between transcription factors orchestrating the development of the ventral spinal cord". PLoS One 9 (11): 11430. PMID 25398016.
- Vohradsky J (September 2001). "Neural model of the genetic network". J. Biol. Chem. 276 (39): 36168–73. doi:10.1074/jbc.M104391200. PMID 11395518.
- Geard N, Wiles J; Wiles (2005). "A gene network model for developing cell lineages". Artif. Life 11 (3): 249–67. doi:10.1162/1064546054407202. PMID 16053570.
- Schilstra MJ, Bolouri H (2 January 2002). "Modelling the Regulation of Gene Expression in Genetic Regulatory Networks". Biocomputation group, University of Hertfordshire.
- Knabe JF, Nehaniv CL, Schilstra MJ, Quick T (2006). "Evolving Biological Clocks using Genetic Regulatory Networks". Proceedings of the Artificial Life X Conference (Alife 10). MIT Press. pp. 15–21. CiteSeerX: 10
.1 .1 .72 .5016.
- Knabe JF, Nehaniv CL, Schilstra MJ (2006). "Evolutionary Robustness of Differentiation in Genetic Regulatory Networks". Proceedings of the 7th German Workshop on Artificial Life 2006 (GWAL-7). Berlin: Akademische Verlagsgesellschaft Aka. pp. 75–84. CiteSeerX: 10
.1 .1 .71 .8768.
- Knabe JF, Schilstra MJ, Nehaniv CL (2008). "Evolution and Morphogenesis of Differentiated Multicellular Organisms: Autonomously Generated Diffusion Gradients for Positional Information" (PDF). Artificial Life XI: Proceedings of the Eleventh International Conference on the Simulation and Synthesis of Living Systems. MIT Press.
- Elowitz MB, Levine AJ, Siggia ED, Swain PS; Levine; Siggia; Swain (August 2002). "Stochastic gene expression in a single cell". Science 297 (5584): 1183–6. doi:10.1126/science.1070919. PMID 12183631.
- Blake WJ, KAErn M, Cantor CR, Collins JJ; Kaern; Cantor; Collins (April 2003). "Noise in eukaryotic gene expression" (PDF). Nature 422 (6932): 633–7. doi:10.1038/nature01546. PMID 12687005.
- Arkin A, Ross J, McAdams HH; Ross; McAdams (August 1998). "Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells". Genetics 149 (4): 1633–48. PMC 1460268. PMID 9691025.
- Raser JM, O'Shea EK; O'Shea (September 2005). "Noise in Gene Expression: Origins, Consequences, and Control". Science 309 (5743): 2010–3. doi:10.1126/science.1105891. PMC 1360161. PMID 16179466.
- Elowitz MB, Leibler S; Leibler (January 2000). "A synthetic oscillatory network of transcriptional regulators". Nature 403 (6767): 335–8. doi:10.1038/35002125. PMID 10659856.
- Gardner TS, Cantor CR, Collins JJ; Cantor; Collins (January 2000). "Construction of a genetic toggle switch in Escherichia coli". Nature 403 (6767): 339–42. doi:10.1038/35002131. PMID 10659857.
- Gillespie DT (1976). "A general method for numerically simulating the stochastic time evolution of coupled chemical reactions". J. Comput. Phys. 22 (4): 403–34. doi:10.1016/0021-9991(76)90041-3.
- Roussel MR, Zhu R; Zhu (November 2006). "Validation of an algorithm for delay stochastic simulation of transcription and translation in prokaryotic gene expression". Phys Biol 3 (4): 274–84. doi:10.1088/1478-3975/3/4/005. PMID 17200603.
- Ribeiro A, Zhu R, Kauffman SA; Zhu; Kauffman (November 2006). "A general modeling strategy for gene regulatory networks with stochastic dynamics". J. Comput. Biol. 13 (9): 1630–9. doi:10.1089/cmb.2006.13.1630. PMID 17147485.
- Zabet NR, Chu DF; Chu (June 2010). "Computational limits to binary genes". Journal of the Royal Society Interface 7 (47): 945–954. doi:10.1098/rsif.2009.0474. PMC 2871807. PMID 20007173.
- Chu DF, Zabet NR, Hone ANW; Zabet; Hone (May–Jun 2011). "Optimal Parameter Settings for Information Processing in Gene Regulatory Networks". BioSystems 104 (2–3): 99–108. doi:10.1016/j.biosystems.2011.01.006. PMID 21256918.
- Zabet NR (September 2011). "Negative feedback and physical limits of genes". Journal of Theoretical Biology 248 (1): 82–91. doi:10.1016/j.jtbi.2011.06.021. PMID 21723295.
- Ribeiro AS, Lloyd-Price J; Lloyd-Price (March 2007). "SGN Sim, a stochastic genetic networks simulator". Bioinformatics 23 (6): 777–9. doi:10.1093/bioinformatics/btm004. PMID 17267430.
- Kaznessis YN (2007). "Models for synthetic biology". BMC Syst Biol 1: 47. doi:10.1186/1752-0509-1-47. PMC 2194732. PMID 17986347.
- "The DREAM Project". Columbia University Center for Multiscale Analysis Genomic and Cellular Networks (MAGNet).
- Gustafsson M, Hörnquist M; Hörnquist (2010). "Gene Expression Prediction by Soft Integration and the Elastic Net—Best Performance of the DREAM3 Gene Expression Challenge". PLoS ONE 5 (2): e9134. doi:10.1371/journal.pone.0009134. PMID 20169069.
- Smith MR, Clement M, Martinez T, Snell Q (2010). "Time Series Gene Expression Prediction using Neural Networks with Hidden Layers" (PDF). Proceedings of the 7th Biotechnology and Bioinformatics Symposium (BIOT 2010). pp. 67–69.
- Barabasi, A.; Oltvai, Z. N. (2004). "Network biology: understanding the cells' functional organization". Nature Reviews Genetics 5 (2): 101–113. doi:10.1038/nrg1272. PMID 14735121.
- Wagner, G. P. and J. Zhang. 2011. The pleiotropic structure of the genotype-phenotype map: the evolvability of complex organisms. Nature Review Genetics 12: 204-213
- Robert D Leclerc (August 2008). "Survival of the sparest: robust gene networks are parsimonious". Molecular Systems Biology 4 (1): 213. doi:10.1038/msb.2008.52. PMC 2538912. PMID 18682703.
- Jukam; Xie, D. B.; Rister, J.; Terrell, D.; Charlton-Perkins, M.; Pistillo, D.; Gebelein, B.; Desplan, C.; Cook, T. et al. (2013). "Opposite feedbacks in the Hippo pathway for growth control and neural fate". Science 342: 211–219. doi:10.1126/science.1238016.
- Hoyos, E.; Kim, K.; Milloz, J.; Barkoulas, M.; Penigault, J.; Munro, E.; Felix, M. (2011). "Quantitative variation in autocrine signaling and pathway crosstalk in the Caenorhabditis vulva network". Current Biology 21 (7): 527–538. doi:10.1016/j.cub.2011.02.040. PMID 21458263.
- Filloux, AAM (editor) (2012). Bacterial Regulatory Networks. Caister Academic Press. ISBN 978-1-908230-03-4.
- Gross, R; Beier, D (editor) (2012). Two-Component Systems in Bacteria. Caister Academic Press. ISBN 978-1-908230-08-9.
- Requena, JM (editor) (2012). Stress Response in Microbiology. Caister Academic Press. ISBN 978-1-908230-04-1.
- Bolouri, Hamid; Bower, James M. (2001). Computational modeling of genetic and biochemical networks. Cambridge, Mass: MIT Press. ISBN 0-262-02481-0.
- Kauffman SA (1969). "Metabolic stability and epigenesis in randomly constructed genetic nets". J. Theor. Biol. 22: 434–67.
- Open source web service for GRN analysis
- BIB: Yeast Biological Interaction Browser
- Graphical Gaussian models for genome data — Inference of gene association networks with GGMs
- A bibliography on learning causal networks of gene interactions - regularly updated, contains hundreds of links to papers from bioinformatics, statistics, machine learning.
- http://mips.gsf.de/proj/biorel/ BIOREL is a web-based resource for quantitative estimation of the gene network bias in relation to available database information about gene activity/function/properties/associations/interactio.
- Evolving Biological Clocks using Genetic Regulatory Networks - Information page with model source code and Java applet.
- Engineered Gene Networks
- Tutorial: Genetic Algorithms and their Application to the Artificial Evolution of Genetic Regulatory Networks
- BEN: a web-based resource for exploring the connections between genes, diseases, and other biomedical entities
- Global protein-protein interaction and gene regulation network of Arabidopsis thaliana