Hybrid Numerical Solution of the Chemical Master Equation

We present a numerical approximation technique for the analysis of continuous-time Markov chains that describe networks of biochemical reactions and play an important role in the stochastic modeling of biological systems. Our approach is based on the construction of a stochastic hybrid model in which certain discrete random variables of the original Markov chain are approximated by continuous deterministic variables. We compute the solution of the stochastic hybrid model using a numerical algorithm that discretizes time and in each step performs a mutual update of the transient probability distribution of the discrete stochastic variables and the values of the continuous deterministic variables. We implemented the algorithm and we demonstrate its usefulness and efficiency on several case studies from systems biology

Chemical master versus chemical langevin for first-order reaction networks

Markov jump processes are widely used to model interacting species in circumstances where discreteness and stochasticity are relevant. Such models have been particularly successful in computational cell biology, and in this case, the interactions are typically rst-order. The Chemical Langevin Equation is a stochastic dierential equation that can be regarded as an approximation to the underlying jump process. In particular, the Chemical Langevin Equation allows simulations to be performed more eectively. In this work, we obtain expressions for the rst and second moments of the Chemical Langevin Equation for a generic rst-order reaction network. Moreover, we show that these moments exactly match those of the under-lying jump process. Hence, in terms of means, variances and correlations, the Chemical Langevin Equation is an excellent proxy for the Chemical Master Equation. Our work assumes that a unique solution exists for the Chemical Langevin Equation. We also show that the moment matching re- sult extends to the case where a gene regulation model of Raser and O'Shea (Science, 2004) is replaced by a hybrid model that mixes elements of the Master and Langevin equations. We nish with numerical experiments on a dimerization model that involves second order reactions, showing that the two regimes continue to give similar results

Approximation and inference methods for stochastic biochemical kinetics-a tutorial review

Stochastic fluctuations of molecule numbers are ubiquitous in biological systems. Important examples include gene expression and enzymatic processes in living cells. Such systems are typically modelled as chemical reaction networks whose dynamics are governed by the chemical master equation. Despite its simple structure, no analytic solutions to the chemical master equation are known for most systems. Moreover, stochastic simulations are computationally expensive, making systematic analysis and statistical inference a challenging task. Consequently, significant effort has been spent in recent decades on the development of efficient approximation and inference methods. This article gives an introduction to basic modelling concepts as well as an overview of state of the art methods. First, we motivate and introduce deterministic and stochastic methods for modelling chemical networks, and give an overview of simulation and exact solution methods. Next, we discuss several approximation methods, including the chemical Langevin equation, the system size expansion, moment closure approximations, time-scale separation approximations and hybrid methods. We discuss their various properties and review recent advances and remaining challenges for these methods. We present a comparison of several of these methods by means of a numerical case study and highlight some of their respective advantages and disadvantages. Finally, we discuss the problem of inference from experimental data in the Bayesian framework and review recent methods developed the literature. In summary, this review gives a self-contained introduction to modelling, approximations and inference methods for stochastic chemical kinetics

Simulation of stochastic reaction-diffusion processes on unstructured meshes

Stochastic chemical systems with diffusion are modeled with a reaction-diffusion master equation. On a macroscopic level, the governing equation is a reaction-diffusion equation for the averages of the chemical species. On a mesoscopic level, the master equation for a well stirred chemical system is combined with Brownian motion in space to obtain the reaction-diffusion master equation. The space is covered by an unstructured mesh and the diffusion coefficients on the mesoscale are obtained from a finite element discretization of the Laplace operator on the macroscale. The resulting method is a flexible hybrid algorithm in that the diffusion can be handled either on the meso- or on the macroscale level. The accuracy and the efficiency of the method are illustrated in three numerical examples inspired by molecular biology

The interplay between discrete noise and nonlinear chemical kinetics in a signal amplification cascade

We used various analytical and numerical techniques to elucidate signal propagation in a small enzymatic cascade which is subjected to external and internal noise. The nonlinear character of catalytic reactions, which underlie protein signal transduction cascades, renders stochastic signaling dynamics in cytosol biochemical networks distinct from the usual description of stochastic dynamics in gene regulatory networks. For a simple 2-step enzymatic cascade which underlies many important protein signaling pathways, we demonstrated that the commonly used techniques such as the linear noise approximation and the Langevin equation become inadequate when the number of proteins becomes too low. Consequently, we developed a new analytical approximation, based on mixing the generating function and distribution function approaches, to the solution of the master equation that describes nonlinear chemical signaling kinetics for this important class of biochemical reactions. Our techniques work in a much wider range of protein number fluctuations than the methods used previously. We found that under certain conditions the burst-phase noise may be injected into the downstream signaling network dynamics, resulting possibly in unusually large macroscopic fluctuations. In addition to computing first and second moments, which is the goal of commonly used analytical techniques, our new approach provides the full time-dependent probability distributions of the colored non-Gaussian processes in a nonlinear signal transduction cascade.Comment: 16 pages, 9 figure

Switching and diffusion models for gene regulation networks

We analyze a hierarchy of three regimes for modeling gene regulation. The most complete model is a continuous time, discrete state space, Markov jump process. An intermediate 'switch plus diffusion' model takes the form of a stochastic differential equation driven by an independent continuous time Markov switch. In the third 'switch plus ODE' model the switch remains but the diffusion is removed. The latter two models allow for multi-scale simulation where, for the sake of computational efficiency, system components are treated differently according to their abundance. The 'switch plus ODE' regime was proposed by Paszek (Modeling stochasticity in gene regulation: characterization in the terms of the underlying distribution function, Bulletin of Mathematical Biology, 2007), who analyzed the steady state behavior, showing that the mean was preserved but the variance only approximated that of the full model. Here, we show that the tools of stochastic calculus can be used to analyze first and second moments for all time. A technical issue to be addressed is that the state space for the discrete-valued switch is infinite. We show that the new 'switch plus diffusion' regime preserves the biologically relevant measures of mean and variance, whereas the 'switch plus ODE' model uniformly underestimates the variance in the protein level. We also show that, for biologically relevant parameters, the transient behaviour can differ significantly from the steady state, justifying our time-dependent analysis. Extra computational results are also given for a protein dimerization model that is beyond the scope of the current analysis