June 2016 - Zuogong
-
Upload
rsg-luxembourg -
Category
Science
-
view
51 -
download
0
Transcript of June 2016 - Zuogong
![Page 1: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/1.jpg)
Statistical inference of regulatory networks for circadian regulation
— Methodology Part
Zuogong Yue
Pizzaclub, 15th June 2016
Authors: Andrej Aderhold, Dirk Huskier, Marco Grzegorczyk
![Page 2: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/2.jpg)
o Mathematical formulation of transcriptional regulation1
Problem Formulation
2
1 Barenco, M., Tomescu, D., Brewer, D., Callard, R., Stark, J., & Hubank, M. (2006). Ranked prediction of p53 targets using hidden variable dynamic modeling. Genome Biology, 7(3), R25.
o Regulatory networks (bipartite structure)
yg1
yg2
yg3
xg1
xg2
xg3
xg4
xg5
![Page 3: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/3.jpg)
Methods
3
o Graphical Gaussian Models (GGM)
The components corresponding to two genes are stochastically independent conditional on the remaining system
if and only if the corresponding element in the inverse covariance matrix is zero.
![Page 4: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/4.jpg)
Methods
4
o Sparse Regression (LASSO and Elastic Net)
(LASSO)
(Elastic Net)
![Page 5: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/5.jpg)
Methods
5
o Time-varying Sparse Regression (Tesla)
![Page 6: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/6.jpg)
Methods
6
o Hierarchical Bayesian Regression Model (HBR)
linear regression model:
prior:
then getting the posterior:
and the marginal likelihood:
![Page 7: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/7.jpg)
Methods
7
o Hierarchical Bayesian Regression Model (HBR) (cont.)
Finally we get the marginal posterior distribution on
Maximizing the above posterior by Markov chain Monte Carlo (MCMC)
and
![Page 8: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/8.jpg)
Methods
8
o Non-homogeneous Hierarchical Bayesian Model
Applying HBR on a multiple change-point process:
Divide the target variable into sub vectors
![Page 9: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/9.jpg)
Methods
9
o Automatic Relevance Determination (ARD) - Sparse Bayesian Regression (SBR)
Using the prior distribution: (choosing appropriate hyper parameters can lead to sparse solutions):
The marginal likelihood:
Maximize the marginal likelihood by Expectation Maximization (EM) method
![Page 10: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/10.jpg)
Methods
10
o Bayesian Spline Autoregression (BSA)
The original covariates are augmented with B-spline basis functions.
To encourage network sparsity, a slab-and-stick-like Bayesian variable selection scheme2 is used.
2 Smith, M., & Kohn, R. (1996). Nonparametric regression using Bayesian variable selection. Journal of Econometrics, 75(2), 317–343.
![Page 11: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/11.jpg)
Methods
11
o Gaussian Processes (GP)
where is the well-known kernel function.
Calculate the posterior:
Marginalize and perform maximization:
![Page 12: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/12.jpg)
Methods
12
o Mutual Information Methods (ARACNE)
The mutual information (MI) is given by
A pruning mechanism by Margolin (2006):
![Page 13: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/13.jpg)
Methods
13
o Mixture Bayesian Network Models (MBN)
Representing as a Gaussian mixture model (GMM):
Maximize the likelihood of the conditional GMM:
![Page 14: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/14.jpg)
Methods
14
o Gaussian Bayesian Network (BGe)
Calculate the posterior distribution of and perform maximization
Assume that
Impose a normal-Wishart prior:
![Page 15: June 2016 - Zuogong](https://reader031.fdocuments.in/reader031/viewer/2022030313/58ec83ac1a28ab4a538b46f5/html5/thumbnails/15.jpg)
15
Thank you!