IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis
-
Upload
claire-rioualen -
Category
Science
-
view
10 -
download
0
Transcript of IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis
![Page 1: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/1.jpg)
IFB cloud:
Integration of snakemake workflows in
an appliance designed for ChIP-seq analysis
Claire Rioualen
2015/10/28
![Page 2: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/2.jpg)
French Institute of Bioinformatics (IFB)
● National service infrastructure in bioinformatics
● 32 platforms grouped into regional centers
● French node of the European research infrastructure ELIXIR
![Page 3: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/3.jpg)
French Institute of Bioinformatics (IFB)
● National service infrastructure in bioinformatics
● 32 platforms grouped into regional centers
● French node of the European research infrastructure ELIXIR
● Provides services and infrastructures in bioinformatics for scientists and engineers working in the field of life sciences
http://www.france-bioinformatique.fr
![Page 4: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/4.jpg)
IFB cloud
● 200 computing cores
● 2 To of RAM
● 50 To of storage
By 2016
● 3,000 cores
● 500 To of storage
By 2017
● 10,000 cores
● 2 Po of storage
![Page 5: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/5.jpg)
IFB cloud appliances
![Page 6: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/6.jpg)
![Page 7: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/7.jpg)
ChIP-seq appliance
● Base Ubuntu 14.04
Including ssh, rsync, git, python 2, python 3...
![Page 8: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/8.jpg)
ChIP-seq appliance
● Base Ubuntu 14.04
Including ssh, rsync, git, python 2, python 3...
● Programming tools
snakemake, graphviz, pandas library...
![Page 9: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/9.jpg)
ChIP-seq appliance
● Base Ubuntu 14.04
Including ssh, rsync, git, python 2, python 3...
● Programming tools
snakemake, graphviz, pandas library...
● NGS tools
![Page 10: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/10.jpg)
ChIP-seq appliance
● Base Ubuntu 14.04
Including ssh, rsync, git, python 2, python 3...
● Programming tools
snakemake, graphviz, pandas library...
● NGS tools
● fg-chip-seq git repository
Including workflow examples (py + json)
![Page 11: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/11.jpg)
Using the IFB cloud: request account
cloud.france-bioinformatique.fr
Request account
![Page 12: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/12.jpg)
Using the IFB cloud: dashboard
cloud.france-bioinformatique.fr
Add ssh key
Create a virtual disk
![Page 13: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/13.jpg)
Using the IFB cloud: vDisk
cloud.france-bioinformatique.fr
Size (Go)
Name
![Page 14: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/14.jpg)
Using the IFB cloud: create instance
cloud.france-bioinformatique.fr
Choose appliance
Plug vDisk
Up to 8 CPU, 32GB RAM
Name
![Page 15: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/15.jpg)
Using the IFB cloud: ssh connection
cloud.france-bioinformatique.fr
ssh connection
![Page 16: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/16.jpg)
Using the IFB cloud: data
![Page 17: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/17.jpg)
Using the IFB cloud: execute workflow
● Several example workflows already available & adaptable in the git repository
● 1 config file (json) + 1 workflow file (py)
● Paths to data, genome & results directories
● Parameters
![Page 18: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/18.jpg)
Using the IFB cloud: execute workflow
● Several example workflows already available & adaptable in the git repository
● 1 config file (json) + 1 workflow file (py)
● Paths to data, genome & results directories
● Parameters
● Results are saved in the vDisk
![Page 19: IFB cloud: Integration of snakemake workflows in an appliance designed for ChIP-seq analysis](https://reader031.fdocuments.in/reader031/viewer/2022022413/58efb1691a28ab06578b4693/html5/thumbnails/19.jpg)
Thank you!