Vision Based Scalable Workflow Development using Web Services

38
Vision Based Scalable Workflow Development using Web Services Jane Ren

description

Vision Based Scalable Workflow Development using Web Services. Jane Ren. Overview. Introduction to Using Web Services with Vision ADT Library Nodes Virtual Screening Workflow Things to Know about Vision Hands On Exercises Using PrepareReceptor from Adt lib - PowerPoint PPT Presentation

Transcript of Vision Based Scalable Workflow Development using Web Services

Page 1: Vision Based Scalable Workflow Development using Web Services

Vision Based Scalable Workflow Development

using Web Services

Jane Ren

Page 2: Vision Based Scalable Workflow Development using Web Services

2

Overview

Introduction to Using Web Services with VisionADT Library NodesVirtual Screening WorkflowThings to Know about VisionHands On Exercises

Using PrepareReceptor from Adt libRunning virtual screening workflowUsing VirtualScreening from Adt libBuilding PDB2PQR macro / library nodeBuilding Autodock workflowBuilidng NAMD workflow

Page 3: Vision Based Scalable Workflow Development using Web Services

3

Mac Users…Make sure your Keyboard & Mouse settings are configure this way, so that your mouse can act like a Windows mouse.

Apple -> System Preferences… -> Keyboard & Mouse

Page 4: Vision Based Scalable Workflow Development using Web Services

4

Loading Web Services Library

QuickTime™ and a decompressor

are needed to see this picture.

Page 5: Vision Based Scalable Workflow Development using Web Services

5

Loading ws.nbcr.net Web Services

QuickTime™ and a decompressor

are needed to see this picture.

After loading the ws library, the new nodes for Web Services appear here.

These are some ofthe web services from

http://ws.nbcr.net

Page 6: Vision Based Scalable Workflow Development using Web Services

6

ws.nbcr.net Web ServicesThe web services you just loaded are exactly the same as the ones on http://ws.nbcr.net.

http://ws.nbcr.net/opal2/GetServicesList.do

QuickTime™ and a decompressor

are needed to see this picture.

Page 7: Vision Based Scalable Workflow Development using Web Services

7

Loading the ADT Library

Page 8: Vision Based Scalable Workflow Development using Web Services

8

ADT Library Nodes for Virtual Screening

New Adt lib nodes appeared

Page 9: Vision Based Scalable Workflow Development using Web Services

9

ADT Lib Node documentation

You can put your cursor over a node to see its documentation.

Page 10: Vision Based Scalable Workflow Development using Web Services

10

PrepareReceptor Node

The PrepareReceptor node creates the PDBQT file based on the input PDB file.

QuickTime™ and a decompressor

are needed to see this picture.

Input - path to PDB file

Output - PDBQT file (can be URL or local path)

Page 11: Vision Based Scalable Workflow Development using Web Services

11

Inside PrepareReceptor Node

Two Major StepsRun PDB2PQR web service.

This step is skipped if an appropriate PQR file exists on the local machine.

Run PrepareReceptor web service.

Output is URL to PDBQT

PDB2PQR and PrepareReceptor are skipped if an appropriate PDBQT file exists on the local machine.

Output is PDBQT path on local machine.

Macro that runsPDB2QR web service.

Macro that runsPrepareReceptor

web service

Page 12: Vision Based Scalable Workflow Development using Web Services

12

PrepareReceptor Web ServiceOpen the PrepareReceptor parameter panel

Click on PrepareReceptorClick on PrepareReceptorWSDouble click on PrepareReceptorOpalService_ws_nbcr_net

Parameter C (preserve all input charges. ie do not add new charges, default is gasteiger charges) is NOT checked by default with MGL Tools release 1.5.6 revision 32. This may change in the next MGLTools release.

The previous PDB2PQR step is used to add hydrogen charges.You should check/Uncheck this option based on your needs.

QuickTime™ and a decompressor

are needed to see this picture.

Page 13: Vision Based Scalable Workflow Development using Web Services

13

ComputeGrids Node

QuickTime™ and a decompressor

are needed to see this picture.

ComputeGrids prepare sthe GPF with the ligand library and then runs the Autogrid web service.

https://www.nbcr.net/pub/wiki/index.php?title=Virtual_Screening_Libraries

contains information about the current ligand libraries on kryptonite.nbcr.net.

ligand library name Receptor PDBQT file GPF template

URL to Autogrid results

Page 14: Vision Based Scalable Workflow Development using Web Services

14

Inside ComputeGrids Node

Check if GPF template path is valid.

Exit if not

Run PrepareGPF web service based on the template GPF.

Run Autogrid web service

Page 15: Vision Based Scalable Workflow Development using Web Services

15

AutodockVS Node

QuickTime™ and a decompressor

are needed to see this picture.

Run Autodock virtual screening with the ligand library.

Ligand library nameTarball of Autogrid results.This can be a URL also. DPF template

URL to Autodock virtual screening results

Page 16: Vision Based Scalable Workflow Development using Web Services

16

Inside AutodockVS Node

Check if DPF template path is valid.

If not, then exit

Run Autodock virtual screening web service.

Page 17: Vision Based Scalable Workflow Development using Web Services

17

Virtual Screening Node

QuickTime™ and a decompressor

are needed to see this picture.

This VirtualScreening node runs the entire virtual screening experiment. It is simply a combination of PrepareReceptor, ComputeGrids, and AutodockVS.

Ligand library name Input - path to PDB file GPF template DPF template

URL to Autodock virtual screening results

Page 18: Vision Based Scalable Workflow Development using Web Services

18

Inside the VirtualScreening Node

Page 19: Vision Based Scalable Workflow Development using Web Services

19

Using Vision

TypesBy default, a generic node/macro node port has the type None.It is good practice to change None to a real type such as int or string.

Right click on the port and choose edit. Select a replacement for None from the data type drop down menu.Click on Apply and then OK.

QuickTime™ and a decompressor

are needed to see this picture.

Page 20: Vision Based Scalable Workflow Development using Web Services

20

Using Vision

Immediate Run ToggleBy default, the toggle is turned on. This means you have immediate run behavior.

If you change the input of a node. Then the node may start running automatically before you click on the run button.

You can turn the toggle off by clicking on the toggle button.

You can also save your network with toggle off Next time your play with your network it will have the immediate run behavior turned off.

QuickTime™ and a decompressor

are needed to see this picture.

Page 21: Vision Based Scalable Workflow Development using Web Services

21

Using Vision

If you don’t know where a node is, then simply type the node name in the search box. The node will be highlighted for a couple of seconds if it is found.

QuickTime™ and a decompressor

are needed to see this picture.

Type the node here

This node will be highlighted for a couple of seconds.

Page 22: Vision Based Scalable Workflow Development using Web Services

22

Using Vision

If the straight lines that are connecting nodes are too hard to see, then spline connections.

Click on Edit

Click on Spline Connections

QuickTime™ and a decompressor

are needed to see this picture.

Page 23: Vision Based Scalable Workflow Development using Web Services

23

Debugging Web Services

You can view the web service log in the Vision terminal. The log may contain helpful URLs.If you do not have a terminal open, then you need to click on the Python IDEL shell icon from ADT or PMV.

QuickTime™ and a decompressor

are needed to see this picture.

QuickTime™ and a decompressor

are needed to see this picture.

Page 24: Vision Based Scalable Workflow Development using Web Services

24

Hands On Exercises

Using PrepareReceptor from Adt lib

Running virtual screening workflow

Using VirtualScreening from Adt lib

Building PDB2PQR macro / library node

Building Autodock workflow

Builidng NAMD workflow

Page 25: Vision Based Scalable Workflow Development using Web Services

25

Exercise - Simple PrepareReceptor

QuickTime™ and a decompressor

are needed to see this picture.

Get File Browser from the Input column in Standard library.Browse a PDB file.

Get PrepareReceptor from Adt library.

Page 26: Vision Based Scalable Workflow Development using Web Services

26

Exercise - Run Entire Virtual Screening Workflow

QuickTime™ and a decompressor

are needed to see this picture.

Page 27: Vision Based Scalable Workflow Development using Web Services

27

Exercise - Play with VirtualScreening

QuickTime™ and a decompressor

are needed to see this picture.

Input - path to PDB file GPF template DPF template

URL to Autodock virtual screening results

ligand library name

Page 28: Vision Based Scalable Workflow Development using Web Services

28

Exercise - Building a Simple PDB2PQR Macro

Edit --> Create MacroUse PDB2PQR as macro name

Drag Pdb2pqrOpalService_ws_nbcr_net node to the macro.

QuickTime™ and a decompressor

are needed to see this picture. QuickTime™ and a decompressor

are needed to see this picture.

Page 29: Vision Based Scalable Workflow Development using Web Services

29

Exercise - Building a Simple PDB2PQR Macro

Double click on the PDB2PQR Web service node

Enter output.pqr as the output_file

Right click on inFile and then click on Unbind Wiget.

This will create an input port for the web service node.

QuickTime™ and a decompressor

are needed to see this picture.

Page 30: Vision Based Scalable Workflow Development using Web Services

30

Exercise - Building a Simple PDB2PQR Macro

3. Get the result URL

QuickTime™ and a decompressor

are needed to see this picture.

This will return a list of all URLs, including input PDB, output PQR, stdout.txt, etc.

Get the first URL in the list

Get URL of the directory that Contains all the output files.

Page 31: Vision Based Scalable Workflow Development using Web Services

31

Exercise - Building a Simple PDB2PQR Macro

4. Add an input file in the main network

QuickTime™ and a decompressor

are needed to see this picture.

Page 32: Vision Based Scalable Workflow Development using Web Services

32

Exercise - Building a Simple PDB2PQR Macro

Try the Web Browser Node

QuickTime™ and a decompressor

are needed to see this picture.macro

Open the URL in default web browser

Page 33: Vision Based Scalable Workflow Development using Web Services

33

Saving PDB2PQR Macro

QuickTime™ and a decompressor

are needed to see this picture.

Right Click

Page 34: Vision Based Scalable Workflow Development using Web Services

34

Saving the MacroIn MyDefaultLib

~/.mgltools/1.5.6/Vision/UserLibs/MyDefaultLib/Macro

In ADT Lib$mgl_install/1.5.6/MGLToolsPckgs/AutoDockTools/VisionInterface/Adt/Macro

QuickTime™ and a decompressor

are needed to see this picture.

Page 35: Vision Based Scalable Workflow Development using Web Services

35

Exercise: Building Autodock Workflow

QuickTime™ and a decompressor

are needed to see this picture.

Load http://mirume.nbcr.net/opal2 ws first.Mirume uses the CSF scheduler and will run Autodock on multiple hosts.

Input is a URL to the virtual screening files right before the Autodock step.http://kryptonite.nbcr.net/app1249000660642/

Page 36: Vision Based Scalable Workflow Development using Web Services

36

Building NAMD Workflow

QuickTime™ and a decompressor

are needed to see this picture.

namd command

All input files

Number of processors

Open stdout.txt inWeb browser

Mirume runs NAMD on teragrid

Page 37: Vision Based Scalable Workflow Development using Web Services

37

GetInputFiles Macro Node

QuickTime™ and a decompressor

are needed to see this picture.

Get absolute path

Get all inputs fromthis directory

Make this files a list

Page 38: Vision Based Scalable Workflow Development using Web Services

38

Useful Links

MGLTools Home pagehttp://mgltools.scripps.edu/

MGL Rocks roll documentationhttp://www.nbcr.net/software/doc/mgl-roll/rocks-5.0/

See sections 4.9 and 4.10 for virtual screening documenation

NBCR 09 Summer Institute wiki on virtual screening workflows

https://www.nbcr.net/pub/wiki/index.php?title=NBCR_Summer_Institute_2009

See section 1.7.4