HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological...
Transcript of HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological...
![Page 1: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/1.jpg)
Borries Demeler, Ph.D.
HPC Applications in Biophysics, Material Science and Biomedicine - enabled by UNICORE
The UltraScan XSEDE Science Gateway
![Page 2: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/2.jpg)
A Science Gateway for Biophysical Analysis
Task
Model data from hydrodynamic experiments to describe moleculesunder dynamic solution conditions
Challenges
Computationally expensive inverse problems, many users
Biophysical applications used
Analytical Ultracentrifugation (AUC)Molecular Dynamics (MD)Bead ModelingSmall angle X-ray and neutron scattering (SAXS/SANS)
![Page 3: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/3.jpg)
A Science Gateway for Biophysical Analysis
Task
Model data from hydrodynamic experiments to describe moleculesunder dynamic solution conditions
Challenges
Computationally expensive inverse problems, many users
Biophysical applications used
Analytical Ultracentrifugation (AUC)Molecular Dynamics (MD)Bead ModelingSmall angle X-ray and neutron scattering (SAXS/SANS)
![Page 4: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/4.jpg)
What is Analytical Ultracentrifugation (AUC)?
A technique to separate macromolecules dissolved in solution in a centrifugal force field. AUC can “watch” the molecules while they are separating and identify and differentiate them by their hydrodynamic properties and partial concentration. AUC is a “first Principle” method, which does NOT require standards.
How does AUC work?
By applying a very large centrifugal force, molecules are separated based on their molar mass and their shape. The molecules are observed using different optical systems that detect different properties of the molecules, such as refractive index, UV or visible absorbance, or fluorescent light emission.
What molecules can be studied?
Virtually any molecule, colloid or particle that can be dissolved in a liquid can be measured by AUC, as long as it does not sediment by gravity alone. The molecule or particle can be as small as a salt ion, or as large as an entire virus particle.
The ultracentrifuge can spin at 60,000 rpm, generating forces close to 300,000 x g. Even small molecules like salt ions will sediment in such a force.
AUC Background
![Page 5: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/5.jpg)
AUC Background
Molecules can be studied in a physiological environment
Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)
Dynamic processes can be studiedreversible self/hetero-association (ex.: oligomerization states)binding strengths (ex.: protein/protein, protein/DNA, drug binding)slow kineticsResponse to changes in pH, ionic strength, ligands, small molecules
Composition analysisFormulation properties, purity, aggregation, stoichiometryPartial concentration, molecular weight, shape
Conformational studiesprotein folding, denaturation, anisotropy studies
Mutational studiesfunctional studies, oligomerization, binding strength
First Principles approach!
![Page 6: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/6.jpg)
A Science Gateway for Biophysical Analysis
Multiple recordings over time...
![Page 7: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/7.jpg)
Ls , D: ∂C∂ t r =
− 1r
∂∂ r [ s 2 r2C − D r
∂C∂ r ] t
MIN : ∑i=1, j=1
r , t
[Y i , j−∑k=1
n
Lk sk , Dki , j ]2
The experiment is described by the Lamm equation, which is solved with FEMCao W and Demeler B. Modeling analytical ultracentrifugation experiments with an adaptive space-time finite element solution of the Lamm equation. (2005) Biophys J. 89(3):1589-602.Cao, W and Demeler B. Modeling Analytical Ultracentrifugation Experiments with an Adaptive Space-Time Finite Element Solution for Multi-Component Reacting Systems. Biophys. J. (2008) 95(1):54-65
![Page 8: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/8.jpg)
Sedimentation Velocity
Sedimentation velocity profile of a mixture of
macromolecules over time
![Page 9: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/9.jpg)
Sedimentation Velocity
How many components?
Composition Analysis
We can answer these questions:
![Page 10: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/10.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
Composition Analysis
We can answer these questions:
![Page 11: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/11.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
What are their shapes?
Composition Analysis
We can answer these questions:
![Page 12: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/12.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
What are their shapes?
What is the partial concentration of each component?
Composition Analysis
We can answer these questions:
![Page 13: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/13.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
What are their shapes?
What is the partial concentration of each component?
Do the components interact (how fast, strong)?
Composition Analysis
We can answer these questions:
![Page 14: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/14.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
What are their shapes?
What is the partial concentration of each component?
Do the components interact (how fast, strong)?
What is the reliability of our measurement?
Composition Analysis
We can answer these questions:
![Page 15: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/15.jpg)
Find: partial concentration,s, D, MW, Kd, k
off and f/f
0
Optimization:
2D-Spectrum AnalysisGenetic Algorithms
Monte Carlo Analysis
![Page 16: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/16.jpg)
We needed an HPC interface for UltraScan to support analysis of AUC experiments on molecules in the solution environment
Goals:
Provide highest possible resolution in the analysis – requires HPC
Offer a flexible approach for multiple optimization methods
Integrate a variety of HPC environments into a uniform submission framework
Must be easy to learn and use – users should not have to be HPC experts
Support a large number of users and analysis instances simultaneously
Support data sharing and collaborations
Easy installation, easy maintenance
Robust and secure multi-user/multi-role framework
Provide check-pointing and easy to understand error messages
Support for multiple grid middleware (UNICORE, GRAM5)
Fast turnaround to support serial workflows (model refinement)
A Science Gateway for Biophysical Analysis
![Page 17: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/17.jpg)
6/24/14
XSEDE
Science Gateways
Apache Airavata
UNICOREGRAM5
![Page 18: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/18.jpg)
![Page 19: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/19.jpg)
Today, there are over 30 gateways using XSEDE
![Page 20: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/20.jpg)
What Is Apache Airavata?
• Science Gateway software system to– Compose, manage, execute, and
monitor distributed, computational workflows
– Wrap legacy command line scientific applications with Web services.
– Abstract job submission and provide uniform API for all resources
– Run jobs on computational resources ranging from local resources to computational grids and clouds
• Airavata software is largely derived from NSF-funded academic research.
![Page 21: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/21.jpg)
Jülich Contributions to Airavata
Apache AiravataApache Airavata
Java CoGAbstraction
JSDL / BES Adaptor
JClouds API, Whirr API
UltraScan Gateway
Amazon EC2,
Hadoop Systems
EC2, SSH, HDFS
XSEDEGlobus
Unicore
Contributed by Shahbaz Memon, JSC
JUROPAUnicore
![Page 22: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/22.jpg)
UltraScan Organization (open source, multi-platform)
UTHSCSA JacintoTerascale storage
Web Server
US LIMS
MySQL DB
User
High Performance Computing Clusters
XSEDE, etc
Globus NetworkUNICORE
Airavata
![Page 23: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/23.jpg)
A Science Gateway for Biophysical Analysis
UltraScan (US) components and 3rd party software:
US-GUI: (Linux, Mac, Windows): used for data processing, editing, uploading, visualization, report generation (C++/Qt).
US-LIMS: web-based interface to the MySQL database. Gives the user web-based access to their data, visualizations and analysis reports (PHP).
US-HPC: includes finite element solver for multiple models and performs all optimization algorithms (2DSA, GA, Monte Carlo)
US-Gridcontrol: PHP daemon to manage job submission, communications and reporting from US-HPC,
MySQL: houses all LIMS data, a separate Airavata DB holds job status info. Each institution has a separate database and separate US-LIMS instance. All interactions with MySQL are performed through stored procedure calls.
Airavata: accepts job requests and brokers them over the appropriate grid middleware to the requested supercomputer, controls job status in Airavata DB.
GRAM/UNICORE grid middleware
SSL communications: All communications and data transfers are SSL encrypted. All database access and LIMS access requires authentication.
Statistic scripts: queries database and reports usage and provides details for XSEDE reporting.
![Page 24: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/24.jpg)
UltraScan LIMS3/GFAC Workflow Overview(GFAC = Generic Factory Component of Apache Airavata)
User
LIMS-3
Instance 1Instance 2
...Instance n
AiravataGFAC
(gw33-Indiana)
Cluster 1Resource
Cluster 2Resource
MysqlLIMS3 DB
Cluster mResource
Apache
MysqlGFAC DB
gridctrl.php
listen.php
LIMS-3QueueViewer UDP
CRON
sendmail
HTTP
Local disk
GRAM5/UNICORE
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
UltraScan GUI
![Page 25: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/25.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 1: User logs into LIMS and requests their data, sets analysis parameters, job isretrieved from DB and packaged for submission, job request gets stored in GFAC DB)
User
LIMS-3
Instance 1Instance 2
...Instance n
MysqlLIMS3 DB
Apache
MysqlGFAC DB
Local disk
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
![Page 26: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/26.jpg)
3. Selecting Gateway Instance
![Page 27: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/27.jpg)
4. Authentication...
![Page 28: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/28.jpg)
5. Data Selection
![Page 29: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/29.jpg)
6. Analysis Method Selection
![Page 30: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/30.jpg)
7. Analysis Method Parameter Selection
![Page 31: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/31.jpg)
9. Cluster Resource Selection
![Page 32: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/32.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 2: LIMS packages data and job parameter on the local storage and
sends notification of pending job to GFAC)
LIMS-3
Instance 1Instance 2
...Instance n
AiravataGFAC
(gw33-Indiana)
Local disk
HTTP
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
![Page 33: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/33.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 3: GFAC grabs data from GFAC DB, and queues the job on the requested resource)
MysqlGFAC DB
AiravataGFAC
(gw33-Indiana)
Cluster 1Resource
Cluster 2Resource
Cluster mResource
GRAM/UNICORE
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
![Page 34: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/34.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 4: US-HPC sends job status over UDP to a daemon which updates GFAC DB)
Cluster 1Resource
Cluster 2Resource
Cluster mResource
MysqlGFAC DB
listen.phpUDP
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
![Page 35: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/35.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 5: cron triggers gridcontrol script periodically to check each job status
in the GFAC DB, updates the Queue Viewer. User checks queue viewer through LIMS)
User
LIMS-3
Instance 1Instance 2
...Instance n
Apache
MysqlGFAC DB
gridctrl.php
LIMS-3QueueViewer CRON
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
![Page 36: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/36.jpg)
10. Queue Monitor
![Page 37: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/37.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 6: cron triggers gridcontrol to check job list on GFAC DB for completed jobs, moves
results to LIMS DB, copies stderr/out results to local disk, deletes completed jobs from GFAC DB, updates queue viewer and sends user
an email with final job completion status)
LIMS-3
Instance 1Instance 2
...Instance n
MysqlLIMS3 DB
MysqlGFAC DB
gridctrl.php
CRON
Local disk
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
LIMS-3QueueViewer
User
sendmail
![Page 38: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/38.jpg)
UltraScan LIMS3/GFAC Workflow Overview(User only interacts with web service or uses US-GUI to visualize final results)
User
LIMS-3
Instance 1Instance 2
...Instance n
AiravataGFAC
(gw33-Indiana)
Cluster 1Resource
Cluster 2Resource
MysqlLIMS3 DB
Cluster mResource
Apache
MysqlGFAC DB
gridctrl.php
listen.php
LIMS-3QueueViewer UDP
CRON
sendmail
HTTP
Local disk
GRAM/UNICORE
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
UltraScan GUI
![Page 39: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/39.jpg)
11. Result Visualization
![Page 40: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/40.jpg)
12. Result Metadata analysis
![Page 41: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/41.jpg)
A Science Gateway for Biophysical Analysis
Usage statistics (in SUs) for the UltraScan Gateway Jan-Dec 2013
There are over 70 institutions in 18 countries actively using UltraScan/LIMSImplemented currently on 7 HPC platforms, including one commercial installation (non-public). In 2013 over 1.5 Million service units provided by XSEDE, Jülich and UTHSCSA.
Ongoing Projects:
Integration of SAXS/SANS modelingIntegration of Molecular Dynamics (DMD)Integration of SDSC Gordon Supercomputer with GRAM5 and UNICOREIntegration of Multi-wavelength optics (500-1000 fold higher data density)Development of Performance Prediction algorithms through dataminingDevelopment of a meta scheduler for mass submissions (of MW data)
![Page 42: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/42.jpg)
Amyloid-β Aggregation studied by Sedimentation Velocity Analytical Ultracentrifugation
L. Nagel-Steger at the Dept. of Physical Biology, Heinrich-Heine-University Düsseldorf & ICS-6, RC-Jülich, Germany
“Our application for high resolution data analysis
with USIII is theinvestigation of amyloid
formation by disease associated proteins.
The existence ofdifferently sized and
shaped species in such protein solutions
provides the primary motivation to use high-resolution AUC analysis which delivers individual
shape parameters in addition to s-values and
partial concentrations for all species.”
![Page 43: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/43.jpg)
Sedimentation analysis of single-walled carbon nanotube composition with a multi-wavelength AUC detector.
Walter, J. and W. Peukert, Dept. of Feststoff- und Grenzflächenverfahrenstechnik,Friedrich-Alexander-Universität Erlangen-Nürnberg.
1. Analysis of quantum dots
We want to study the size dependent optical properties by means of multi-wavelength AUC analysis. Hydrodynamic analysis will be complemented by simultaneous spectral analysis. We are also interested in the effect of surface modifications using different surfactants. AUC allows us to study surface properties and stabilizer interactions of particles in the lower nanoscale.
2. Analysis of carbon nanotubesThe evaluation of carbon nanotubes using AUC allows us to distinguish between different species of tubes in even complex mixtures exploiting their unique optical and hydrodynamic properties.
![Page 44: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/44.jpg)
Synthesis and Characterization of DNA-Metal Hybrid Materials
Urban, M. and H. Cölfen, Dept. of Chemistry and biofunctional Materials University of Konstanz
Development of new plasmonic devices.
We want to develop DNA-Metal hybrid materials by linking two gold nanoparticles by DNA single- and double-stranded oligomers. The number of bases in the oligomer allows us to precisely control the distances between the metal cores to optimize plasmon resonance and fluorescence properties.
AUC provides the necessary size and shape characteri-zation of DNA-Metal hybrid particles to allow us to bulk-characterize mixtures of nanoparticles and their assemblies with DNA.
![Page 45: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/45.jpg)
UltraScan-III: SciGaP Project: http://www.ultrascan.uthscsa.edu http://www.scigap.orgXSEDE Science Gateway: Airavata Project: https://portal.xsede.org/science-gateways http://airavata.apache.org/
A copy of this presentation:http://www.demeler.uthscsa.edu/unicore-2014.pdf
Links:
![Page 46: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/46.jpg)
Acknowledgements:
Demeler Lab:
Emre BrookesVirgil Schirf
Funding:
NIH/NCRRSACI (NCI)National Science FoundationNSF Teragrid (XSEDE)San Antonio Life Science InstituteHoward Hughes Medical InstituteUT Permanent University Fund
Gary GorbetDan Zollars
Shabhaz Memon Norbert AttigMorris Riedel Florian Janetzko
Indiana UniversityMarlon PierceSuresh MarruRaminder Singh
Jülich SupercomputingCenter, Germany
Thanks to the UNICORE Summit Organizers!
![Page 47: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/47.jpg)
Borries Demeler, Ph.D.
HPC Applications in Biophysics, Material Science and Biomedicine - enabled by UNICORE
The UltraScan XSEDE Science Gateway
![Page 48: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/48.jpg)
A Science Gateway for Biophysical Analysis
Task
Model data from hydrodynamic experiments to describe moleculesunder dynamic solution conditions
Challenges
Computationally expensive inverse problems, many users
Biophysical applications used
Analytical Ultracentrifugation (AUC)Molecular Dynamics (MD)Bead ModelingSmall angle X-ray and neutron scattering (SAXS/SANS)
![Page 49: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/49.jpg)
A Science Gateway for Biophysical Analysis
Task
Model data from hydrodynamic experiments to describe moleculesunder dynamic solution conditions
Challenges
Computationally expensive inverse problems, many users
Biophysical applications used
Analytical Ultracentrifugation (AUC)Molecular Dynamics (MD)Bead ModelingSmall angle X-ray and neutron scattering (SAXS/SANS)
![Page 50: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/50.jpg)
What is Analytical Ultracentrifugation (AUC)?
A technique to separate macromolecules dissolved in solution in a centrifugal force field. AUC can “watch” the molecules while they are separating and identify and differentiate them by their hydrodynamic properties and partial concentration. AUC is a “first Principle” method, which does NOT require standards.
How does AUC work?
By applying a very large centrifugal force, molecules are separated based on their molar mass and their shape. The molecules are observed using different optical systems that detect different properties of the molecules, such as refractive index, UV or visible absorbance, or fluorescent light emission.
What molecules can be studied?
Virtually any molecule, colloid or particle that can be dissolved in a liquid can be measured by AUC, as long as it does not sediment by gravity alone. The molecule or particle can be as small as a salt ion, or as large as an entire virus particle.
The ultracentrifuge can spin at 60,000 rpm, generating forces close to 300,000 x g. Even small molecules like salt ions will sediment in such a force.
AUC Background
![Page 51: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/51.jpg)
AUC Background
Molecules can be studied in a physiological environment
Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)
Dynamic processes can be studiedreversible self/hetero-association (ex.: oligomerization states)binding strengths (ex.: protein/protein, protein/DNA, drug binding)slow kineticsResponse to changes in pH, ionic strength, ligands, small molecules
Composition analysisFormulation properties, purity, aggregation, stoichiometryPartial concentration, molecular weight, shape
Conformational studiesprotein folding, denaturation, anisotropy studies
Mutational studiesfunctional studies, oligomerization, binding strength
First Principles approach!
![Page 52: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/52.jpg)
A Science Gateway for Biophysical Analysis
Multiple recordings over time...
![Page 53: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/53.jpg)
Ls , D : ∂C∂ t r =
− 1r
∂∂ r [ s 2r2C − D r
∂C∂ r ] t
MIN : ∑i=1, j=1
r , t
[Y i , j−∑k=1
n
Lk sk , Dki , j ]2
The experiment is described by the Lamm equation, which is solved with FEMCao W and Demeler B. Modeling analytical ultracentrifugation experiments with an adaptive space-time finite element solution of the Lamm equation. (2005) Biophys J. 89(3):1589-602.Cao, W and Demeler B. Modeling Analytical Ultracentrifugation Experiments with an Adaptive Space-Time Finite Element Solution for Multi-Component Reacting Systems. Biophys. J. (2008) 95(1):54-65
![Page 54: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/54.jpg)
Sedimentation Velocity
Sedimentation velocity profile of a mixture of
macromolecules over time
![Page 55: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/55.jpg)
Sedimentation Velocity
How many components?
Composition Analysis
We can answer these questions:
![Page 56: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/56.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
Composition Analysis
We can answer these questions:
![Page 57: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/57.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
What are their shapes?
Composition Analysis
We can answer these questions:
![Page 58: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/58.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
What are their shapes?
What is the partial concentration of each component?
Composition Analysis
We can answer these questions:
![Page 59: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/59.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
What are their shapes?
What is the partial concentration of each component?
Do the components interact (how fast, strong)?
Composition Analysis
We can answer these questions:
![Page 60: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/60.jpg)
Sedimentation Velocity
How many components?
What are their molecular weights?
What are their shapes?
What is the partial concentration of each component?
Do the components interact (how fast, strong)?
What is the reliability of our measurement?
Composition Analysis
We can answer these questions:
![Page 61: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/61.jpg)
Find: partial concentration,s, D, MW, Kd, k
off and f/f
0
Optimization:
2D-Spectrum AnalysisGenetic Algorithms
Monte Carlo Analysis
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 62: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/62.jpg)
We needed an HPC interface for UltraScan to support analysis of AUC experiments on molecules in the solution environment
Goals:
Provide highest possible resolution in the analysis – requires HPC
Offer a flexible approach for multiple optimization methods
Integrate a variety of HPC environments into a uniform submission framework
Must be easy to learn and use – users should not have to be HPC experts
Support a large number of users and analysis instances simultaneously
Support data sharing and collaborations
Easy installation, easy maintenance
Robust and secure multi-user/multi-role framework
Provide check-pointing and easy to understand error messages
Support for multiple grid middleware (UNICORE, GRAM5)
Fast turnaround to support serial workflows (model refinement)
A Science Gateway for Biophysical Analysis
![Page 63: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/63.jpg)
6/24/14
XSEDE
Science Gateways
Apache Airavata
UNICOREGRAM5
17
![Page 64: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/64.jpg)
![Page 65: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/65.jpg)
Today, there are over 30 gateways using XSEDE
![Page 66: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/66.jpg)
What Is Apache Airavata?
• Science Gateway software system to– Compose, manage, execute, and
monitor distributed, computational workflows
– Wrap legacy command line scientific applications with Web services.
– Abstract job submission and provide uniform API for all resources
– Run jobs on computational resources ranging from local resources to computational grids and clouds
• Airavata software is largely derived from NSF-funded academic research.
![Page 67: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/67.jpg)
Jülich Contributions to Airavata
Apache AiravataApache Airavata
Java CoGAbstraction
JSDL / BES Adaptor
JClouds API, Whirr API
UltraScan Gateway
Amazon EC2,
Hadoop Systems
EC2, SSH, HDFS
XSEDEGlobus
Unicore
Contributed by Shahbaz Memon, JSC
JUROPAUnicore
![Page 68: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/68.jpg)
UltraScan Organization (open source, multi-platform)
UTHSCSA JacintoTerascale storage
Web Server
US LIMS
MySQL DB
User
High Performance Computing Clusters
XSEDE, etc
Globus NetworkUNICORE
Airavata
![Page 69: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/69.jpg)
A Science Gateway for Biophysical Analysis
UltraScan (US) components and 3rd party software:
US-GUI: (Linux, Mac, Windows): used for data processing, editing, uploading, visualization, report generation (C++/Qt).
US-LIMS: web-based interface to the MySQL database. Gives the user web-based access to their data, visualizations and analysis reports (PHP).
US-HPC: includes finite element solver for multiple models and performs all optimization algorithms (2DSA, GA, Monte Carlo)
US-Gridcontrol: PHP daemon to manage job submission, communications and reporting from US-HPC,
MySQL: houses all LIMS data, a separate Airavata DB holds job status info. Each institution has a separate database and separate US-LIMS instance. All interactions with MySQL are performed through stored procedure calls.
Airavata: accepts job requests and brokers them over the appropriate grid middleware to the requested supercomputer, controls job status in Airavata DB.
GRAM/UNICORE grid middleware
SSL communications: All communications and data transfers are SSL encrypted. All database access and LIMS access requires authentication.
Statistic scripts: queries database and reports usage and provides details for XSEDE reporting.
![Page 70: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/70.jpg)
UltraScan LIMS3/GFAC Workflow Overview(GFAC = Generic Factory Component of Apache Airavata)
User
LIMS-3
Instance 1Instance 2
...Instance n
AiravataGFAC
(gw33-Indiana)
Cluster 1Resource
Cluster 2Resource
MysqlLIMS3 DB
Cluster mResource
Apache
MysqlGFAC DB
gridctrl.php
listen.php
LIMS-3QueueViewer UDP
CRON
sendmail
HTTP
Local disk
GRAM5/UNICORE
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
UltraScan GUI
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 71: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/71.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 1: User logs into LIMS and requests their data, sets analysis parameters, job is
retrieved from DB and packaged for submission, job request gets stored in GFAC DB)
User
LIMS-3
Instance 1Instance 2
...Instance n
MysqlLIMS3 DB
Apache
MysqlGFAC DB
Local disk
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 72: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/72.jpg)
3. Selecting Gateway Instance
![Page 73: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/73.jpg)
4. Authentication...
![Page 74: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/74.jpg)
5. Data Selection
![Page 75: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/75.jpg)
6. Analysis Method Selection
![Page 76: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/76.jpg)
7. Analysis Method Parameter Selection
![Page 77: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/77.jpg)
9. Cluster Resource Selection
![Page 78: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/78.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 2: LIMS packages data and job parameter on the local storage and
sends notification of pending job to GFAC)
LIMS-3
Instance 1Instance 2
...Instance n
AiravataGFAC
(gw33-Indiana)
Local disk
HTTP
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 79: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/79.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 3: GFAC grabs data from GFAC DB, and queues the job on the requested resource)
MysqlGFAC DB
AiravataGFAC
(gw33-Indiana)
Cluster 1Resource
Cluster 2Resource
Cluster mResource
GRAM/UNICORE
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 80: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/80.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 4: US-HPC sends job status over UDP to a daemon which updates GFAC DB)
Cluster 1Resource
Cluster 2Resource
Cluster mResource
MysqlGFAC DB
listen.phpUDP
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 81: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/81.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 5: cron triggers gridcontrol script periodically to check each job status
in the GFAC DB, updates the Queue Viewer. User checks queue viewer through LIMS)
User
LIMS-3
Instance 1Instance 2
...Instance n
Apache
MysqlGFAC DB
gridctrl.php
LIMS-3QueueViewer CRON
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 82: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/82.jpg)
10. Queue Monitor
![Page 83: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/83.jpg)
UltraScan LIMS3/GFAC Workflow Overview(Step 6: cron triggers gridcontrol to check job list on GFAC DB for completed jobs, moves
results to LIMS DB, copies stderr/out results to local disk, deletes completed jobs from GFAC DB, updates queue viewer and sends user
an email with final job completion status)
LIMS-3
Instance 1Instance 2
...Instance n
MysqlLIMS3 DB
MysqlGFAC DB
gridctrl.php
CRON
Local disk
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
LIMS-3QueueViewer
User
sendmail
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 84: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/84.jpg)
UltraScan LIMS3/GFAC Workflow Overview(User only interacts with web service or uses US-GUI to visualize final results)
User
LIMS-3
Instance 1Instance 2
...Instance n
AiravataGFAC
(gw33-Indiana)
Cluster 1Resource
Cluster 2Resource
MysqlLIMS3 DB
Cluster mResource
Apache
MysqlGFAC DB
gridctrl.php
listen.php
LIMS-3QueueViewer UDP
CRON
sendmail
HTTP
Local disk
GRAM/UNICORE
Color legend: - UTHSCSA- Indiana University- remote user- HPC resources
UltraScan GUI
We can represent the sedimentation problem as a 2-dimensional parameter space (s and f/f0, or s and MW, or MW and f/f0, or s and D, or D and MW, or D and f/f0, etc.). Each one of these representations is valid and provides the en-tire information necessary to describe completely the solution properties of indi-vidual solutes. The problem is then to identify the solutes (blue dots in the plane), and their relative concentration that when combined make up the exper-imental data shown as a blue concentration traces for differen time and radius values.
![Page 85: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/85.jpg)
11. Result Visualization
![Page 86: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/86.jpg)
12. Result Metadata analysis
![Page 87: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/87.jpg)
A Science Gateway for Biophysical Analysis
Usage statistics (in SUs) for the UltraScan Gateway Jan-Dec 2013
There are over 70 institutions in 18 countries actively using UltraScan/LIMSImplemented currently on 7 HPC platforms, including one commercial installation (non-public). In 2013 over 1.5 Million service units provided by XSEDE, Jülich and UTHSCSA.
Ongoing Projects:
Integration of SAXS/SANS modelingIntegration of Molecular Dynamics (DMD)Integration of SDSC Gordon Supercomputer with GRAM5 and UNICOREIntegration of Multi-wavelength optics (500-1000 fold higher data density)Development of Performance Prediction algorithms through dataminingDevelopment of a meta scheduler for mass submissions (of MW data)
![Page 88: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/88.jpg)
Amyloid-β Aggregation studied by Sedimentation Velocity Analytical Ultracentrifugation
L. Nagel-Steger at the Dept. of Physical Biology, Heinrich-Heine-University Düsseldorf & ICS-6, RC-Jülich, Germany
“Our application for high resolution data analysis
with USIII is theinvestigation of amyloid
formation by disease associated proteins.
The existence ofdifferently sized and
shaped species in such protein solutions
provides the primary motivation to use high-resolution AUC analysis which delivers individual
shape parameters in addition to s-values and
partial concentrations for all species.”
![Page 89: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/89.jpg)
Sedimentation analysis of single-walled carbon nanotube composition with a multi-wavelength AUC detector.
Walter, J. and W. Peukert, Dept. of Feststoff- und Grenzflächenverfahrenstechnik,Friedrich-Alexander-Universität Erlangen-Nürnberg.
1. Analysis of quantum dots
We want to study the size dependent optical properties by means of multi-wavelength AUC analysis. Hydrodynamic analysis will be complemented by simultaneous spectral analysis. We are also interested in the effect of surface modifications using different surfactants. AUC allows us to study surface properties and stabilizer interactions of particles in the lower nanoscale.
2. Analysis of carbon nanotubesThe evaluation of carbon nanotubes using AUC allows us to distinguish between different species of tubes in even complex mixtures exploiting their unique optical and hydrodynamic properties.
![Page 90: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/90.jpg)
Synthesis and Characterization of DNA-Metal Hybrid Materials
Urban, M. and H. Cölfen, Dept. of Chemistry and biofunctional Materials University of Konstanz
Development of new plasmonic devices.
We want to develop DNA-Metal hybrid materials by linking two gold nanoparticles by DNA single- and double-stranded oligomers. The number of bases in the oligomer allows us to precisely control the distances between the metal cores to optimize plasmon resonance and fluorescence properties.
AUC provides the necessary size and shape characteri-zation of DNA-Metal hybrid particles to allow us to bulk-characterize mixtures of nanoparticles and their assemblies with DNA.
![Page 91: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/91.jpg)
UltraScan-III: SciGaP Project: http://www.ultrascan.uthscsa.edu http://www.scigap.orgXSEDE Science Gateway: Airavata Project: https://portal.xsede.org/science-gateways http://airavata.apache.org/
A copy of this presentation:http://www.demeler.uthscsa.edu/unicore-2014.pdf
Links:
![Page 92: HPC Applications in Biophysics, Material Science and ...Molecules can be studied in a physiological environment Very large size range (102 – 108 Dalton, complements cryo-EM and NMR)](https://reader035.fdocuments.in/reader035/viewer/2022070817/5f1109c7d5ebe43a0d11f48b/html5/thumbnails/92.jpg)
Acknowledgements:
Demeler Lab:
Emre BrookesVirgil Schirf
Funding:
NIH/NCRRSACI (NCI)National Science FoundationNSF Teragrid (XSEDE)San Antonio Life Science InstituteHoward Hughes Medical InstituteUT Permanent University Fund
Gary GorbetDan Zollars
Shabhaz Memon Norbert AttigMorris Riedel Florian Janetzko
Indiana UniversityMarlon PierceSuresh MarruRaminder Singh
Jülich SupercomputingCenter, Germany
Thanks to the UNICORE Summit Organizers!