HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web...
Transcript of HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web...
![Page 1: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/1.jpg)
![Page 2: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/2.jpg)
Research
Life Cycle
Acquire
Plan
Analyse
Access
Collaborate
Manage
Archive
Publish
Reuse
Data
HPC
Cloud
Virtual labs
Dataset transfer
Collaborative sites
Dataset transfer
Databases
Web-based file sharing
Collaborative sitesAutomated ingest
and management
RDM support
Technical advice
Costing
Grant assistance
Comprehend
Visualisation facilities
Institutional repository
![Page 3: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/3.jpg)
Emerging Researcher Series
Research Collaboration Research Collaboration
Thursday, 2 March 2017
Jason van Rooyen - eResearch Analyst
Heine de Jager – Senior Technical Specialist
![Page 4: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/4.jpg)
Research Collaboration
Tools, platforms and services which assist researchers
to collaborate more effectively locally, nationally or
internationally.
Collaboration
Research Collaboration
2 March2017
![Page 5: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/5.jpg)
Lee Lab:• Managing access permissions
• Who and how
• Internal vs. external collaborators
• Privacy and POPI act
• Small vs. large
• Tools
• Firewalls
• Bandwidth
• Costs
• Bandwidth
• Importance vs. other traffic
• Licence fees
//researchdata
Challenges of sharing data
Research Collaboration
2 March2017
![Page 6: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/6.jpg)
Collaboration Platforms & Tools
� Research Collaboration Tools:
� Communication tools:
• Web & Video Conferencing
• Blogging & Wiki’s
• Micro Blogging
• Mailing Lists
� Team Collaboration
� Project Management
� Data Transfers
� File Sharing
Research Collaboration
2 March2017
![Page 7: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/7.jpg)
Collaboration Sites, Platforms & ToolsCollaboration Sites, Platforms & Tools
Research Collaboration
2 March2017
![Page 8: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/8.jpg)
Communication Tools - Web & Video Conferencing
� Local (UCT) Platforms:
� Skype
� Adobe Connect
� Polycom
� National Platforms:
� Vidyo – Managed by Tenet
� MConf Web Conferencing – Managed by SANREN
� International Platforms:
� Google Hangouts
Research Collaboration
2 March2017
![Page 9: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/9.jpg)
Communication Tools - Blogging & Wiki’s
� Blogging & Wiki’s
� SharePoint
� Blogs@UCT - www.blogs.uct.ac.za.
� Office365
� Micro Blogging:
� Yammer -- https://www.yammer.com/uct.ac.za/
� Mailing lists:
� ICTS Mailing List System
Research Collaboration
2 March2017
![Page 10: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/10.jpg)
Team Collaboration & Project Management
� Team Collaboration:
� Microsoft OneNote
� Microsoft SharePoint (UCT site license)
� Slack -- www.slack.org
� RedMine -- http://www.redmine.org/projects/redmine/wiki
� Confluence (commercial)
Research Collaboration
2 March2017
![Page 11: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/11.jpg)
Team Collaboration & Project Management
� Project Management:
� Microsoft Project (UCT site license)
� RedMine -- http://www.redmine.org/projects/redmine/wiki
� Trello
Research Collaboration
2 March2017
� Team Collaboration:
� Microsoft 365
![Page 12: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/12.jpg)
Team Collaboration – Microsoft OneNote & Class Notebook
Research Collaboration
2 March2017
![Page 13: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/13.jpg)
Team Collaboration – Microsoft & Google Tools
Research Collaboration
2 March2017
![Page 14: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/14.jpg)
Team Collaboration – Microsoft SharePoint
Research Collaboration
2 March2017
![Page 15: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/15.jpg)
Team Collaboration – Microsoft SharePoint
Research Collaboration
2 March2017
![Page 16: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/16.jpg)
Team Collaboration – Microsoft SharePoint
Research Collaboration
2 March2017
![Page 17: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/17.jpg)
Team Collaboration – Microsoft SharePoint
Research Collaboration
2 March2017
![Page 18: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/18.jpg)
Team Collaboration – Microsoft SharePoint
Research Collaboration
2 March2017
![Page 19: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/19.jpg)
• Open Source - RedMine
Team Collaboration – RedMine
Research Collaboration
2 March2017
![Page 20: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/20.jpg)
Collaboration & Project Management - Trello
• Open Source - Trello
Research Collaboration
2 March2017
![Page 21: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/21.jpg)
Collaboration & Project Management - Slack
• Open Source - Slack
Research Collaboration
2 March2017
![Page 22: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/22.jpg)
Collaboration Platforms – A Use Case – Clinical Trials
• Clinical Trial Management using OpenClinica
• Data Management – UCT central research data store
• Document Management using Microsoft SharePoint� Calendar – site visits / patient visits / scheduling
� Audit Trails
� Document version tracking via check-in & check-out
� Co-authoring of documents
� Announcements
� Alerts & Notifications
� Team Discussions
� Team Task Lists
• Data Analysis using Stata
Research Collaboration
2 March2017
![Page 23: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/23.jpg)
The Connected WorldThe Connected World
Research Collaboration
2 March2017
![Page 24: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/24.jpg)
Dataset Transfers - Inter-continental Connectivity
� West Coast of Africa:
� SAT3
� ACE
� WACS **
� East Coast of Africa:
� Seacom **
� EASSy
** UCT connects to the rest of the
world via these undersea cables.
Research Collaboration
2 March2017
![Page 25: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/25.jpg)
Dataset Transfers - National Connectivity
� South African National
Research Network
(SANREN)
� We have 10 Gbps
connecting all
universities and other
tertiary institutions in
South Africa
� International
connectivity 1.2 Gbps
on the WACS cable
Research Collaboration
2 March2017
![Page 26: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/26.jpg)
Data TransferData Transfer
Research Collaboration
2 March2017
![Page 27: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/27.jpg)
Data Transfers
< 20MB file � Can Use Email
> 20Mb < 128GB � Use File Sender
Bigger than 128GB � Use Globus or (GridFTP)
Download – Send Link Upload – Send Voucher
Research Collaboration
2 March2017
![Page 28: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/28.jpg)
Dataset Transfer Tools – FileSender
• Send files to external
collaborators
• Send guest vouchers
• Not suitable for
multiple files unless
zipped
Research Collaboration
2 March2017
![Page 29: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/29.jpg)
Gathering Data
FileSender (Receiver)
Research Collaboration
2 March2017
![Page 30: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/30.jpg)
Gathering Data
FileSender (Voucher)
Research Collaboration
2 March2017
![Page 31: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/31.jpg)
Dataset Transfer Tools – Globus Online
• GridFTP Made Easy
• Software-as-a-service (SAAS)
• Free Option
• University of Chicago and
Argonne National Laboratory
Research Collaboration
2 March2017
![Page 32: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/32.jpg)
Dataset Transfer Tools – Globus Online
Research Collaboration
2 March2017
![Page 33: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/33.jpg)
Web-based File SharingWeb-based File Sharing
Research Collaboration
2 March2017
![Page 34: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/34.jpg)
Gathering DataResearch collaboration
Web-based File Sharing – NextCloud
2 March2017
![Page 35: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/35.jpg)
Gathering DataResearch collaboration
Web-based File Sharing – NextCloud
2 March2017
![Page 36: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/36.jpg)
Gathering Data
Code Sharing – GitHub
What is GitHub exactly:
� Code sharing and publishing
� Social networking for developers
� Based on Git (started by Linus Torvalds)
� Stores and Manages revisions of projects
� Access Control
� Wikis
� Even Websites
Research collaboration
2 March2017
![Page 37: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/37.jpg)
EndEnd
Research Collaboration
2 March2017
![Page 38: HPC Cloud Virtual labs Research Data · 2017. 3. 9. · Vidyo – Managed by Tenet MConf Web Conferencing –Managed by SANREN International Platforms: Google Hangouts Research Collaboration](https://reader033.fdocuments.in/reader033/viewer/2022052003/60164d0a0fbd2546e541c00e/html5/thumbnails/38.jpg)
Research Collaboration
Research Collaboration
Dataset Transfer
Can you help me transfer data from overseas?
Databases
Can you help us migrate our old database to a safer more current system?
Web-based File Sharing
Can you help me share data with my project team?
I need to send a large file to a colleague overseas. What’s the best way?
Collaborative Sites & Platforms
Do you offer any collaborative spaces for my team to work and to share data?
What if some members of the team are external to UCT?
2 March2017