The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did...

18
The OpenTopography Community Dataspace allows users who are producing small to moderate sized topographic datasets to: Archive their data with OpenTopography Establish proper dataset cita>on Enable dataset sharing and reuse Provide educa>onal applica>ons Community Dataspace Tutorial

Transcript of The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did...

Page 1: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

The OpenTopography Community Dataspace allows users who are producing small tomoderatesizedtopographicdatasetsto:•  ArchivetheirdatawithOpenTopography•  Establishproperdatasetcita>on•  Enabledatasetsharingandreuse•  Provideeduca>onalapplica>ons

CommunityDataspaceTutorial

Page 2: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

IfyoudonothaveaCommunityDataspaceaccount,youcanapplyforone:•  GotoDataà“ContributedData”.Fromthatpagetherewillbealinktoclickinorderto

applytobecomeadatacontributor.

CommunityDataspaceTutorial

Page 3: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

UserswillbedirectedtotheirMyOpenTopoAuthoriza>onspage:

CommunityDataspaceTutorial

ScrolldowntotheboLomtorequestpermissiontosubmitdatatotheCommunityDataspace:

Page 4: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Oncetheaccountissetup,logintoyourOpenTopographyaccount:•  Clickonthe“ContributeDataset”buLontostarttheprocess.

CommunityDataspaceTutorial

Page 5: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step1:•  Giveyourdatasetaname.This,tlewillbeusedinyourdatacita,on,somakeitunique

anddescrip>ve.It’sbesttofollowatemplateof“MeasuredFeature,Loca/on,Date”Forexample:“SurveyofOzaukeeSouthBeachBluff,Wisconsin,May2018”

•  Choosethecollec>onplaPormthatwasusedtocollectyourdataset.•  ChecktheappropriateboxifyoudatasetcontainsPointClouds,Rasters,orboth.•  Select“Next”whendone.

CommunityDataspaceTutorial

Page 6: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step2:•  Foreachfiletype,uploadtheappropriatefiles.

•  Point Clouds:we currently only accept LAS orLAZformats.LAZformatsarepreferredastheyreduce file size dras>cally, and will reduceupload >mes. If the data is georeferenced,pleasemakesure that thecoordinate systeminfoisincludedintheheader.

•  Rasters: we currently only accept IMG or TIFfiles.Ifthedataisgeoreferenced,pleasemakesure that the coordinate system info isincludedintheheader.

•  Metadata:ThemetadatadocumentmustbeinPDF format. Users are free to use whateverformat they wish, but it is preferrable if theOpenTopography template is used. Thetemplateisavailableonthedatauploadpages.

CommunityDataspaceTutorial

Page 7: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

CommunityDataspaceTutorial

Notes:•  Click on the “Notes” link for guidance on upload

requirements.•  Users can upload mul>ple files through the “Choose

Files”buLon,orbydragginganddroppingfiles.•  Althoughthereisa10GBlimitonasinglesubmission,ifa

projectislargerthan10GB,itshouldbebrokenintopartsandsubmiLedwithpartnumbersdesignatedclearly.

Page 8: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step2(con,nued):•  Addthefilesbyusingthe“ChooseFiles”buLonorbysimplydraggingthefilesintothedesignatedareaofthewindow.•  Whenallfileshavebeenadded,selectthegreen,“StartUpload”buLontobegintheuploadprocess.•  Thereisa“StartUpload”buLonforeachcategoryoffile,sobesuretoperformthisopera>onforeachofthesec>onsyou

added.•  Notethatifyouhavenotuploadedsuccessfully,therewillbeasmall“x”nexttothefilesize.

CommunityDataspaceTutorial

Page 9: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step2(con,nued):•  Onceyou select the “StartUpload”buLon, youwill see theprogressbaraseachfile isuploaded to theSanDiegoSuper

Compu>ng(SDSC)server.•  Whenallthefileshavecompletedtheuploadprocess,selectthe“Next”buLonattheboLomofthepage.

CommunityDataspaceTutorial

Page 10: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step3:•  Thisstepvalidatestheinputdata.Theamountof>methisrequireswilldependonthesize,andamountfilesuploaded.•  Theprogressofthevalida>onisdisplayedonthewebsiteasseenbelow.

CommunityDataspaceTutorial

Page 11: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step4:•  Ifthevalida>oncompletessuccessfully,a

pagewillloadthatshowsamapwiththetotal spa>al coverage of all the datasetsinred.

•  Therewillalsobeaseriesoftextboxestoadd addi>onal informa>on about thedatasets.

•  Required fields are marked with a redasterisk.

•  If the map does not show the footprintloca>ons, it could mean that either thedata did not have proper coordinatesystem informa>on, or it was notrecognized on ingest. If you know theEPSGcodeofthedata,youcanenterthiscodeintheboxbelowthemaptoupdatethecoordinatereferencesystem.

CommunityDataspaceTutorial

Page 12: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step4(Con,nued):•  Clickingonthe“ShowDataFiles”barwillshowalistofthefilesthatwereingestedandsomebasic

sta>s>csoneachfile.•  Clickingonthe“ViewDetail”buLonwilldisplayaddi>onalmetadataforeachfile.

CommunityDataspaceTutorial

Page 13: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step4(Con,nued):•  Clickingonthemappiniconontherighthandsideofeachfilelis>ngwillupdatethemaptoshowthe

spa>alextentofthatfilecoloredingreen.•  Clickingonthegarbagecaniconwilldeleteafilefromthecollec>on.

CommunityDataspaceTutorial

Page 14: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step4(Con,nued):•  Itisbestprac,cetoprovideasmuchinforma,onaboutthedatasetaspossible,somakeanefforttofill

inallapplicablefields.•  Project Roles and Contributors can be added to help provide contact informa>on. A_er adding a

contributor, a green check mark will display to show that the user or organiza>on has been addedsuccessfully.

CommunityDataspaceTutorial

Page 15: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

Step4(Con,nued)FinalSubmission:•  Usethe“SaveProgress”buLontosavework,butdelaysubmi`ngthedatasetforanother>me.•  Whenall thedataentry iscompleted,andthedataset is readyforfinalsubmission,select the“Submit

Dataset”buLon. ThepagewillrefreshanddisplayabanneratthetopthatstatesthatthedatasethasbeensuccessfullysubmiLedandispendingOpenTopographyapproval.

•  Youaredone!OnceanOpenTopographyteammemberreviewsthesubmission,anemailwillbesenttoyouraccountwithalinktoverifythedatasubmissionanddisplaythedatahomepage.

CommunityDataspaceTutorial

Page 16: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

TipsandTroubleshoo,ng:•  UseLAZfileswhenpossible.Thecompressiondras>callyreducesfilesizes,andwillspeedupthewholeprocess.•  Whenappropriate,verifythatfileshavecoordinatesysteminforma>onintheheader.•  Ifuploadsaretakingalong>me,orhavestalled,theprocessmayhaves>llcompleted. Userscancheckthestatusofthe

upload by going to MyOpenTopoà Contributeà “View and manage my community Dataspace datasets” (see imagebelow). Select theeditbuLonnext to theprojectof interest,andverify thatall thefilesareuploadedandhavecorrectsta>s>cs.

CommunityDataspaceTutorial

Page 17: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

TipsandTroubleshoo,ng(con,nued):

•  WhenworkingwithTLSdata,some>meserrorscanoccurintheuploadbecausethedistribu>onofpointsbetweenthefilesisveryuneven–e.g.filescontainingpointsnearthescan-centerwillhaveMUCHlargerpointcountsthanfilescontainingpoints far fromthescanner. This largediscrepancy infile sizescancauseerrorswhenuploading to theDataspace. Theeasiestsolu>onrightnowistosplitthedatausinglassplitfromtheLAStoolspackage(hLps://rapidlasso.com/lastools/).Thefollowingcommandcanbeused:

lassplit-v–iinput.laz–ooutput_/le.laz-digits2-split25000000Thissplitsthethelazfileintofileswith25,000,000pointsineachfile. The"digits"keywordisjusttellingtheso_waretoincrementthefilenamesby2digits,sooutputfilenameswillbeintheform:output_>le00.laz,output_>le01.laz,etc.

•  Notethatifthereiss>llanunevendistribu>onofpointsbetweenthefiles,itmaybenecessarytomanuallysplitthefiles,with the XY loca>on of the scanner as the split loca>on. This can be accomplished by using the las2las command, andmanuallyspecifyingtheXYrangeofthedatatoincludeineachfile.Usingthe“-keep_xy”keywordenablestheabilitytocutoutdataforaspecifiedXYrange.Forexample:

las2las-iinput.laz–ooutput.laz-keep_xy35060147523223510214752696

CommunityDataspaceTutorial

Page 18: The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did not have proper coordinate system informa>on, or it was not recognized on ingest.

TipsandTroubleshoo,ng(con,nued):•  Forcita>onofdatasetscontributedtotheCommunityDataspace,acita>onwillbeautoma>callygeneratedinthefollowing

format:

PI’slastname,PI’sfirst/middleini/als.(publicreleaseyear):Titleofdatasetcollec/on.DistributedbyOpenTopography.linktoDOI.DateofDataAccess.Examples:Hiscock,A.(2019).2019ZigZagLandslideReconnaissance,MorganCounty,Utah.DistributedbyOpenTopography.hLps://doi.org/10.5069/G96D5R4Q.Accessed:2020-01-22Amatulli, G., McInerney, D., Sethi, T., Strobl, P., Domisch, S. (2020). Geomorpho90m - Global High-Resolu>onGeomorphometryLayers.DistributedbyOpenTopography.hLps://doi.org/10.5069/G91R6NPX.Accessed:2020-01-22Gruetzner, C. (2019). Suusamyr Basin, eastern 1992 surface ruptures, Kyrgyzstan. Distributed by OpenTopography.hLps://doi.org/10.5069/G9V69GRT.Accessed:2020-01-22Arrowsmith, J R., PiscioLa, F. and CERG-C (2018): Photogrammetric model of a por>on of the Faraglione--a rockoutcropping in the Vulcano Town area, Vulcano Island, Sicily, Italy (point cloud [17M points] and DEM [6 cm/pix]).DistributedbyOpenTopography..hLps://doi.org/10.5069/G9WD3XPDAccessedOctober29,2018

CommunityDataspaceTutorial