The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did...
Transcript of The OpenTopography Community Dataspace allows …...locaons, it could mean that either the data did...
The OpenTopography Community Dataspace allows users who are producing small tomoderatesizedtopographicdatasetsto:• ArchivetheirdatawithOpenTopography• Establishproperdatasetcita>on• Enabledatasetsharingandreuse• Provideeduca>onalapplica>ons
CommunityDataspaceTutorial
IfyoudonothaveaCommunityDataspaceaccount,youcanapplyforone:• GotoDataà“ContributedData”.Fromthatpagetherewillbealinktoclickinorderto
applytobecomeadatacontributor.
CommunityDataspaceTutorial
UserswillbedirectedtotheirMyOpenTopoAuthoriza>onspage:
CommunityDataspaceTutorial
ScrolldowntotheboLomtorequestpermissiontosubmitdatatotheCommunityDataspace:
Oncetheaccountissetup,logintoyourOpenTopographyaccount:• Clickonthe“ContributeDataset”buLontostarttheprocess.
CommunityDataspaceTutorial
Step1:• Giveyourdatasetaname.This,tlewillbeusedinyourdatacita,on,somakeitunique
anddescrip>ve.It’sbesttofollowatemplateof“MeasuredFeature,Loca/on,Date”Forexample:“SurveyofOzaukeeSouthBeachBluff,Wisconsin,May2018”
• Choosethecollec>onplaPormthatwasusedtocollectyourdataset.• ChecktheappropriateboxifyoudatasetcontainsPointClouds,Rasters,orboth.• Select“Next”whendone.
CommunityDataspaceTutorial
Step2:• Foreachfiletype,uploadtheappropriatefiles.
• Point Clouds:we currently only accept LAS orLAZformats.LAZformatsarepreferredastheyreduce file size dras>cally, and will reduceupload >mes. If the data is georeferenced,pleasemakesure that thecoordinate systeminfoisincludedintheheader.
• Rasters: we currently only accept IMG or TIFfiles.Ifthedataisgeoreferenced,pleasemakesure that the coordinate system info isincludedintheheader.
• Metadata:ThemetadatadocumentmustbeinPDF format. Users are free to use whateverformat they wish, but it is preferrable if theOpenTopography template is used. Thetemplateisavailableonthedatauploadpages.
CommunityDataspaceTutorial
CommunityDataspaceTutorial
Notes:• Click on the “Notes” link for guidance on upload
requirements.• Users can upload mul>ple files through the “Choose
Files”buLon,orbydragginganddroppingfiles.• Althoughthereisa10GBlimitonasinglesubmission,ifa
projectislargerthan10GB,itshouldbebrokenintopartsandsubmiLedwithpartnumbersdesignatedclearly.
Step2(con,nued):• Addthefilesbyusingthe“ChooseFiles”buLonorbysimplydraggingthefilesintothedesignatedareaofthewindow.• Whenallfileshavebeenadded,selectthegreen,“StartUpload”buLontobegintheuploadprocess.• Thereisa“StartUpload”buLonforeachcategoryoffile,sobesuretoperformthisopera>onforeachofthesec>onsyou
added.• Notethatifyouhavenotuploadedsuccessfully,therewillbeasmall“x”nexttothefilesize.
CommunityDataspaceTutorial
Step2(con,nued):• Onceyou select the “StartUpload”buLon, youwill see theprogressbaraseachfile isuploaded to theSanDiegoSuper
Compu>ng(SDSC)server.• Whenallthefileshavecompletedtheuploadprocess,selectthe“Next”buLonattheboLomofthepage.
CommunityDataspaceTutorial
Step3:• Thisstepvalidatestheinputdata.Theamountof>methisrequireswilldependonthesize,andamountfilesuploaded.• Theprogressofthevalida>onisdisplayedonthewebsiteasseenbelow.
CommunityDataspaceTutorial
Step4:• Ifthevalida>oncompletessuccessfully,a
pagewillloadthatshowsamapwiththetotal spa>al coverage of all the datasetsinred.
• Therewillalsobeaseriesoftextboxestoadd addi>onal informa>on about thedatasets.
• Required fields are marked with a redasterisk.
• If the map does not show the footprintloca>ons, it could mean that either thedata did not have proper coordinatesystem informa>on, or it was notrecognized on ingest. If you know theEPSGcodeofthedata,youcanenterthiscodeintheboxbelowthemaptoupdatethecoordinatereferencesystem.
CommunityDataspaceTutorial
Step4(Con,nued):• Clickingonthe“ShowDataFiles”barwillshowalistofthefilesthatwereingestedandsomebasic
sta>s>csoneachfile.• Clickingonthe“ViewDetail”buLonwilldisplayaddi>onalmetadataforeachfile.
CommunityDataspaceTutorial
Step4(Con,nued):• Clickingonthemappiniconontherighthandsideofeachfilelis>ngwillupdatethemaptoshowthe
spa>alextentofthatfilecoloredingreen.• Clickingonthegarbagecaniconwilldeleteafilefromthecollec>on.
CommunityDataspaceTutorial
Step4(Con,nued):• Itisbestprac,cetoprovideasmuchinforma,onaboutthedatasetaspossible,somakeanefforttofill
inallapplicablefields.• Project Roles and Contributors can be added to help provide contact informa>on. A_er adding a
contributor, a green check mark will display to show that the user or organiza>on has been addedsuccessfully.
CommunityDataspaceTutorial
Step4(Con,nued)FinalSubmission:• Usethe“SaveProgress”buLontosavework,butdelaysubmi`ngthedatasetforanother>me.• Whenall thedataentry iscompleted,andthedataset is readyforfinalsubmission,select the“Submit
Dataset”buLon. ThepagewillrefreshanddisplayabanneratthetopthatstatesthatthedatasethasbeensuccessfullysubmiLedandispendingOpenTopographyapproval.
• Youaredone!OnceanOpenTopographyteammemberreviewsthesubmission,anemailwillbesenttoyouraccountwithalinktoverifythedatasubmissionanddisplaythedatahomepage.
CommunityDataspaceTutorial
TipsandTroubleshoo,ng:• UseLAZfileswhenpossible.Thecompressiondras>callyreducesfilesizes,andwillspeedupthewholeprocess.• Whenappropriate,verifythatfileshavecoordinatesysteminforma>onintheheader.• Ifuploadsaretakingalong>me,orhavestalled,theprocessmayhaves>llcompleted. Userscancheckthestatusofthe
upload by going to MyOpenTopoà Contributeà “View and manage my community Dataspace datasets” (see imagebelow). Select theeditbuLonnext to theprojectof interest,andverify thatall thefilesareuploadedandhavecorrectsta>s>cs.
CommunityDataspaceTutorial
TipsandTroubleshoo,ng(con,nued):
• WhenworkingwithTLSdata,some>meserrorscanoccurintheuploadbecausethedistribu>onofpointsbetweenthefilesisveryuneven–e.g.filescontainingpointsnearthescan-centerwillhaveMUCHlargerpointcountsthanfilescontainingpoints far fromthescanner. This largediscrepancy infile sizescancauseerrorswhenuploading to theDataspace. Theeasiestsolu>onrightnowistosplitthedatausinglassplitfromtheLAStoolspackage(hLps://rapidlasso.com/lastools/).Thefollowingcommandcanbeused:
lassplit-v–iinput.laz–ooutput_/le.laz-digits2-split25000000Thissplitsthethelazfileintofileswith25,000,000pointsineachfile. The"digits"keywordisjusttellingtheso_waretoincrementthefilenamesby2digits,sooutputfilenameswillbeintheform:output_>le00.laz,output_>le01.laz,etc.
• Notethatifthereiss>llanunevendistribu>onofpointsbetweenthefiles,itmaybenecessarytomanuallysplitthefiles,with the XY loca>on of the scanner as the split loca>on. This can be accomplished by using the las2las command, andmanuallyspecifyingtheXYrangeofthedatatoincludeineachfile.Usingthe“-keep_xy”keywordenablestheabilitytocutoutdataforaspecifiedXYrange.Forexample:
las2las-iinput.laz–ooutput.laz-keep_xy35060147523223510214752696
CommunityDataspaceTutorial
TipsandTroubleshoo,ng(con,nued):• Forcita>onofdatasetscontributedtotheCommunityDataspace,acita>onwillbeautoma>callygeneratedinthefollowing
format:
PI’slastname,PI’sfirst/middleini/als.(publicreleaseyear):Titleofdatasetcollec/on.DistributedbyOpenTopography.linktoDOI.DateofDataAccess.Examples:Hiscock,A.(2019).2019ZigZagLandslideReconnaissance,MorganCounty,Utah.DistributedbyOpenTopography.hLps://doi.org/10.5069/G96D5R4Q.Accessed:2020-01-22Amatulli, G., McInerney, D., Sethi, T., Strobl, P., Domisch, S. (2020). Geomorpho90m - Global High-Resolu>onGeomorphometryLayers.DistributedbyOpenTopography.hLps://doi.org/10.5069/G91R6NPX.Accessed:2020-01-22Gruetzner, C. (2019). Suusamyr Basin, eastern 1992 surface ruptures, Kyrgyzstan. Distributed by OpenTopography.hLps://doi.org/10.5069/G9V69GRT.Accessed:2020-01-22Arrowsmith, J R., PiscioLa, F. and CERG-C (2018): Photogrammetric model of a por>on of the Faraglione--a rockoutcropping in the Vulcano Town area, Vulcano Island, Sicily, Italy (point cloud [17M points] and DEM [6 cm/pix]).DistributedbyOpenTopography..hLps://doi.org/10.5069/G9WD3XPDAccessedOctober29,2018
CommunityDataspaceTutorial