Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data...
Transcript of Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data...
Large-scale3DModelingfromCrowdsourcedData
Jan-MichaelFrahm,UNCEnriqueDunn,SIT
MarcPollefeys,ETHZ,MicrosoftJaredHeinly,URCV
JohannesSchönberger,ETHZ
ResourcesJohannesL.Schönberger
DataAssociation
• StreamingConnectedComponentDiscoveryhttps://github.com/jheinly/streaming_connected_component_discovery
• COLMAP (OpenSource,Freeware)https://colmap.github.io/
3Large-scale3DModelingfromCrowdsourcedData
IncrementalSfM
• Bundler (OpenSource,Freeware)http://www.cs.cornell.edu/~snavely/bundler/
• VisualSfM (ClosedSource,Freeware)http://ccwu.me/vsfm/
• COLMAP (OpenSource,Freeware)https://colmap.github.io/
4Large-scale3DModelingfromCrowdsourcedData
GlobalSfM
• Theia(OpenSource,Freeware)http://www.theia-sfm.org/
• OpenMVG (OpenSource,Freeware)https://github.com/openMVG/openMVG
5Large-scale3DModelingfromCrowdsourcedData
Bundleadjustment
• CeresSolver(OpenSource,Freeware)http://ceres-solver.org/
• PBA (OpenSource,Freeware)https://grail.cs.washington.edu/projects/mcba/
• SSBA (OpenSource,Freeware)https://github.com/chzach/SSBA
6Large-scale3DModelingfromCrowdsourcedData
Multi-ViewStereoandFusion• COLMAP (OpenSource,Freeware)https://colmap.github.io/
• CMVS/PMVS(OpenSource,Freeware)https://www.di.ens.fr/cmvshttps://www.di.ens.fr/pmvs
• CMP-MVS(ClosedSource,Freeware)http://ptak.felk.cvut.cz/sfmservice/websfm.pl?menu=cmpmvs
• Gipuma (OpenSource,Freeware)https://hithub.com/kysucix/gipuma
• OpenMVS (OpenSource,Freeware)https://github.com/cdcseacave/openmvs
7Large-scale3DModelingfromCrowdsourcedData
Benchmarks
• “TanksandTemples:BenchmarkingLarge-ScaleSceneReconstruction”A.Knapitsch,J.Park,Q.Zhou,V.Koltun.SIGGRAPH2017.https://www.tanksandtemples.org/• “AMulti-ViewStereoBenchmarkwithHigh-ResolutionImagesandMulti-CameraVideos”T.Schöps,J.L.Schönberger,S.Galliani,T.Sattler,K.Schindler,M.Pollefeys,A.Geiger.CVPR2017.http://www.eth3d.net/• “ExperimentalComparisonofOpenSourceVision-BasedStateEstimationAlgorithms”Quattrini etal.ISER2016.
8Large-scale3DModelingfromCrowdsourcedData
References• S.Agarwal,N.Snavely,S.M.Seitz,andR.Szeliski,“Bundleadjustmentinthelarge.”ECCV2010
• S.Agarwal,Y.Furukawa,N.Snavely,I.Simon,B.Curless,S.M.Seitz,andR.Szeliski.“BuildingRomeinaDay.”Comm.ACM,2011
• J.-M.Frahm,P.Fite-Georgel,D.Gallup,T.Johnson,R.Raguram,C.Wu,Y.-H.Jen,E.Dunn,B.Clipp,S.Lazebnik,andM.Pollefeys.“BuildingRomeonacloudlessday.”ECCV2010
• J.-M.Frahm,M.Pollefeys,S.Lazebnik,C.Zach,D.Gallup,B.Clipp,R.Raguram,C.Wu,T.Johnson."FastRobustLarge-scaleMappingfromVideoandInternetPhotoCollections",Inspecialissue"100yearsofISPRS"oftheISPRSJournalofPhotogrammetryandRemoteSensing.
• D.Gallup,M.Pollefeys,J.-M.Frahm."3DReconstructionusingann-LayerHeightmap",DAGM2010.
• J.Heinly,J.L.Schönberger,E.Dunn,J.-M.Frahm,“ReconstructingtheWorld*inSixDays*(AsCapturedbytheYahoo100MillionImageDataset)“,IEEEConferenceonComputerVisionandPatternRecognition(CVPR),2015
• X.Li,C.Wu,C.Zach,S.Lazebnik,J.-M.Frahm.“ModelingandRecognitionofLandmarkImage“.ECCV2008
• R.Raguram,C.Wu,J.-M.Frahm,andS.Lazebnik.“ModelingandRecognitionofLandmarkImageCollectionsUsingIconicSceneGraphs.”IJCV,2011
• J.L.Schönberger,J.-M.Frahm."Structure-from-MotionRevisited",CVPR2016.
• J.L.Schönberger,F.Radenovic,O.Chum,J.-M.Frahm."FromSingleImageQuerytoDetailed3DReconstruction",CVPR2015.
• J.L.Schönberger,E.Zheng,M.Pollefeys,J.-M.Frahm."Pixelwise ViewSelectionforUnstructuredMulti-ViewStereo",ECCV2016.
• N.Snavely,S.M.Seitz,andR.Szeliski.“PhotoTourism:Exploringimagecollectionsin3D.”SIGGRAPH,2006
• N.Snavely,S.MSeitz,andR.Szeliski.“Modelingtheworldfrominternetphotocollections.”IJCV,2008
• N.Snavely,S.MSeitz,andR.Szeliski.“Skeletalgraphsforefficientstructurefrommotion.”InCVPR,2008.
• C.Sweeney,V.Fragoso,T.Hollerer,M.Turk.“LargeScaleSfM withtheDistributedCameraModel”,3DV2016.
• E.Zheng,E.Dunn,V.Jojic,J.-M.Frahm."PatchMatch BasedJointViewSelectionandDepthmap Estimation",CVPR2014.
9Large-scale3DModelingfromCrowdsourcedData
WebsiteandSlides
• https://demuc.de/tutorials/cvpr2017
10Large-scale3DModelingfromCrowdsourcedData
Questions?Thankyou!