3D3 - 1hvrl.ics.keio.ac.jp/.../2017/IDW17_3D3-1.pdf3D3 - 1 Author IDW 17 Created Date 10/18/2017...

3
$XJPHQWHG 9LVXDOL]DWLRQ RI 5HDOLW\ IURP &ROOHFWLRQ RI ,PDJHV +LGHR 6DLWR 'HSDUWPHQW RI ,QIRUPDWLRQ DQG &RPSXWHU 6FLHQFH .HLR 8QLYHUVLW\ +L\RVKL .RKRNXNX <RNRKDPD -DSDQ .H\ZRUGV 0L[HG$XJPHQWHG 5HDOLW\ 'LPLQLVKHG 5HDOLW\ 6WUXFWXUH IURP 0RWLRQ 0XOWLYLHZSRLQW $%675$&7 In this talk, I will present a future trend of visual processing in which the amount of images captured by various devices is extremely increasing. While machine learning has made drastic improvement based on the huge amount of image data, we need to achieve the innovative visualization technology using huge amount of image data. I believe that one of such trends is augmenting visual reality based on multi-dimensional visual information analysis for providing intuitive understanding using collection of various images. I will show some preliminary example research directions based on the collection images. ,1752'8&7,21 ,W KDV EHHQ RYHU WZR GHFDGHV VLQFH WKH WHFKQRORJ\ RI ³IUHH YLHZSRLQW V\QWKHVLV´ ZDV SURSRVHG EDVHG RQ ' VKDSH UHFRYHU\ DQG PRGHOLQJ IURP PXOWLSOH YLHZSRLQW LPDJHV >@ LQ ' YLVXDO SURFHVVLQJ ILHOG 'XULQJ WKH WZR GHFDGHV PDQ\ NH\ WHFKQRORJLHV KDYH EHHQ GHYHORSHG IRU LPSURYLQJ WKH SHUIRUPDQFH RI ³IUHH YLHZSRLQW V\QWKHVLV´ VR WKDW ZH FDQ H[SHFW LW LV HDV\ WR PDNH LW SUDFWLFDO XVH VXFK DV VSRUWV YLVXDOL]DWLRQ +RZHYHU ZH KDYH DOUHDG\ QRWLFHG WKDW PDNLQJ LW SUDFWLFDO XVH LV DFWXDOO\ QRW HDV\ WDVN ZKLFK PD\ UHTXLUH PRUH DGGLWLRQDO LQQRYDWLYH WHFKQLTXHV IRU PDNLQJ SHRSOH IHHO VXFK WKDW LPSRVVLEOH FDQ EH SRVVLEOH , EHOLHYH WKDW YLVXDOL]LQJ LQYLVLEOH UHDOLW\ IRU KXPDQ LV RQH RI LQGLVSHQVDEOH WHFKQRORJLHV ZKLFK FDQ EH UHDOL]HG E\ LQQRYDWLQJ ' YLVXDO SURFHVVLQJ $FFRUGLQJ WR LQFUHDVLQJ FDSDELOLW\ RI DPRXQW RI LPDJHV FDSWXUHG E\ YDULRXV NLQG GHYLFHV ZH FDQ DFKLHYH PDQ\ LQQRYDWLYH YLVXDOL]DWLRQV WKDW SHRSOH KDYH EHOLHYHG DV LPSRVVLEOH ,Q WKLV DUWLFOH , SUHVHQW VRPH H[DPSOH WHFKQRORJLHV IRU YLVXDOL]LQJ UHDOLW\ WKDW FDQQRW GLUHFWO\ EH REVHUYHG EXW UHFRQVWUXFWHG IURP FROOHFWLRQ RI LPDJHV , FDOO VXFK WHFKQRORJLHV DV DXJPHQWHG YLVXDOL]DWLRQ $8*0(17(' 9,68$/,=$7,21 86,1* 029,1* &$0(5$ $V DQ H[DPSOH WHFKQRORJ\ ZLWK UHFHQW GUDVWLF LPSURYHPHQW ZH DSSO\ VWUXFWXUH IURP PRWLRQ 6I0 WHFKQRORJLHV >@ WR YLVXDOL]DWLRQ RI LQYLVLEOH UHDOLW\ E\ UHFRYHULQJ ' VWUXFWXUH DQG FDPHUD SRVHV IURP PXOWLSOH YLHZ LPDJH VHTXHQFH )LJ VKRZV D SLSHOLQH IRU YLVXDOL]LQJ D YLGHR ZLWKRXW SHRSOH >@ +HUH WKH EDFNJURXQG RI WKH SHRSOH LV YLVXDOL]HG XVLQJ GLIIHUHQW IUDPHV FDSWXULQJ WKH VFHQH EHKLQG WKH SHRSOH )RU YLVXDOL]LQJ WKH EDFNJURXQG RI WKH VFHQH ' VWUXFWXUH RI WKH VFHQH VKRXOG DOVR EH UHFRYHUHG 6I0 LV D VLJQLILFDQW WHFKQRORJ\ IRU REWDLQLQJ WKH ' VWUXFWXUH LQ WKRVH FDVHV 3HRSOH LQ WKH LQSXW YLGHR DUH ILUVW GHWHFWHG DQG HUDVHG IURP WKH LQSXW YLGHR WKHQ 6I0 LV DSSOLHG WR UHFRYHU ' VWUXFWXUH RI WKH EDFNJURXQG VFHQH 8VLQJ WKH HVWLPDWHG SRVHV RI WKH FDPHUD PRWLRQ WKH DUHD RI WKH GHWHFWHG SHRSOH LV ILOOHG ZLWK LPDJHV FDSWXULQJ EHKLQG WKH SHRSOH $V D UHODWHG WHFKQRORJ\ RI 6I0 YLVXDO 6/$0V >@ KDYH DOVR EHHQ VWXGLHG ZKLFK WDNHV RUGHUHG LPDJH VHTXHQFH IURP PRYLQJ FDPHUD WR VLPXOWDQHRXVO\ UHFRYHU SRVH RI WKH FDPHUD DQG ' VWUXFWXUH RI WKH VFHQH LQ UHDOWLPH )LJ VKRZV YLVXDOL]DWLRQ RI WHPSHUDWXUH RQ WKH VXUIDFH RI WKH VFHQH FDSWXUHG E\ D VHW RI PRYLQJ D 5*% FDPHUD DQG D WKHUPDO FDPHUD %DVHG RQ WKH ' VWUXFWXUH UHFRYHUHG E\ '62 >@ D 6/$0 DOJRULWKP RI WKH WDUJHW VFHQH ZH FDQ PDS WKHUPDO LPDJHV RQWR WKH FRORU LPDJHV ZLWK FROOHFW UHJLVWUDWLRQ LQ ' VFHQH >@ )LJ VKRZV YLVXDOL]DWLRQ RI REMHFW UHFRJQLWLRQ >@ LQ WKH VFHQH EDVHG RQ VLPXOWDQHRXV ' VWUXFWXUH UHFRYHU\ DQG REMHFW VHJPHQWDWLRQ IURP 5*%' LPDJH VHTXHQFH >@ 6LQFH WKH REMHFWV DUH UHFRJQL]HG IURP PXOWLSOH YLHZSRLQWV ZH FDQ DFKLHYH EHWWHU DFFXUDF\ RI WKH UHFRJQLWLRQ WKDQ REMHFW UHFRJQLWLRQ EDVHG RQ D IL[HG YLHZSRLQW $8*0(17(' 9,68$/,=$7,21 86,1* 08/7,3/( &$0(5$6 &DSWXULQJ ZLWK PXOWLSOH FDPHUDV DOVR DQ HVVHQWLDO ZD\ IRU DXJPHQWHG YLVXDOL]DWLRQ $V DQ DSSOLFDWLRQ RI PXOWLSOH FDPHUD V\VWHPV ZH KDYH GHYHORSHG GLPLQLVKHG UHDOLW\ YLVXDOL]DWLRQV >@ )LJ VKRZV DQ H[DPSOH RI WKH GLPLQLVKHG UHDOLW\ YLVXDOL]DWLRQ IRU EDVHEDOO ZDWFKLQJ >@ )RU YLVXDOL]LQJ WKH SHUIRUPDQFH RI SLWFKHU DQG WKH EDOO WUDMHFWRU\ EHKLQG WKH FDWFKHU DQG WKH XPSLUH LPDJHV FDSWXUHG E\ GLIIHUHQW YLHZSRLQW FDPHUDV DUH XVHG IRU UHQGHULQJ WKH KLGGHQ VFHQH LQ WKH WDUJHW FDPHUD 8VLQJ PXOWLSOH FDPHUDV ZH KDYH GHYHORSHG D V\VWHP IRU YLVXDOL]LQJ VFHQHV RFFOXGHG E\ KDQGV DQG WRROV LQ YDULRXV KDQGZRUNLQJ VFHQDULRV >@ ,Q WKLV V\VWHP ZH 3D3 - 1 Invited ISSN-L 1883-2490/24/0818 © 2017 ITE and SID IDW ’17 818

Transcript of 3D3 - 1hvrl.ics.keio.ac.jp/.../2017/IDW17_3D3-1.pdf3D3 - 1 Author IDW 17 Created Date 10/18/2017...

In this talk, I will present a future trend of visual processing in which the amount of images captured by various devices is extremely increasing. While machine learning has made drastic improvement based on the huge amount of image data, we need to achieve the innovative visualization technology using huge amount of image data. I believe that one of such trends is augmenting visual reality based on multi-dimensional visual information analysis for providing intuitive understanding using collection of various images. I will show some preliminary example research directions based on the collection images.

3D3 - 1Invited

ISSN-L 1883-2490/24/0818 © 2017 ITE and SID IDW ’17 818

819 IDW ’17

IDW ’17 820