Supplementary Materialvis- › motionSegmentation › ECCV16... · Table 1: Ground truth of BMS-26...

6
Supplementary Material It’s Moving! A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videos Pia Bideau, Erik Learned-Miller College of Information and Computer Sciences, University of Massachusetts, Amherst {pbideau,elm}@cs.umass.edu Overview Our supplementary material contains: a review of the BMS-26 data set and a detailed overview about excluded video sequences, additional details about the Camouflaged Animals Data Set, a description of our modified Bruss and Horn error [1], a fundamental part of our motion segmentation initialization. 1 Comparability of the motion segmentation data sets A lot of different databases have been created to provide a common bench- mark for motion segmentation. Often a clear definition of what people intend to segment when they provide a ground truth is missing. This results in many inconsistent segmentations, which makes it hard to compare against other mo- tion segmentation methods. In our paper we give a clear definition of motion segmentation (I) Every pixel is given one of two labels: static background or moving objects. (II) If only part of an object is moving, the entire object should be seg- mented. (III) All freely moving objects should be segmented, but nothing else. (IV) Stationary objects are not segmented, even when they moved before or will move in future. We consider segmentation of previously moving objects to be tracking. In the following subsection we give detailed information about all videos that do not correspond to our understanding of motion segmentation.

Transcript of Supplementary Materialvis- › motionSegmentation › ECCV16... · Table 1: Ground truth of BMS-26...

Page 1: Supplementary Materialvis- › motionSegmentation › ECCV16... · Table 1: Ground truth of BMS-26 video sequences we excluded for evaluation due to mislabeled regions in ground truth.

Supplementary MaterialItrsquos Moving A Probabilistic Model for Causal Motion

Segmentation in Moving Camera Videos

Pia Bideau Erik Learned-Miller

College of Information and Computer SciencesUniversity of Massachusetts Amherstpbideauelmcsumassedu

Overview

Our supplementary material contains

ndash a review of the BMS-26 data set and a detailed overview about excludedvideo sequences

ndash additional details about the Camouflaged Animals Data Set

ndash a description of our modified Bruss and Horn error [1] a fundamental partof our motion segmentation initialization

1 Comparability of the motion segmentation data sets

A lot of different databases have been created to provide a common bench-mark for motion segmentation Often a clear definition of what people intendto segment when they provide a ground truth is missing This results in manyinconsistent segmentations which makes it hard to compare against other mo-tion segmentation methods In our paper we give a clear definition of motionsegmentation

(I) Every pixel is given one of two labels static background or movingobjects

(II) If only part of an object is moving the entire object should be seg-mented

(III) All freely moving objects should be segmented but nothing else(IV) Stationary objects are not segmented even when they moved before or will

move in future We consider segmentation of previously moving objects tobe tracking

In the following subsection we give detailed information about all videos thatdo not correspond to our understanding of motion segmentation

2 Pia Bideau Erik Learned-Miller

video ground truth I II III IV comment

cars9 5 3 3 7 white van issegmented before itstarts to move

people2 3 3 7 3 third person in the bg

is not segmented

tennis 4 3 7 3 tennis ball is not

segmented

marple2 5 3 7 3 static fg building is

segmented

marple6 3 3 7 7 bike in the bg is not

segmented

marple7 5 3 7 7 static hedge is

segmented

marple10 5 3 7 3 static wall is

segmented

marple11 2 3 3 7 man is segmentedbefore he starts tomove

marple12 4 3 3 7 pot is segmentedwhich was movedbefore

marple13 4 3 3 7 chair is segmentedwhich was movedbefore

Table 1 Ground truth of BMS-26 video sequences we excluded for evaluation dueto mislabeled regions in ground truth

11 Berkeley Motion Segmentation database (BMS-26)

To satisfy the first criterion of motion segmentation we converted the givenground truth into a binary segmentation removing the provided motion labelsIf all four criteria are satisfied we used the video for comparison The effectof the mislabeled ground truth varies a lot The difference between a correctground truth of marple2 and the provided ground truth for example is enormouswhereas the difference of a correct ground truth of tennis would be almost notnoticeable Trying to be as objective as possible we excluded all videos whereone of our four criteria of motion definition is violated independently of the size

3

of the mislabeled region The following table shows the sequences we excludedfor evaluation

12 Camouflaged Animals Data Set

Our new data set includes nine short video sequences extracted from YouTubevideos and an accompanying ground truth Table 1 shows the link to the originalYouTube video the exact time where our chosen video sequence starts withinthe YouTube video and the number of frames the sequence contains For ourmotion segmentation algorithm we converted the video sequence to an imagesequence in the png format using the VideoReader function of Matlab Eachsequence contains hand-labeled ground truth of moving objects in every fifthframe

Video Link Start Frameschameleon [2] 022820 218

frog [3] 000538 31glow-worm beetle [4] 060213 104

snail [4] 060702 84scorpion1 [4] 020900 105scorpion2 [4] 022504 61scorpion3 [4] 022748 76scorpion4 [4] 000611 80stickinsect [5] 000568 80

2 Modified Bruss and Horn Error

As described in the main text we introduced a modification to the error functionof the Bruss and Horn algorithm that we call the modified Bruss and Horn(MBH) error We first give some basic background on perspective projectiondescribe the Bruss and Horn error function and a particular issue that makesit problematic in the context of motion segmentation and then describe ourmodification to the algorithm

Basics of perspective projection Given a particular set of translationparameters (U VW ) (and assuming no camera rotation) the direction of opticalflow of the background can be predicted for each point (x y) in the image via theperspective projection equations Let a point P have 3-D coordinates (XY Z)Then the image coordinates (x y) for this point are

x =Xf

Zand y =

Y f

Z (1)

where f is the camerarsquos focal length A translational camera motion (U VW )yields in a pixel displacement v in the image

vx =W middot xminus U middot f

Zand vy =

W middot y minus V middot fZ

(2)

4 Pia Bideau Erik Learned-Miller

The direction of the motion given by

arctan(W middot y minus V middot fW middot xminus U middot f) (3)

is then a function of the original image position (x y) the direction of motion(U VW ) and the focal length f and has no dependence on the depth Z of thepoint

Fig 1 Bruss and Horn error Let pbe a vector in the direction of preferredmotion with respect to a motion hypoth-esis (U VW ) The Bruss and Horn errorassigned to a translational flow vector vt

is then the distance of its projection ontop However this same error would be as-signed to a vector minusvt pointing in the op-posite direction which should have muchlower compatibility with the motion hy-pothesis

The Bruss and Horn Error Function The point of the Bruss andHorn algorithm (translation-only case) is to find the motion direction param-eters (U VW ) that are as compatible as possible with the observed optical flowvectors Let p be a vector in the direction of the flow expected from a motion(U VW ) (see Figure 1) Then the Bruss and Horn error for the observed flowvector vt is the distance of the projection of vt onto p shown by the red segmente on the right side of the figure

The problem with this error function is that this distance is small not only forvectors which are close to the preferred direction but also for vectors that are ina direction opposite the preferred direction That is observed optical flow vectorsthat point in exactly the wrong direction with respect to a motion (U VW ) geta small error in the Bruss and Horn algorithm In particular the error assignedto a vector vt is the same as the error assigned to a vector minusvt in the oppositedirection (See Figure 1)

Because the Bruss and Horn algorithm is intended for motion estimationin scenarios where there is only a single moving object (the background) suchmotions in the opposite direction to the preferred motion are not common andthus this ldquoproblemrdquo wersquove identified has little impact However in the motionsegmentation setting where flows of objects may be in opposite directions thiscan make the flow of a separately moving object (like a car) look as though itis compatible with the background We address this problem by introducing amodified version of the error

The modified Bruss and Horn error As stated above the Bruss andHorn error is the distance of the projection of an optical flow vector onto thevector p representing the preferred direction of flow according to a translational

5

motion (U VW ) This can be written simply as

eBH(vtp) = vt middot |sin(](vtp)|

This error function has the appropriate behavior when the observed opticalflow is within 90 degrees of the expected flow direction ie when vt middot p ge 0However when the observed flow points away from the preferred direction weassign an error equal to the magnitude of the entire vector rather than itsprojection since no component of this vector represents a ldquovalid directionrdquo withrespect to (U VW ) This results in the modified Bruss and Horn error (seeFigure 2)

Fig 2 Modified Bruss and Horn er-ror When an observed translation vectorvt is within 90 degrees of the preferred di-rection its error is computed in the samemanner as the traditional Bruss and Hornerror (right side of figure) However whenthe observed vector is more than 90 de-grees from the preferred direction its erroris computed as its full magnitude ratherthan the distance of projection (left sideof figure) This new error function keepsobjects moving in opposite directions frombeing confused with each other

eMBH =

vt if vt middot p lt 0

vt middot |sin(](vtp)| otherwise

This error has the desired behavior of penalizing flows in the opposite directionto the expected flow

6 Pia Bideau Erik Learned-Miller

References

1 Bruss AR Horn BK Passive navigation Computer Vision Graphics and ImageProcessing 21(1) (1983) 3ndash20

2 Most amazing camouflage (part 1 of 3) httpwwwyoutubecomwatchv=

Wc5wMX6lFZ8 (2014) [Online accessed 1-March-2015]3 Most amazing camouflage (part 2 of 3) httpswwwyoutubecomwatchv=

yoG1P4newO4 (2014) [Online accessed 1-March-2015]4 Most amazing camouflage (part 3 of 3) httpswwwyoutubecomwatchv=

GnEkBJnS_FU (2014) [Online accessed 1-March-2015]5 Phasmid - incredible insect camouflage httpswwwyoutubecomwatchv=

adufPBDNCKo (2014) [Online accessed 1-March-2015]

  • Supplementary Material Its Moving A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videos
Page 2: Supplementary Materialvis- › motionSegmentation › ECCV16... · Table 1: Ground truth of BMS-26 video sequences we excluded for evaluation due to mislabeled regions in ground truth.

2 Pia Bideau Erik Learned-Miller

video ground truth I II III IV comment

cars9 5 3 3 7 white van issegmented before itstarts to move

people2 3 3 7 3 third person in the bg

is not segmented

tennis 4 3 7 3 tennis ball is not

segmented

marple2 5 3 7 3 static fg building is

segmented

marple6 3 3 7 7 bike in the bg is not

segmented

marple7 5 3 7 7 static hedge is

segmented

marple10 5 3 7 3 static wall is

segmented

marple11 2 3 3 7 man is segmentedbefore he starts tomove

marple12 4 3 3 7 pot is segmentedwhich was movedbefore

marple13 4 3 3 7 chair is segmentedwhich was movedbefore

Table 1 Ground truth of BMS-26 video sequences we excluded for evaluation dueto mislabeled regions in ground truth

11 Berkeley Motion Segmentation database (BMS-26)

To satisfy the first criterion of motion segmentation we converted the givenground truth into a binary segmentation removing the provided motion labelsIf all four criteria are satisfied we used the video for comparison The effectof the mislabeled ground truth varies a lot The difference between a correctground truth of marple2 and the provided ground truth for example is enormouswhereas the difference of a correct ground truth of tennis would be almost notnoticeable Trying to be as objective as possible we excluded all videos whereone of our four criteria of motion definition is violated independently of the size

3

of the mislabeled region The following table shows the sequences we excludedfor evaluation

12 Camouflaged Animals Data Set

Our new data set includes nine short video sequences extracted from YouTubevideos and an accompanying ground truth Table 1 shows the link to the originalYouTube video the exact time where our chosen video sequence starts withinthe YouTube video and the number of frames the sequence contains For ourmotion segmentation algorithm we converted the video sequence to an imagesequence in the png format using the VideoReader function of Matlab Eachsequence contains hand-labeled ground truth of moving objects in every fifthframe

Video Link Start Frameschameleon [2] 022820 218

frog [3] 000538 31glow-worm beetle [4] 060213 104

snail [4] 060702 84scorpion1 [4] 020900 105scorpion2 [4] 022504 61scorpion3 [4] 022748 76scorpion4 [4] 000611 80stickinsect [5] 000568 80

2 Modified Bruss and Horn Error

As described in the main text we introduced a modification to the error functionof the Bruss and Horn algorithm that we call the modified Bruss and Horn(MBH) error We first give some basic background on perspective projectiondescribe the Bruss and Horn error function and a particular issue that makesit problematic in the context of motion segmentation and then describe ourmodification to the algorithm

Basics of perspective projection Given a particular set of translationparameters (U VW ) (and assuming no camera rotation) the direction of opticalflow of the background can be predicted for each point (x y) in the image via theperspective projection equations Let a point P have 3-D coordinates (XY Z)Then the image coordinates (x y) for this point are

x =Xf

Zand y =

Y f

Z (1)

where f is the camerarsquos focal length A translational camera motion (U VW )yields in a pixel displacement v in the image

vx =W middot xminus U middot f

Zand vy =

W middot y minus V middot fZ

(2)

4 Pia Bideau Erik Learned-Miller

The direction of the motion given by

arctan(W middot y minus V middot fW middot xminus U middot f) (3)

is then a function of the original image position (x y) the direction of motion(U VW ) and the focal length f and has no dependence on the depth Z of thepoint

Fig 1 Bruss and Horn error Let pbe a vector in the direction of preferredmotion with respect to a motion hypoth-esis (U VW ) The Bruss and Horn errorassigned to a translational flow vector vt

is then the distance of its projection ontop However this same error would be as-signed to a vector minusvt pointing in the op-posite direction which should have muchlower compatibility with the motion hy-pothesis

The Bruss and Horn Error Function The point of the Bruss andHorn algorithm (translation-only case) is to find the motion direction param-eters (U VW ) that are as compatible as possible with the observed optical flowvectors Let p be a vector in the direction of the flow expected from a motion(U VW ) (see Figure 1) Then the Bruss and Horn error for the observed flowvector vt is the distance of the projection of vt onto p shown by the red segmente on the right side of the figure

The problem with this error function is that this distance is small not only forvectors which are close to the preferred direction but also for vectors that are ina direction opposite the preferred direction That is observed optical flow vectorsthat point in exactly the wrong direction with respect to a motion (U VW ) geta small error in the Bruss and Horn algorithm In particular the error assignedto a vector vt is the same as the error assigned to a vector minusvt in the oppositedirection (See Figure 1)

Because the Bruss and Horn algorithm is intended for motion estimationin scenarios where there is only a single moving object (the background) suchmotions in the opposite direction to the preferred motion are not common andthus this ldquoproblemrdquo wersquove identified has little impact However in the motionsegmentation setting where flows of objects may be in opposite directions thiscan make the flow of a separately moving object (like a car) look as though itis compatible with the background We address this problem by introducing amodified version of the error

The modified Bruss and Horn error As stated above the Bruss andHorn error is the distance of the projection of an optical flow vector onto thevector p representing the preferred direction of flow according to a translational

5

motion (U VW ) This can be written simply as

eBH(vtp) = vt middot |sin(](vtp)|

This error function has the appropriate behavior when the observed opticalflow is within 90 degrees of the expected flow direction ie when vt middot p ge 0However when the observed flow points away from the preferred direction weassign an error equal to the magnitude of the entire vector rather than itsprojection since no component of this vector represents a ldquovalid directionrdquo withrespect to (U VW ) This results in the modified Bruss and Horn error (seeFigure 2)

Fig 2 Modified Bruss and Horn er-ror When an observed translation vectorvt is within 90 degrees of the preferred di-rection its error is computed in the samemanner as the traditional Bruss and Hornerror (right side of figure) However whenthe observed vector is more than 90 de-grees from the preferred direction its erroris computed as its full magnitude ratherthan the distance of projection (left sideof figure) This new error function keepsobjects moving in opposite directions frombeing confused with each other

eMBH =

vt if vt middot p lt 0

vt middot |sin(](vtp)| otherwise

This error has the desired behavior of penalizing flows in the opposite directionto the expected flow

6 Pia Bideau Erik Learned-Miller

References

1 Bruss AR Horn BK Passive navigation Computer Vision Graphics and ImageProcessing 21(1) (1983) 3ndash20

2 Most amazing camouflage (part 1 of 3) httpwwwyoutubecomwatchv=

Wc5wMX6lFZ8 (2014) [Online accessed 1-March-2015]3 Most amazing camouflage (part 2 of 3) httpswwwyoutubecomwatchv=

yoG1P4newO4 (2014) [Online accessed 1-March-2015]4 Most amazing camouflage (part 3 of 3) httpswwwyoutubecomwatchv=

GnEkBJnS_FU (2014) [Online accessed 1-March-2015]5 Phasmid - incredible insect camouflage httpswwwyoutubecomwatchv=

adufPBDNCKo (2014) [Online accessed 1-March-2015]

  • Supplementary Material Its Moving A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videos
Page 3: Supplementary Materialvis- › motionSegmentation › ECCV16... · Table 1: Ground truth of BMS-26 video sequences we excluded for evaluation due to mislabeled regions in ground truth.

3

of the mislabeled region The following table shows the sequences we excludedfor evaluation

12 Camouflaged Animals Data Set

Our new data set includes nine short video sequences extracted from YouTubevideos and an accompanying ground truth Table 1 shows the link to the originalYouTube video the exact time where our chosen video sequence starts withinthe YouTube video and the number of frames the sequence contains For ourmotion segmentation algorithm we converted the video sequence to an imagesequence in the png format using the VideoReader function of Matlab Eachsequence contains hand-labeled ground truth of moving objects in every fifthframe

Video Link Start Frameschameleon [2] 022820 218

frog [3] 000538 31glow-worm beetle [4] 060213 104

snail [4] 060702 84scorpion1 [4] 020900 105scorpion2 [4] 022504 61scorpion3 [4] 022748 76scorpion4 [4] 000611 80stickinsect [5] 000568 80

2 Modified Bruss and Horn Error

As described in the main text we introduced a modification to the error functionof the Bruss and Horn algorithm that we call the modified Bruss and Horn(MBH) error We first give some basic background on perspective projectiondescribe the Bruss and Horn error function and a particular issue that makesit problematic in the context of motion segmentation and then describe ourmodification to the algorithm

Basics of perspective projection Given a particular set of translationparameters (U VW ) (and assuming no camera rotation) the direction of opticalflow of the background can be predicted for each point (x y) in the image via theperspective projection equations Let a point P have 3-D coordinates (XY Z)Then the image coordinates (x y) for this point are

x =Xf

Zand y =

Y f

Z (1)

where f is the camerarsquos focal length A translational camera motion (U VW )yields in a pixel displacement v in the image

vx =W middot xminus U middot f

Zand vy =

W middot y minus V middot fZ

(2)

4 Pia Bideau Erik Learned-Miller

The direction of the motion given by

arctan(W middot y minus V middot fW middot xminus U middot f) (3)

is then a function of the original image position (x y) the direction of motion(U VW ) and the focal length f and has no dependence on the depth Z of thepoint

Fig 1 Bruss and Horn error Let pbe a vector in the direction of preferredmotion with respect to a motion hypoth-esis (U VW ) The Bruss and Horn errorassigned to a translational flow vector vt

is then the distance of its projection ontop However this same error would be as-signed to a vector minusvt pointing in the op-posite direction which should have muchlower compatibility with the motion hy-pothesis

The Bruss and Horn Error Function The point of the Bruss andHorn algorithm (translation-only case) is to find the motion direction param-eters (U VW ) that are as compatible as possible with the observed optical flowvectors Let p be a vector in the direction of the flow expected from a motion(U VW ) (see Figure 1) Then the Bruss and Horn error for the observed flowvector vt is the distance of the projection of vt onto p shown by the red segmente on the right side of the figure

The problem with this error function is that this distance is small not only forvectors which are close to the preferred direction but also for vectors that are ina direction opposite the preferred direction That is observed optical flow vectorsthat point in exactly the wrong direction with respect to a motion (U VW ) geta small error in the Bruss and Horn algorithm In particular the error assignedto a vector vt is the same as the error assigned to a vector minusvt in the oppositedirection (See Figure 1)

Because the Bruss and Horn algorithm is intended for motion estimationin scenarios where there is only a single moving object (the background) suchmotions in the opposite direction to the preferred motion are not common andthus this ldquoproblemrdquo wersquove identified has little impact However in the motionsegmentation setting where flows of objects may be in opposite directions thiscan make the flow of a separately moving object (like a car) look as though itis compatible with the background We address this problem by introducing amodified version of the error

The modified Bruss and Horn error As stated above the Bruss andHorn error is the distance of the projection of an optical flow vector onto thevector p representing the preferred direction of flow according to a translational

5

motion (U VW ) This can be written simply as

eBH(vtp) = vt middot |sin(](vtp)|

This error function has the appropriate behavior when the observed opticalflow is within 90 degrees of the expected flow direction ie when vt middot p ge 0However when the observed flow points away from the preferred direction weassign an error equal to the magnitude of the entire vector rather than itsprojection since no component of this vector represents a ldquovalid directionrdquo withrespect to (U VW ) This results in the modified Bruss and Horn error (seeFigure 2)

Fig 2 Modified Bruss and Horn er-ror When an observed translation vectorvt is within 90 degrees of the preferred di-rection its error is computed in the samemanner as the traditional Bruss and Hornerror (right side of figure) However whenthe observed vector is more than 90 de-grees from the preferred direction its erroris computed as its full magnitude ratherthan the distance of projection (left sideof figure) This new error function keepsobjects moving in opposite directions frombeing confused with each other

eMBH =

vt if vt middot p lt 0

vt middot |sin(](vtp)| otherwise

This error has the desired behavior of penalizing flows in the opposite directionto the expected flow

6 Pia Bideau Erik Learned-Miller

References

1 Bruss AR Horn BK Passive navigation Computer Vision Graphics and ImageProcessing 21(1) (1983) 3ndash20

2 Most amazing camouflage (part 1 of 3) httpwwwyoutubecomwatchv=

Wc5wMX6lFZ8 (2014) [Online accessed 1-March-2015]3 Most amazing camouflage (part 2 of 3) httpswwwyoutubecomwatchv=

yoG1P4newO4 (2014) [Online accessed 1-March-2015]4 Most amazing camouflage (part 3 of 3) httpswwwyoutubecomwatchv=

GnEkBJnS_FU (2014) [Online accessed 1-March-2015]5 Phasmid - incredible insect camouflage httpswwwyoutubecomwatchv=

adufPBDNCKo (2014) [Online accessed 1-March-2015]

  • Supplementary Material Its Moving A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videos
Page 4: Supplementary Materialvis- › motionSegmentation › ECCV16... · Table 1: Ground truth of BMS-26 video sequences we excluded for evaluation due to mislabeled regions in ground truth.

4 Pia Bideau Erik Learned-Miller

The direction of the motion given by

arctan(W middot y minus V middot fW middot xminus U middot f) (3)

is then a function of the original image position (x y) the direction of motion(U VW ) and the focal length f and has no dependence on the depth Z of thepoint

Fig 1 Bruss and Horn error Let pbe a vector in the direction of preferredmotion with respect to a motion hypoth-esis (U VW ) The Bruss and Horn errorassigned to a translational flow vector vt

is then the distance of its projection ontop However this same error would be as-signed to a vector minusvt pointing in the op-posite direction which should have muchlower compatibility with the motion hy-pothesis

The Bruss and Horn Error Function The point of the Bruss andHorn algorithm (translation-only case) is to find the motion direction param-eters (U VW ) that are as compatible as possible with the observed optical flowvectors Let p be a vector in the direction of the flow expected from a motion(U VW ) (see Figure 1) Then the Bruss and Horn error for the observed flowvector vt is the distance of the projection of vt onto p shown by the red segmente on the right side of the figure

The problem with this error function is that this distance is small not only forvectors which are close to the preferred direction but also for vectors that are ina direction opposite the preferred direction That is observed optical flow vectorsthat point in exactly the wrong direction with respect to a motion (U VW ) geta small error in the Bruss and Horn algorithm In particular the error assignedto a vector vt is the same as the error assigned to a vector minusvt in the oppositedirection (See Figure 1)

Because the Bruss and Horn algorithm is intended for motion estimationin scenarios where there is only a single moving object (the background) suchmotions in the opposite direction to the preferred motion are not common andthus this ldquoproblemrdquo wersquove identified has little impact However in the motionsegmentation setting where flows of objects may be in opposite directions thiscan make the flow of a separately moving object (like a car) look as though itis compatible with the background We address this problem by introducing amodified version of the error

The modified Bruss and Horn error As stated above the Bruss andHorn error is the distance of the projection of an optical flow vector onto thevector p representing the preferred direction of flow according to a translational

5

motion (U VW ) This can be written simply as

eBH(vtp) = vt middot |sin(](vtp)|

This error function has the appropriate behavior when the observed opticalflow is within 90 degrees of the expected flow direction ie when vt middot p ge 0However when the observed flow points away from the preferred direction weassign an error equal to the magnitude of the entire vector rather than itsprojection since no component of this vector represents a ldquovalid directionrdquo withrespect to (U VW ) This results in the modified Bruss and Horn error (seeFigure 2)

Fig 2 Modified Bruss and Horn er-ror When an observed translation vectorvt is within 90 degrees of the preferred di-rection its error is computed in the samemanner as the traditional Bruss and Hornerror (right side of figure) However whenthe observed vector is more than 90 de-grees from the preferred direction its erroris computed as its full magnitude ratherthan the distance of projection (left sideof figure) This new error function keepsobjects moving in opposite directions frombeing confused with each other

eMBH =

vt if vt middot p lt 0

vt middot |sin(](vtp)| otherwise

This error has the desired behavior of penalizing flows in the opposite directionto the expected flow

6 Pia Bideau Erik Learned-Miller

References

1 Bruss AR Horn BK Passive navigation Computer Vision Graphics and ImageProcessing 21(1) (1983) 3ndash20

2 Most amazing camouflage (part 1 of 3) httpwwwyoutubecomwatchv=

Wc5wMX6lFZ8 (2014) [Online accessed 1-March-2015]3 Most amazing camouflage (part 2 of 3) httpswwwyoutubecomwatchv=

yoG1P4newO4 (2014) [Online accessed 1-March-2015]4 Most amazing camouflage (part 3 of 3) httpswwwyoutubecomwatchv=

GnEkBJnS_FU (2014) [Online accessed 1-March-2015]5 Phasmid - incredible insect camouflage httpswwwyoutubecomwatchv=

adufPBDNCKo (2014) [Online accessed 1-March-2015]

  • Supplementary Material Its Moving A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videos
Page 5: Supplementary Materialvis- › motionSegmentation › ECCV16... · Table 1: Ground truth of BMS-26 video sequences we excluded for evaluation due to mislabeled regions in ground truth.

5

motion (U VW ) This can be written simply as

eBH(vtp) = vt middot |sin(](vtp)|

This error function has the appropriate behavior when the observed opticalflow is within 90 degrees of the expected flow direction ie when vt middot p ge 0However when the observed flow points away from the preferred direction weassign an error equal to the magnitude of the entire vector rather than itsprojection since no component of this vector represents a ldquovalid directionrdquo withrespect to (U VW ) This results in the modified Bruss and Horn error (seeFigure 2)

Fig 2 Modified Bruss and Horn er-ror When an observed translation vectorvt is within 90 degrees of the preferred di-rection its error is computed in the samemanner as the traditional Bruss and Hornerror (right side of figure) However whenthe observed vector is more than 90 de-grees from the preferred direction its erroris computed as its full magnitude ratherthan the distance of projection (left sideof figure) This new error function keepsobjects moving in opposite directions frombeing confused with each other

eMBH =

vt if vt middot p lt 0

vt middot |sin(](vtp)| otherwise

This error has the desired behavior of penalizing flows in the opposite directionto the expected flow

6 Pia Bideau Erik Learned-Miller

References

1 Bruss AR Horn BK Passive navigation Computer Vision Graphics and ImageProcessing 21(1) (1983) 3ndash20

2 Most amazing camouflage (part 1 of 3) httpwwwyoutubecomwatchv=

Wc5wMX6lFZ8 (2014) [Online accessed 1-March-2015]3 Most amazing camouflage (part 2 of 3) httpswwwyoutubecomwatchv=

yoG1P4newO4 (2014) [Online accessed 1-March-2015]4 Most amazing camouflage (part 3 of 3) httpswwwyoutubecomwatchv=

GnEkBJnS_FU (2014) [Online accessed 1-March-2015]5 Phasmid - incredible insect camouflage httpswwwyoutubecomwatchv=

adufPBDNCKo (2014) [Online accessed 1-March-2015]

  • Supplementary Material Its Moving A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videos
Page 6: Supplementary Materialvis- › motionSegmentation › ECCV16... · Table 1: Ground truth of BMS-26 video sequences we excluded for evaluation due to mislabeled regions in ground truth.

6 Pia Bideau Erik Learned-Miller

References

1 Bruss AR Horn BK Passive navigation Computer Vision Graphics and ImageProcessing 21(1) (1983) 3ndash20

2 Most amazing camouflage (part 1 of 3) httpwwwyoutubecomwatchv=

Wc5wMX6lFZ8 (2014) [Online accessed 1-March-2015]3 Most amazing camouflage (part 2 of 3) httpswwwyoutubecomwatchv=

yoG1P4newO4 (2014) [Online accessed 1-March-2015]4 Most amazing camouflage (part 3 of 3) httpswwwyoutubecomwatchv=

GnEkBJnS_FU (2014) [Online accessed 1-March-2015]5 Phasmid - incredible insect camouflage httpswwwyoutubecomwatchv=

adufPBDNCKo (2014) [Online accessed 1-March-2015]

  • Supplementary Material Its Moving A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videos