Cross- Modal Object Recognition is Viewpoint Independent
description
Transcript of Cross- Modal Object Recognition is Viewpoint Independent
![Page 1: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/1.jpg)
S E 3 6 7 : I N T R O D U C T I O N T O C O G N I T I V E S C I E N C E
S U B M I TT E D BY: -
H E M A N G I N I PA R M A RY 8 2 1 4
Cross- Modal Object Recognition is Viewpoint Independent
Final Project Presentation
![Page 2: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/2.jpg)
Objects
Dimensions~ (3-5)cm x 2cm x 2cmLego bricks usedMirror images avoidedVery similar objects to prevent distinctive
cues
![Page 3: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/3.jpg)
Objects
![Page 4: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/4.jpg)
Objects
![Page 5: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/5.jpg)
Objects
![Page 6: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/6.jpg)
Objects
![Page 7: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/7.jpg)
Experimental Setup
20 female participants: age group=19-21 years
Random sequence for [modality,rotation] per object to avoid any pattern formationwhere
modality={VV,VH,HV,HH}rotation={UR,X,Y,Z}
Visual mode= 15 secHaptic mode=30sec
![Page 8: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/8.jpg)
Haptic Setup
![Page 9: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/9.jpg)
Visual Setup
![Page 10: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/10.jpg)
Observation Accuracy
![Page 11: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/11.jpg)
OSIQ
![Page 12: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/12.jpg)
Correlation with Spatial scores
0.1
0.12
0.14
0.16
0.18 0.
20.
220.
240.
260.
280
0.5
1
1.5
2
Cross Modal-R
Cross Modal-R
0.1
0.12
0.14
0.16
0.18 0.
20.
220.
240.
260.
280
0.20.40.60.8
11.2
Cross Modal-UR
Cross Modal-UR
0.1
0.12
0.14
0.16
0.18 0.
20.
220.
240.
260.
280
0.5
1
1.5
2
2.5
3
Within Modal-R
Within Modal-R
0.1
0.12
0.14
0.16
0.18 0.
20.
220.
240.
260.
280
0.20.40.60.8
11.2
Within Modal-UR
Within Modal-UR
![Page 13: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/13.jpg)
Correlation with Object Imagery Scores
0.1 0.15 0.2 0.25 0.30
0.20.40.60.8
11.21.41.6
Cross Modal-R
Cross Modal-R
0.1 0.15 0.2 0.25 0.30
0.2
0.4
0.6
0.8
1
1.2
Cross Modal-UR
Cross Modal-UR
0.1 0.15 0.2 0.25 0.30
0.5
1
1.5
2
2.5
3
Within Modal-R
Within Modal-R
0.1 0.15 0.2 0.25 0.30
0.2
0.4
0.6
0.8
1
1.2
Within Modal-UR
Within Modal-UR
![Page 14: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/14.jpg)
Conclusion
The hypothesis that cross-modal recognition is viewpoint independent is validated
The hypothesis that a higher level representation is involved in cross-modal object recognition is still unclear.
![Page 15: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/15.jpg)
References
Lacey S, Peters A, Sathian K (2007) Cross-Modal Object Recognition Is Viewpoint-Independent. PLoS ONE 2(9): e890. doi:10.1371/journal.pone.0000890
Olessia Blajenkova, Maria Kozhevnikov and Michaela Motes (2006) Object-Spatial Imagery: A New Self-Report Imagery Questionnaire, Appl. Cognit. Psychol. 20: 239–263 (2006)
![Page 16: Cross- Modal Object Recognition is Viewpoint Independent](https://reader036.fdocuments.in/reader036/viewer/2022062517/5681391f550346895da0c740/html5/thumbnails/16.jpg)