CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put...
Transcript of CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put...
![Page 1: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/1.jpg)
CAP6412AdvancedComputerVision
Website:http://www.cs.ucf.edu/~bgong/CAP6412.html
Jan12,2016
![Page 3: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/3.jpg)
Email--- thebestwaytoreachme
• Put[CAP6412] insubjectline• Summarizemessageinsubjectline• Ex:[CAP6412]Meetingrequest:Thursday(Jan14)4:30pm?
![Page 4: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/4.jpg)
Today
• Courseoverview• Logistics,requirements
![Page 5: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/5.jpg)
Whatiscomputervision?
• Computerprogramstorecognizeimages• Understandimagesequencesorvideos• Visualscences aroundus• Imitatehumancapabilitiestounderstandscenes• Perception,visualperceivingofthe3Dworld
![Page 6: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/6.jpg)
Whatiscomputervision?
• Duplicatethecapabilitiesofhumanvisiononmachines
• “Acquire,process,analyze,andunderstandimages,videos,3Ddata,andothertypesofhigh-dimensionaldataofthereal(visual)world”--- Wikipedia.org
![Page 7: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/7.jpg)
Researchoncomputervision
• TopicsSceneundestandingMedicalimageanalysisHuman-centricCV
Humanactionrecognition,Face3DScenereconstructionDocument/characterrecognitionLow-levelcomputervision
• Methods,tools,modelsGraphicalmodels(HMM,GMM,etc.),Neuralnetworks,OpenCV
• Relateddisciplines• Graphics,Machinelearning,HCI,Imageprocessing,Medicine,Statistics
![Page 8: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/8.jpg)
Researchoncomputervision
• Topics3DmodelingandreconstructionStereo,structurefrommotionBiomedicalimageanalysisComputationalphotographyFaceandgesturesLow-levelvision(edge,color,etc.)MotionandtrackingOptimizationStatisticallearning,interactivelearningRecognition(ofobjects,attributes,scenes)SegmentationVideo:action,tracking,surveillanceVisionforX
• Relateddisciplines
![Page 9: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/9.jpg)
Disseminatingcomputervisionresearch
• Conferences • Journals,transactions
![Page 10: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/10.jpg)
Disseminatingcomputervisionresearch
• Conferences- CVPR,ICCV,ECCV,NIPS- BMVC,WACV,ACCV,etc.
• Journals,transactions- IEEET-PAMI,IJCV- IEEET-IP,T-MM,CVIU,etc.
• Submission,double-blind review,rebuttal,decision• Morenoisyreviews• Publicationinabout6months
• Submission,single-blind review,response,review,response,…...,decision• Publicationin>1years
arXiv.org:e-prints,self-archived
![Page 11: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/11.jpg)
Digestingcomputervisionresearch
• #1courseobjective- Familiarwithfrontierproblems,researchgroups,andresearchers- Understandstate-of-the-arttechniquesandtools- Familiarwithcomputervisiondatasets(benchmarks)- Understandevaluationmethodsandmetrics
- Improvecriticalanalysiscapabilities
![Page 12: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/12.jpg)
Howtoreadresearchpapers?(1)
• Askquestionsbeforeyoustart
![Page 13: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/13.jpg)
Howtoreadresearchpapers?(1)
• Askquestionsbeforeyoustart
- Whatarethemotivationsforthispaper?- Whatproblemisbeingsolved?- Whatistheproposedsolution?- Whatexperimentsaredesignedtotestthesolution?- Whataretheevaluationmethodsandmetrics
- Whatarethecontributions?- Whatarethefuturedirections?- Howisthepaperrelatedtowhatyoupreviouslyknew?- Howisthepaperrelatedtootherworks?
![Page 14: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/14.jpg)
Howtoreadresearchpapers?(2)
• Repeat:decreasingmarginalgainuntilconvergence?• Getthegeneralideafirst
• Whatproblemisbeingsolved?• Whatarethemainstepsinthesolution?• Whatisthehigh-levelideaofthesolution?
• Drawanalogiestowhatyouknowwell• Readinorder:
• Abstract,conclusion,problemstatementifitexists,intro,approach,experiments
• Divideandconquer• HowtoreadresearchpapersbyDr.MubarakShah:http://crcv.ucf.edu/people/faculty/HowToRead.html
• Thethree-passapproachbyDr.SrinivasanKeshav:http://ccr.sigcomm.org/online/files/p83-keshavA.pdf
![Page 15: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/15.jpg)
Howtoreviewresearchpapers?(1)
• Writeareviewonthepaper--- #2courseobjective- Summarizeatake-homemessage- Recallthemainstrengthsofthepaper
- Novelty- Technicalcorrectness- Clarity- Experimentalevaluation
![Page 16: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/16.jpg)
Howtoreviewresearchpapers?(2)
• Writeareviewonthepaper--- #2courseobjective- Summarizeatake-homemessage- Recallthemainstrengthsofthepaper- Bepicky:weaknessofthepaper
- Lackofnovelty:comparingtopriorwork- Lackofclarity:language,organization,presentation- Technicalerrors:rare- Mismatchedexperimentdesign- Insufficientexperiments- Unfaircomparisonwithothermethods- Justifyyourcomment
![Page 17: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/17.jpg)
Howtoreviewresearchpapers?(3)
• Writeareviewonthepaper--- #2courseobjective- Summarizeatake-homemessage- Recallthemainstrengthsofthepaper- Bepicky:weaknessofthepaper- Overallrating(adaptedfromNIPSreviewerinstructions)
- 0: Top10%ofthepapersIhaveread,anexcellentpaper,astrongaccept.- Iwillfightforacceptance.IwillconsidernotreviewingpapersforXXifthisisrejected.
- 1: Top50%ofacceptedNIPSpapers,averygoodpaper,aclearaccept.- Ivoteandargueforacceptance.
- 2: Goodpaper,accept.- Ivoteforacceptance,althoughwouldnotbeupset ifitwererejected.
- 3:Marginallyabovetheacceptancethreshold.- Itendtovoteforacceptingit,but leavingitoutoftheprogramwouldbenogreatloss.
- 4:Marginallybelowtheacceptancethreshold.- Itendtovoteforrejectingit,buthavingitintheprogramwouldnotbethatbad.
- 5: AnOKpaper,butnotgoodenough.Arejection.- Ivoteforrejectingit,althoughwouldnotbeupset ifitwereaccepted.
![Page 18: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/18.jpg)
Howtoreviewresearchpapers?(4)
• Writeareviewonthepaper--- #2courseobjective- Summarizeatake-homemessage- Recallmainstrengthsofthepaper- Bepicky:weaknessesofthepaper- Overallrating(0,1--5)- Explainyourrating:howyouweighthestrengthsandweaknesses- Brainstormfuturedirections
- ??
![Page 19: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/19.jpg)
Howtoreviewresearchpapers?(4)
• Writeareviewonthepaper--- #2courseobjective- Summarizeatake-homemessage- Recallmainstrengthsofthepaper- Bepicky:weaknessesofthepaper- Overallrating(0,1--5)- Explainyourrating:howyouweighthestrengthsandweaknesses- Brainstormfuturedirections
- Newsolutions- Newsolutionsextendingorinspiredbythepaper’ssolution- Openproblems- Otherproblemsthatcouldbenefitfromthepaper
![Page 20: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/20.jpg)
Howtopresentresearchpapers(inclass)?(1)
• Makegoodpresentations--- #3courseobjective- Knowyouraudience:fellowgraduatestudentswithgoodbackground- Beawareofyourtime:Tues,Thurs,3pm—4:15pm- Adaptthepresentationgoal:explainanddiscussthepaper- Assumenooneintheclasshasreadthepaperbefore
![Page 21: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/21.jpg)
Howtopresentresearchpapers?(2)
• Makegoodpresentations--- #3courseobjective- Title,authors(fullname),authors’institutes,yournameandemail- Motivationoftheresearch(1—2slides)- Problemstatement
- Whatisbeingsolved?- Whyisitanimportantproblem?
- Maincontributionsofthepaper- Studiedanewandimportantproblem- Proposedanovelapproach- Improvedorextendedexistingmethods- Comparedseveralpopularmethods- Exploredavarietyofusecases(manydatasetsofdifferentkinds)- Presentednewtheories- Introducednewmethodologiesortoolstocomputervision
![Page 22: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/22.jpg)
Howtopresentresearchpapers?(3)
• Makegoodpresentations--- #3courseobjective- Title,authors(fullname),authors’institutes,yournameandemail- Motivationoftheresearch(1—2slides)- Problemstatement(1—2slides)- Maincontributionsofthepaper- Approachoutline(1slide)- Detailsoftheproposedapproach- Experiments
- Data,features,baselines,evaluationmetrics,results- Relatedwork(1—3slides)- Conclusion:take-homemessage(1—2slides)
![Page 23: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/23.jpg)
Howtopresentresearchpapers?(4)
• Makegoodpresentations--- #3courseobjective- Title,authors(fullname),authors’institutes,yournameandemail- Motivationoftheresearch(1—2slides)- Problemstatement(1—2slides)- Maincontributionsofthepaper- Approachoutline(1slide)- Detailsoftheproposedapproach- Experiments- Relatedwork(1—3slides)- Conclusion:take-homemessage(1—2slides)- Strengths&weaknessesofthepaper(1—2slides)- Overallrating&why(howyouweighthestrengthsandweaknesses)(1slide)- Futuredirections(1—3slides)
![Page 24: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/24.jpg)
Syllabus(1)
• Overarchingobjective- Introducethefrontiersandtrendsincomputervision- Preparestudentsforcomputervisionresearch
• Throughtakingthiscourse- Gainin-depthunderstandingofthestate-of-the-artsincomputervision- Writehigh-qualitypaperreviews- Improvepresentationskills- Sharpenprogrammingandcriticalanalysisskills- Identifynewresearchdirections
![Page 25: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/25.jpg)
Syllabus(2)
• Topics- Convolutionalneuralnetworks:basicsandapplications- Visionandlanguage:imagecaptioning,visualquestionanswering,etc.- Representations:low-level,middle-level(attributes,parts),CNNlayers,etc.- Video:action,tracking,surveillance,etc.- Statisticalmodelsandlearning- Imageretrievalandmatching- Human-centeredcomputervision:face,pose,pedestrian,ego-centric,feedback,humansintheloop,activelearning,etc.
- Visualsaliency:saliency,gaze,objectproposal,etc.- Formoretopics,seeSyllabus andPapersoncoursehomepage:http://www.cs.ucf.edu/~bgong/CAP6412.html
SubmituptothreepreferredtopicsbyJan14th 2016(Thurs),1pm(UCFFinancialAid)
![Page 26: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/26.jpg)
Syllabus(3)
• GradingpolicyReports(writingpaperreviews):25%
- Tworeviewsperweek(dueresp.Tuesday,Thursday,3pm)- DueonJan14th 2016(Thurs),1pm:uptothreepreferredtopics
PaperPresentations:20%- 1—2presentationseveryclass(volunteers?)
DiscussionandAttendance:20%ProgrammingProjects:25%
- Potentialworkshop&conferencesubmissions- Projectpresentation:10%
Finalprojectpresentation:1:00pm—3:50pm,April28th.Lettergrades:90—100:A,80—89:B,70—79:C,60—69:D,below60:F
![Page 27: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/27.jpg)
Syllabus(4)
• Latehomeworkpolicy- Threelatedaysintotalforallreportsandprojects- Countingatthegranularityof12hours- Noadditionallatedays
![Page 28: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/28.jpg)
Syllabus(5)
• ImportantdatesJan11th, 2016:ClassesbeginJan14th,2016:LastdaytodropandrequestfullrefundJan15th,2016:AdddeadlineonmyUCFMarch23rd,2016:WithdrawaldeadlineApril26th,2016:Classesend;LastdaytoremoveincompleteApril28th,2016:Finalprojectpresentation
Seehttp://calendar.ucf.edu/2016/spring foranyupdates
![Page 29: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/29.jpg)
Syllabus(6)
• StatementonAcademicIntegrity:The UCF Golden Rule (http://goldenrule.sdes.ucf.edu/) will be observed inthe class. Plagiarism and Cheating of any kind on an examination, quiz, orassignment will result at least in an "F" for that assignment (and may,depending on the severity of the case, lead to an "F" for the entire course)and may be subject to appropriate referral to the Office of Student Conductfor further action. I will assume for this course that you will adhere to theacademic creed of this University and will maintain the highest standards ofacademic integrity. In other words, don't cheat by giving answers to othersor taking them from anyone else. I will also adhere to the highest standardsof academic integrity, so please do not ask me to change (or expect me tochange) your grade illegitimately or to bend or break rules for one personthat will not apply to everyone.
![Page 30: CAP 6412 Advanced Computer Vision - UCF CRCV · Email --- the best way to reach me • Put [CAP6412] in subject line • Summarize message in subject line • Ex: [CAP6412] Meeting](https://reader034.fdocuments.in/reader034/viewer/2022042322/5f0cd1657e708231d43747fc/html5/thumbnails/30.jpg)
Questions?