[email protected] Writing Guide: Conducting Electronic Research
Electronic Conducting System
description
Transcript of Electronic Conducting System
![Page 1: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/1.jpg)
Electronic Conducting System
Kenzo AbrahamsSupervisor: Mehrdad GhaziasgarCo-supervisor: James ConnonMentored by: Diego Mushfieldt
![Page 2: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/2.jpg)
OverviewIntroductionUser Interface SpecificationHigh Level DesignLow level DesignDemo
![Page 3: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/3.jpg)
IntroductionInteractive Conducting SystemTracks hands using webcamReal-time alterations depending
on hand gestures◦Change volume◦Change tempo
![Page 4: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/4.jpg)
User Interface Specification Graphic User Interface (GUI)User interacts using webcam and
mouse
![Page 5: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/5.jpg)
User Interface Specification
![Page 6: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/6.jpg)
User Interface Specification
![Page 7: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/7.jpg)
User Interface Specification
![Page 8: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/8.jpg)
High Level DesignThe solution can be broken up
into 3 parts◦Input ◦Image processing◦Adjust music
![Page 9: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/9.jpg)
Low Level Design
![Page 10: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/10.jpg)
Low Level DesignInput
◦The frames need to be acquired from the webcam
◦cvQueryFrame(capture)
![Page 11: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/11.jpg)
Low Level DesignImage Processing
◦Convert copies of frames to HSV colour space
◦cvCvtColor(frame, img_hsv, CV_BGR2HSV)
![Page 12: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/12.jpg)
Low Level DesignImage Processing
◦Skin segmentation◦Use of a predefined method◦Detect if pixels in the rectangle fall
within a certain range
![Page 13: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/13.jpg)
Low Level DesignImage Processing
◦Set hand as region of interest
◦cvSetImageROI(pHueImg, pHandRect )
![Page 14: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/14.jpg)
Low Level DesignImage Processing
◦Perform Camshift
cvCamShift( pProbImg, prevHandRect, cvTermCriteria( CV_TERMCRIT_EPS | CV_TERMCRIT_ITER, 10, 1 ), &components, &HandBox )
![Page 15: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/15.jpg)
Low Level DesignAdjust Music
◦Library RTcmix is used to produce the music
◦Can be imbedded into C++ code◦load("WAVETABLE")◦Wave = maketable("wave", 1000,
"tri")◦WAVETABLE(start time, duration,
amp, frequency, pan, wave)
![Page 16: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/16.jpg)
DemoOverview of demonstration
◦Track the right hand◦Perform the gestures that are going
to be used◦Track the left hand◦Perform simple gestures such as
raising and lowering hand◦Move each hand separately
![Page 17: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/17.jpg)
Project PlanGoal Due Date
Learn how to use OpenCV and its tools.Elicit the requirements and define a designers interpretation of the problem.
CompletedFrom the users requirements design a prototype for the system
CompletedConstruct the system with all its functionality present Term 3Test the system and deployment Term 4
![Page 18: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/18.jpg)
References O'Niel, D L. (2008). Music Theater Jobs. Available:
http://www.ehow.com/list_6547349_music-theater-jobs.html. Last accessed 29th March 2012.
Bradski, G Kaehler, A. (2008). Getting to Know OpenCV. In: Loukides, M Learning OpenCV. United States of America: O’Reilly. pp31-87.
Ivanciuc, O. (2005). SVM - Support Vector Machines . Available: http://www.support-vector-machines.org/. Last accessed 29th March
Nakra, T., Ivanov, Y., Smaragdis, P., Ault, C. (2009). The USB Virtual Maestro: an Interactive Conducting System, pp.250-255, NIME2009
Borchers, J., Hadjakos, A., M¨uhlh¨auser, M. (2006), MICON a music stand for interactive conducting. Proceedings of the 2006 conference on New interfaces for musical expression, pp254–259.
![Page 19: Electronic Conducting System](https://reader031.fdocuments.in/reader031/viewer/2022020921/5681602d550346895dcf405c/html5/thumbnails/19.jpg)
Questions and Answers