Speech Recognition Robot

Lab BookBeti Lula John

Speech Recognition Robot

Problem and Mission

Civilization’s Great Steps Forward:1) Fire2) The Wheel3) The Printing Press4) The Steam Engine5) The Transistor6) Google7) ???

www.build-it-yourself.com

http://image42.webshots.com/42/4/11/70/305241170vgPjRb_fs.jpg

http://image42.webshots.com/42/4/11/70/305241170vgPjRb_fs.jpg


Problem and Mission

Robots Will Rule!!!

However to make this next great leap forward, we need to make the interface between humans and machines more natural.



Project Plan

Goal:Design, build and present a speech recognition robot that is worthy of media attention.

1) It must work.2) It must be engaging.

Deliverables:1) Power Point Lab book2) Working robot3) Presentation



Project Plan

Tasks:1) Research2) Identify problem3) Specify solution functionality4) Build5) Test and modify6) Manage and document7) Market and present



Teamwork

Assign specific tasks to focused specialists:

Marketing Engineering Programming-Market Demand - Technologies - Technologies- Competition - Inputs / Outputs - Inputs / Outputs- Sales Pitch - Specifications - Specifications- Project Mgm’t - Build - Program- Present - Test & Refine - Test & Refine



Performance


Name 1 Name 2 Name 3Attendance 5 3 2Professionalism 5 3 2Teamwork 4 1 1Initiative 3 1 1Results 5 3 2Total 22 11 8

Attendance - Are you present?Professionalism - Are you respectful of your lab and your teammates?Teamwork - Did you help your teammates or participate in discussions? Initiative - Did you do something more than was expected?Results - Did you get a result?

Yes = 1 No = 0


Project Management – 4 Phases

1) Discovery Research applications Research technology

2) Design Specify a talking robot

3) Development Build a talking robot

4) Deployment Document project Present project



Speech Recognition Applications

Document useful applications of speech recognition robots.

1) Aviation2) Healthcare3) Administration4) Personal computers5) Production6) ???



Robots … What are they good for?

Document what robots do better than humans.

Document what humans do better than robots.



Problem and Mission

Document a problem that could be solved by a speech recognition robot.

Document the mission. (What must our speech recognition robot do to solve the problem?)



Problem Solving Techniques

1) Identify the problem and focus.2) Build on the ideas of others.3) Break the solution into simple parts.4) Work with teammates.5) Document.



Measures of Success

1) Does it work 9 times out of 10?2) Is it unique?3) Will it attract media attention?



Program Primitives

1) Series vs. Parallel2) Iteration3) Conditional4) Variables5) Messaging



Strategies for recognizing speech

What are 3 attributes of speech that can be detected and interpreted?



Program Flow Chart to Detect Syllables


Start

Wait forsyllable

Wait

2nd syllabledetected

?

Display2 syllables

Display1 syllable

YesNo

start



Start

Wait forsyllable

Volumelow?

Yes

No

start

Volumehigh

?

Yes

No

End

Program Flow Chart to Detect Syllables


Tasks


Marketing:1) Develop an elevator pitch for your robot. Research what an elevator pitch is.2) Design a one page advertisement for your robot.3) Design signs that explain how your robot works.4) Build expressive eyes, mouth, arms, and body.5) Write and record the script you want your robot to lead (man - machine interaction)

Engineering:1) Build the structure.2) Build a gear train that drives two shafts.3) Build a mechanism that makes eyes, mouth and arms move.

Programming:1) Write a program to execute the script or man - machine interaction.

Document everything in your lab books.


Robot / Human Script


When visitor is detected, say:Greetings! My name is ...

Welcome to Colegio Las Hayas.

While you are waiting, would you like to ...

Please answer, "Si" or "Huh, Huh" to my question.

If "Si" then say:

If "Huh, Huh" then say:


Structure and components


Engineering:This structure is good for mounting motion modules and sensors at different levels.

The vertical shaft could make arms move left and right.


Robot Structure:Click on ‘Build-It-Blocks’Select ‘Presenting Ideas’Select ‘LEGO Tall Structure

Gear Train:Click on ‘Build-It-Blocks’Select ‘Spin, Rotate, Twirl’Select ‘Power Top Gear Train Mini”

http://www.build-it-yourself.com/




Engineering:The ‘Open ‘n Close’ module can drive many parts to move.


Robot Structure:Click on ‘Build-It-Blocks’Select ‘Shake, Dance, Flap’Select ‘Open ‘n Close’

http://www.build-it-yourself.com/




Engineering:The arms and the mouth move.


Robots Made from Premium Quality Junk



SpeechRecognitionProgram



SpeechRecognitionProgram


Programming team:


Robot Promo


Marketing team:

What can you say and show that will makecustomers want to buy your robot?

1) Write and perform a song that your robot will sing.2) Write and design an advertisement.3) Design a Web page or a Facebook page for your robot.


References


Example of project web site http://www.build-it-yourself.com/support/support-workshops/wkshp-archive/wkshp-glts-2002/index.

Introduction to talking robots at Tokyo Universityhttp://www.youtube.com/watch?v=Li4w9DPPNYI&NR=1&feature=fvwp

Demo of MIT Kismet language vs expressionhttp://www.youtube.com/watch?v=dKZczUDGp_I

Demo of how engaging a talking robot can be.http://www.youtube.com/watch?v=HuqL74C6KI8&feature=related

http://www.build-it-yourself.com/support/support-workshops/wkshp-archive/wkshp-glts-2002/index.html

http://www.youtube.com/watch?v=Li4w9DPPNYI&NR=1&feature=fvwp

http://www.youtube.com/watch?v=dKZczUDGp_I

http://www.youtube.com/watch?v=HuqL74C6KI8&feature=related


Project Summary


What you should know:• The problem and mission• 3 deliverables• 3 measures of success• 4 project management phases• 3 reasons for modular construction• 5 problem solving techniques• 5 program primitives• Effective use of Power Point, Google, Excel and

collaboration tools

Reference Slides Follow


Presentation Outline


Project Presentation

1) Introduce team members and explain the parts of the project that were most interesting to you.2) State the problem and mission (PPT Lab Book)3) Describe the 4 phases of project planning and who did what. (PPT Lab Book) - Discovery - Design - Development - Deployment4) Present your research (PPT Lab Book)5) Present your robot.6) Grade your work on 5 measures of performance.

Questions

1) Why is modular construction valuable?2) Why is teamwork important?3) What do humans do well and what to robots do well?4) What are 5 computer programming structures?5) Describe how your program works?


Teamwork

The importance of teamwork in solving complex problems.

How many people are on the World of Warcraft team?

How many people to develop an animated feature film?



Teamwork


How many people are on the World of Warcraft team? 60 developers / 400 employees when launched in 2001. 5000 employees in 2009.

How many people to develop an animated feature film? 75 artists using hand made frames. 27 animators made Toy Story using computer tools.



Teamwork


How many people worked for NASA when we landed on the moon?



Teamwork


How many people worked for NASA when we landed on the moon?36,000 NASA employees when man landed on the moon



Can’t read from a distance. Image does not relate to content

Speech Recognition RobotLab BookBetiLula John

Average, boring, not engaging


Direct, engaging

Speech Recognition Robot

Documents

Transcript of Speech Recognition Robot