VAHCS Voice Activated Home Control System By: Kyle Joseph Troy Resetich Advisors: Dr. Malinowski Dr....

VAHCSVAHCSVVoice oice AActivated ctivated HHome ome CControl ontrol

SSystemystem

By:By:Kyle JosephKyle Joseph

Troy ResetichTroy Resetich

Advisors: Dr. Advisors: Dr. Malinowski Malinowski Dr. SchertzDr. Schertz

Presentation OutlinePresentation Outline

Project SummaryProject Summary

Functional DescriptionFunctional Description

Block DiagramBlock Diagram IR CaptureIR Capture IR TransmissionIR Transmission Voice Direct II interfaceVoice Direct II interface User InterfaceUser Interface

ConclusionConclusion

Infra-red

Presentation SummaryPresentation Summary

Project SummaryProject Summary

Control any IR activated deviceControl any IR activated device Via voice commandVia voice command

ProgrammableProgrammable Learn IR Code Learn IR Code Learn Voice CommandLearn Voice Command

Learn Multiple IR Commands Learn Multiple IR Commands per Voice Commandper Voice Command

User interfaceUser interface


InputsInputs Voice CommandsVoice Commands IR Sequences To Be CapturedIR Sequences To Be Captured Key Presses (User Responses to Menu)Key Presses (User Responses to Menu)

OutputsOutputs User Interface Menu Via LCD ScreenUser Interface Menu Via LCD Screen Transmitted IR SequencesTransmitted IR Sequences Speaker Queuing User To Say Command Speaker Queuing User To Say Command

Word Word


Modes Of OperationModes Of Operation

Continuous Voice RecognitionContinuous Voice Recognition

Command RecognizedCommand Recognized IR TransmitIR Transmit

Keypad Initiated Learn ModeKeypad Initiated Learn Mode Learn Voice CommandLearn Voice Command Learn IR Command(s)Learn IR Command(s)

Keypad Initiated Erase Mode Keypad Initiated Erase Mode IR SequencesIR Sequences Voice SystemsVoice Systems

Block DiagramBlock Diagram

Sub-Systems

8051 Microprocessor

SensoryVoice Direct II

(Voice -recognition

chip)

LCD(liquid crystal

display)

Keyboard

IR Receiver

IR Transmitter

Microphone

Speaker

Accomplished 1: SWAccomplished 1: SW

Logic of Capture is SamplingLogic of Capture is Sampling Each Sample Saved as Bit in External Each Sample Saved as Bit in External

MemoryMemory

Time Out of 7 seconds if no IR detectedTime Out of 7 seconds if no IR detected

720 samples per sequence720 samples per sequence


Panasonic DVD Play

Sony VCR Play

Sony Receiver Aux

IR to X-10

DVD Discrete Off


Sample every 100 Sample every 100 µsµs

72 ms Recording time for each IR 72 ms Recording time for each IR Sequence Sequence Logic Low Header IncludedLogic Low Header Included

Each Sequence Requires 90 Bytes of Each Sequence Requires 90 Bytes of MemoryMemory


Transmitting Stored IR Sequences Uses Transmitting Stored IR Sequences Uses Same Logic and Timing as CapturingSame Logic and Timing as Capturing

Every 100 Every 100 µs one of the 720 samples sent µs one of the 720 samples sent to output pinto output pin

Accomplished 5: HWAccomplished 5: HW

Transmission of IR requires simple Transmission of IR requires simple modulation modulation 1 =>intensity of IR light 1 =>intensity of IR light

modulated with a triangle wavemodulated with a triangle wave 0 =>no IR light0 =>no IR light

Modulator = VCO, OP-AMP, Transistor, Modulator = VCO, OP-AMP, Transistor, IR-LEDIR-LED LED requires 76 mA (peak)LED requires 76 mA (peak)

Set Backs 1Set Backs 1

Some IR Codes Can Not Be Stored Using Some IR Codes Can Not Be Stored Using This MethodThis Method DVD Discrete OnDVD Discrete On IR to X-10IR to X-10

Set Backs 2Set Backs 2

Panasonic DVD Play

Sony VCR Play

Sony Receiver Aux

IR to X-10

DVD Discrete Off

VDII +User InterfaceVDII +User Interface

Control a complete menu interface Control a complete menu interface with voice activationwith voice activation

Co-ordinate voice inputs with IR signalsCo-ordinate voice inputs with IR signals

Create user-friendly interfaceCreate user-friendly interface

Problems:Problems:

Slave mode:Slave mode: ““not supported”not supported” Stand-alone (4 modes):Stand-alone (4 modes):

ESR, SCL, MCL, SWSESR, SCL, MCL, SWS

Utilize SCL “Single Trigger Continuous Listening”Utilize SCL “Single Trigger Continuous Listening”

Memory:Memory: 60 words different modes60 words different modes

SCL 1 trigger word + 15 wordsSCL 1 trigger word + 15 words

Number of I/0 pins availableNumber of I/0 pins available

Slave Mode:Slave Mode:

Originally the slave mode would allow the Originally the slave mode would allow the EMAC to control the voice templates.EMAC to control the voice templates.

SCL Mode:SCL Mode:

Number of I/O pins:Number of I/O pins:

2 VDII boards working in Parallel2 VDII boards working in Parallel 2 trigger-words or “systems”2 trigger-words or “systems”

30 commands or 15 per system30 commands or 15 per system Ports:Ports:

Share 8 pin parallel inputShare 8 pin parallel input TALK signalTALK signal

Monitor Talk signalMonitor Talk signal

Duration of 176ms

Duration of 32 ms

Voice Direct II/EMAC interfaceVoice Direct II/EMAC interface

Voice Direct II

Board

Input/output

configuration

TALK

OUT1

OUT2

OUT3

OUT4

OUT5

OUT6

OUT7

OUT8

MODE1

MODE2

TRAIN

TRIG-TRAIN

RESET

Held Externally

Emac Outputs

Emac Inputs

EMAC/Voice Direct II interface:EMAC/Voice Direct II interface:

EMAC

Board

Input/output

configuration

VDII CMOS

TALK Sys. 1

TALK Sys. 2

OUT1

OUT2

OUT3

OUT4

OUT5

OUT6

OUT7

OUT8

RECOG(1)

TRAIN(1)

TRIG-TRAIN(1)

RECOG(2)

TRAIN(2)

TRIG-TRAIN(2)

P0.2

P0.3

P0.4

P0.5

P0.6

P0.7

EMAC/Voice Direct II interface:EMAC/Voice Direct II interface:

Use CMOS switches MAX4614 active HIGHUse CMOS switches MAX4614 active HIGH

Delay used to output 105 ms pulse, INX portDelay used to output 105 ms pulse, INX port

VDII

RECOG(1)

TRAIN(1)

TRIG-TRAIN(1)

RECOG(2)

TRAIN(2)

TRIG-TRAIN(2)

P0.2

P0.3

P0.4

P0.5

P0.6

P0.7

VDII + User interface:VDII + User interface:

Initializations:Initializations: Reset both boardsReset both boards TRAIN & RECOG set HIGHTRAIN & RECOG set HIGH

Options:Options: Add New SystemAdd New System

Add New CommandAdd New Command

Delete SystemDelete System

Menu Flow-Chart:Menu Flow-Chart:

Add New System:Add New System:

Add New Command:Add New Command:

Delete System:Delete System:

Listening mode entered after any command is Listening mode entered after any command is storedstored

Trigger word + Command word RecognizedTrigger word + Command word Recognized

LED + Voice OutputLED + Voice Output

EMAC External I/0 inputEMAC External I/0 input

Corresponding IR RecalledCorresponding IR Recalled

IR outputIR output

VDII Feedback:VDII Feedback:

““Voice Activation”:Voice Activation”:

Receive Voice

Command Word?

No

Transmit IRSequence

Yes

Last IR Sequence?

No

Yes

Conclusion:Conclusion:

Currently Completed:Currently Completed: User interface operationalUser interface operational EMAC / VDII interface operationalEMAC / VDII interface operational IR Capture/TransmitIR Capture/Transmit

Possible Project Extensions:Possible Project Extensions: IR / Voice integrationIR / Voice integration Memory Problems (single EMAC board)Memory Problems (single EMAC board)

QUESTIONS?QUESTIONS?

VAHCS Voice Activated Home Control System By: Kyle Joseph Troy Resetich Advisors: Dr. Malinowski Dr....

Documents

Transcript of VAHCS Voice Activated Home Control System By: Kyle Joseph Troy Resetich Advisors: Dr. Malinowski Dr....