PROJ REPORT.docx

8/17/2019 PROJ REPORT.docx

1/69

Hand Gesture Recognition For Indian Sign Language

CHAPTER 1

INTRODUCTION

1.1 PROBLEM DEFINITION

Dept. of ECE, RYMEC Page 1


2/69


Generally dumb people use sign language for communication but they find difficulty in

communicating with others who do not understand sign language. Sign language is not universal;

it changes from country to country. Recognition of sign language is to provide most important

opportunity for deaf community.

It is based on the need of developing an electronic device that can translate sign language

into speech in order to mae the communication to tae place between the mute communities

with general public. !his pro"ect aims to lower this barrier in communication.

1.2 MOTIVATION

Sign language is the most natural way of e#pression for the deaf community. !he urge to

support the integration of deaf people into the hearing society made the automatic sign language

recognition. !his pro"ect is motivated by a thought of ensuring that deaf people have e$uality of

opportunity and full participation in society. %y developing sign language recognition system a

hearing impaired person can easily interact with a normal person at different levels in the society.

&e have attempted to design a basic system of sign language pertaining to Indian sign language.

1.3 APPROACH

In this pro"ect we are developing an electronic device that bridges the communication gap

between the mute communities and the general public based on 'R( ).First we made a brief

study of all the methods pertaining to general gesture recognition systems using various

techni$ues. !hen we studied about the Indian sign language which is used conveniently by the

mute community in their daily life.

1.4 SIGNIFICANCE OF PROJECT

*eople+ who are not deaf+ never try to learn the sign language for interacting with deaf

people. !his becomes a cause of isolation of deaf people. %ut+ if an embedded system can be

programmed in such a way that it can translate sign language to te#t format+ the difference



3/69


between normal people and deaf community can be minimi,ed. !he main ob"ective of our

pro"ect is to fill the communication gap between deaf community and normal people in India.

In today-s life several applications in education and entertainmentsuch as interactive

learning modules+ lecture presentations and /0 games which have speech input and outputcapabilities. Speech and hearing impaired humans re$uire real time sign language gesture

recognition and generation to use these applications. Hence our pro"ect paves the way to fulfill

all these necessities.

1.5 FEATURES

• !he ARM7TDMI is a member of the 'dvanced RIS1 (achines 2'R(3 family of

general purpose /4bit microprocessors+ which offer high performance for very low

power consumption and price. !he 'R( architecture is based on Reduced Instruction Set

1omputer 2RIS13 principles+ and the instruction set and related decode mechanism are

much simpler than those of micro programmed 1omple# Instruction Set 1omputers.

• LPC2148 combines microcontroller with embedded high speed flash memory ranging

from /4% to 564%. 0ue to its tiny si,e and low power consumption+ L*14678 is ideal

for applications where miniaturi,ation is a ey re$uirement.

• Data !"#$ is used which is a normal cloth driving gloves fitted with sensors along the

length of each finger and thumb. (ute people can use the gloves to perform hand gesture

and it will be converted into speech so that normal people can understand their

e#pression. !his pro"ect provides the map for developing such a digital glove.

• 9arious softwares such as :IL+ FL'SH('GI1+


4/69


? Human hands vary in shape and si,e. So some users cannot wear these input devices.

? In these systems+ where hand tracing is re$uired+ some type of noise is bound to be

associated with the data.

? 'ccuracy is one of the most critical components to provide robust recognition.

1.8 APPLICATIONS

? (edically monitoring patients.

? 1ommunicating in video conferencing.

? 0istance learning @ teleteaching assistance.

1.& ORGANI'ATION

!he overall report is organi,ed in a systematic manner so as to mae it convenient for thereader in following the concepts.

• 1hapter 4 provides the literature survey which is done regarding the pro"ect and the

papers referred with respect to the pro"ect.

• 1hapter / provides the brief study of the sign language.

• 1hapter 7 shows the bloc diagram and detailed e#planation of each bloc.

• 1hapter 5 includes the detailed e#planation of hardware used in this pro"ect.

• 1hapter A includes the detailed e#planation of software used in this pro"ect.

• 1hapter ) shows the results and analysis of our pro"ect.

• 1hapter 8 shows the advantages and disadvantages of using this particular system and

application of our pro"ect.

• 's no wor progresses without reference+ conclusion discussion and future wor+ these

topics are noted in chapter B.



5/69


CHAPTER 2

LITERATURE SURVE(



6/69


2.1 INTRODUCTION

In the world of sign language+ and gestures a lot of research wor has been done over the

past three decades. In present scenario+ gesture recognition systems+ facilitate communication

between the deaf and hearing people in real world situations. In order to improve the accuracy of

recognition+ many researchers have deployed methods such as H((+ 'rtificial neural networs+

and+ :inect platform. ffective algorithms for segmentation+ classification+ pattern matching and

recognition have evolved+ but this creates both+ challenges and opportunities for sign language

recognition related research.

2.2 RELATED )OR*

In the last two decades+ several different methods of potential applications in the

advanced gesture recognition system have been suggested+ but these differ from one to another in

their models. Some of them are Ceural Cetwor+ H((s+ and Fu,,y systems.

!he past decades have witnessed two specific patterns for categories of sign language

recognition.

!he first category is dependent upon electromechanical devices for e#ampleD !he glove

based systems. !hey can be used for measuring different parameters of gestures such as hand and

finger position+ angles+ and tip recognitions etc.

!he second category revolved around the use of machine vision and image processing

techni$ues to formulate vision based hand gesture recognition systems.

!he related research wors done based on these categories areD



7/69


• (ing+ Huei developed a system based on windowed template matching recognition

strategy. It focuses on recogni,ing a continuous flow of signs in 'SL+ by enhancing the

functionalities of the traditional data glove.

• Starner and *entland presented a high accuracy computer vision based method+ which

used Hidden (arov (odels for 'SL recognition. !hey used the traditional dual camera

method+ one for tracing user-s hand+ and the other mounted on the des.

• 1aridais and 0iamenti designed a robust system for consistent hand tracing and

preservation of the resulting contours. !heir scheme incorporated (arov chains+ H((+

self organi,ing maps for segmentation and feature e#traction.

• Loeding and Sarar developed a system which made use of signemes i.e.+ parts of signs

that are present in most occurrences+ taen from videos.

TABLE 2.1+ RECENT TRENDS IN SIGN LANGUAGE RECOGNITION ,1-

E'R &>R: 0>C (!H>0

464 ' continuous sign language

recognition system for

thiopian sign language to

recogni,e gestures against

comple# bacground.

!wo main parts 1andidate

gesture selection 21GS3 and

Hand movement tra"ectory

determination 2H(!03 to

recogni,e gestures against

plain and comple#

bacground.

466 Sign Language recognition

using6.:inect !echnology and

4. Ceural Cetwors.

(icrosoft :inect Sensor was

used to recogni,e 'merican

sign language.' new

architecture using the neura

networs was developed.

46 ' human 1omputer interface

which wors on images as

well as videos.

!his method first cancels

bacground and noise effects

on the image+ it then classifies

the gesture features using a

multiclass support vectormachine classifier.

4B ' system used Hidden (arov

(odels+ boundary tracing and

fingertip detection.

%oundary edge detection

algorithm was used for dge

0etection+ clipping and

boundary tracing. H((s were

used to recogni,e gestures in



8/69


real time.

2.3 DRA)BAC*S OF THE PREVIOUS RESEARCH )OR*S

In dynamic hand gesture recognition+ the tra"ectory estimation in vision based system

may re$uire to apply comple# algorithm to trac hand and fingers using silhouettes and edges.

• !he ma"or drawbac of colour based locali,ation techni$ues is the variability of sin

colour footprint in different lighting conditions. !his fre$uently results in undetected sin

regions or falsely detected nonsin te#tures.

• In Ceural Cetwors techni$ue+ networ training can be very timeconsuming and does

not guarantee good results. It also re$uires retraining of entire networ if hand gestures

are added or removed.

• 's with multilevel neural networs+ the hidden nature of Hidden (arov (odels maes

it difficult to observe their internal behavior.

• =sing Image processing techni$ue+ the drawbacs will be that highresolution cameras

are used and hence it is not economic for common people. !he system may not be

portable due to the use of cameras. !he low level features of histograms results in a

disadvantage of this techni$ue.

2.4 OUR APPROACH

Glove based systems represent one of the most important efforts aimed at ac$uiring hand

movement data. (ute people can use the gloves to perform hand gesture and it will be converted

into speech so that normal people can understand their e#pression. !he tra"ectory estimation is

$uite simple and straight forward in glovebased hand gesture recognition system that provides

spatial information directly which overcomes the problem in image processing.



9/69


Since embedded system is dedicated to specific tass+ design engineers can optimi,e it to

reduce the si,e and cost of the product and increase the reliability and performance.

!his approach uses embedded technology 2'R()3. !he L*14678 microcontrollers are

based on 6Abit@/4bit 'R()!0(IS 1*= with realtime emulation and embedded trace

support. 0ue to their tiny si,e and lowpower consumption+ L*14678 are ideal for applications

where miniaturi,ation is a ey re$uirement. !he 'R( memory interface has been designed to

allow the performance potential to be reali,ed without incurring high costs in the memory

system.



10/69


CHAPTER 3

INDIAN SIGN LANGUAGE

3.1 INTRODUCTION



11/69


Sign languages are natural languages that use different means of e#pression for

communication in everyday life. (ore particularly+ it is a means of communication for hearing

impaired. !hus+ it provides replacement for speech among deaf and mute people. #amples of

some sign languages are the 'merican Sign Language+ %ritish sign language+ Indian sign

language+ apanese sign language and so on.

Sign language are well structured language with a phonology+ morphology+ synta# and

grammar distinctive from spoen languages. !he structure of a spoen language maes use of

words linearly i.e.+ one after the other+ where as a sign language maes use of several body

movements simultaneously in the spatial as well as in temporal space. !he linguistic characters

of a sign language are different than that of spoen language due to e#istence of several

components affecting the conte#t such as the use of facial e#pressions and head movements in

addition to hand movements.

3.1.1 FACTS OF SIGN LANGUAGE

Sign language has its own grammatical structure independent of any spoen or written

language.

!he ma"ority of deaf children are born to hearing parents and therefore do not ac$uire

sign language as a mother tongue. !hey need to learn it at school.

(inority of deaf children are born to deaf parents. !hey ac$uire sign language as a

mother tongue.

Some studies reveal that children can learn sign language earlier than they can learn to

spea.

3.2 INDIAN SIGN LANGUAGE

India+ with its one billion people+ is the second most populated country in the world. It is

estimated that there are over a million people who are profoundly deaf and appro#imately 6

million hard of hearing people+ in India. Co formal census data are available. !hese figures are

e#trapolated from the number of people who are deaf and hard of hearing+ in &estern nations

26 for individuals who are deaf and 6 for the hard of hearing3.



12/69


It would be realistic to believe that the actual number of people who are deaf and hard of

hearing is much higher+ because of poor hygienic conditions and lac of ade$uate medical

services in India. %ased on these numbers+ one of every five people who are deaf in the world+

lives in India. 'ccording to an =CS1> report in the 6B8-s+ only 5 of children who were

deaf attended any special educational programme. 'pplied to the present situation+ this would

mean that only 5+ children+ who are deaf+ receive any education while the other B5+ are

left to their own devices.

3.2.1 ORIGIN OF INDIAN SIGN LANGUAGE

In regard to the degree of intelligence necessary for the invention and use of gesture

speech there is a great variety of opinion among scientific investigators. 't a very early period of

savage state+ the necessity for communication developed certain signs+ visible and vocal+ which

met the wants of the necessity felt at that time. In all probability vocal signs were not at first as

rapidly developed as gestures+ but though of slower growth they finally crowded out+ and in a

measure too the place of facial e#pression and body movements so that by that time when the

later stage or period of savagery or perhaps barbarism was reached each group in this unfolding

process which might be called a family+ band or tribe had retained only a few of their originaloperations of thought a rude and imperfect articulate language.

Indian sign language also nown as *lains sign language was developed by Indian

society to meet a need for clear communication between tribes that spoe different languages. 's

with any native language+ Indian sign language was in danger of dying out and being lost. In

6B/ the =.S Government sponsored a conference on Indian sign language that included the

production of a film+ J!he Indian Sign LanguageK. !his film is reportedly stored at the Cational

'rchives.

!he concept of sign language interpreting is fairly new to the Indian subcontinent.

'lthough sign language has been in e#istence for many centuries in India+ the first ever



13/69


professional training in Indian sign language interpreting began in 46 at !he Indian sign

language cell at 'li Eavar ung Cational institute for the hearing handicapped in (umbai.4M

3.2.2+ RESEARCH )OR* ON INDIAN SIGN LANGUAGE

For a country the si,e of India+ the paucity of research on people who are deaf and hard

of hearing is not understandable. (iles+ compiled a historical bibliography on the education

of children who are handicapped in South 'sia and found only a few citations relative to

deafness and the education of children who are 0eaf over a span of 7+ years. (iles pointed

out that until the 4th century+ deafness was considered as punishment for sins of earlier

incarnations. *eople who were deaf were not allowed to inherit property by law+ until the

beginning of the 4th 1entury. &ith the prevalence of such beliefs+ it is not surprising that Indiansociety does not mae deaf education a priority. =ntil 6B)8+ it was generally believed that there

was no Indian Sign Language 2ISL3.

%aner"ee compared signs used in three schools for the deaf situated in %engal 2present &.

%engal and part of 'ssam3. His conclusion was that gestures used in each school were different.

He believed that signing started in India in the 68th century but its use was strongly discouraged+

as signing was believed to impede learning to read. In 6B)5+ (adan 9asishta sent a $uestionnaire

to the heads of the 66) schools for the deaf in India. 'lmost all the respondents agreed that there

was no Indian Sign Language. !hey did+ however+ acnowledge that deaf children used some

ind of Jcollection of gesturesK. ' similar survey was conducted by 0. 0eshmuh 4 years later+

again using $uestionnaires sent out to schools for the 0eaf. Some of the responses show the same

misconceptions about sign language+ saying+ for instance+ that signing is Jbased on spoen

languageK+ or Jis based on nglishK+ or that+ Jit is difficult to provide a sign for every spoen

wordK. However+ there were also some statements that showed a more positive attitude towards

manual communication+ and here respondents did tal about Jsign languageK+ rather than

JgesturesK. Increasing awareness about the nature of sign languages is evidenced in statements

such asD J!hrough sign languages+ there is free and easy communicationK+ JSign language is

the mother tongue of the 0eafK.



14/69


Linguistic wor on Indian Sign Language 2ISL3 began in the 6B)-s. In 6B))+ 9asishta+

&oodward+ and &ilson visited India with partial support from the Cational Science Foundation

2=S'3 and collected signs from four ma"or urban centers 20elhi+ 1alcutta+ %ombay+ and

%angalore3 for linguistic analyses. 9asishta et al.+ found that ISL is a language in its own right

and is indigenous to the Indian subcontinent. Subse$uent efforts by 9asishta et al between 6B))

and 6B84 resulted in four dictionaries of ISL regional varieties. !he 'll India Federation of the

0eaf supposedly distributed these dictionaries to selected programmes serving the 0eaf in India.

In 46+ another dictionary was published by the Ramarishna (ission 9idyalaya in

1oimbatore. /M



15/69


FIGURE 3.1 GESTURES IN INDIAN SIGN LANGUAGE



16/69


CHAPTER 4

BLOC* DIAGRAMAND

)OR*ING METHODOLOG(

4.1 BLOC* DIAGRAM



17/69


F/0$ 4.1+ B!" a0a

4.2 DESCRIPTION OF BLOC* DIAGRAM

GloveD Glove is used which is normal clothdriven glove fitted with sensors. Sensors placed on

the thumb act as inputs. !he placement of the sensors on the other four fingers is such that they

help in maing the e#act gesture of Indian sign language.

*ower Supply: *ower supply is designed to convert high voltage '1 mains electricity to a

suitable low voltage supply for electronic circuits and other devices. 59 regulated supply is used.

L()85 is used for 59 regulated supply.• >utput current in e#cess of .5'

• It accepts input voltage range from )9 to 659

• Co e#ternal components

• Internal thermal overload protection

• Internal short circuit currentlimiting

• >utput transistor safearea compensation


GLOV

E

LCDRM!7

LPC 2148

PO"ER

O#RE$E%

PCPO"

ER

RE$E%


18/69


• >utput voltages of 59+ 649+ and 659

F/0$ 4.2+ B!" Da0a " P"6$0 S/!

ach of the blocs is described in more detail belowD

• !ransformer steps down high voltage '1 mains to low voltage '1.

• Rectifier converts '1 to 01+ but the 01 output is varying.

• Smoothing smoothes the 01 from varying greatly to a small ripple.

• Regulator eliminates ripple by setting 01 output to a fi#ed voltage.

'R(): 'R()!0(IS is a general purpose /4bit microprocessor which offers high

performance and very low power consumption. !he 'R( architecture is based on reduced

instruction set computer 2RIS13 principle. !he 'R()!0(IS processor has two instruction

sets. !hey are standard /4bit 'R( set and a 6Abit !humbset. !he L*14678 contains two

analog to digital converters. !hese converters are single 6bit successive appro#imation analog

to digital converters. !he total number of available '01 inputs for L*14678 is 67.7M

L10D ' li$uid crystal display 2L103 is a flat panel display+ electronic visual display or video

display that uses the light modulating properties of li$uid crystals 2L1s3. L1s do not emit light

directly. L10s are more energy efficient and offer safer disposal. Its low electrical power

consumption enables it to be used in batterypowered electronic e$uipment.

4.3 )OR*ING METHODOLOG(



19/69


!he cables are connected from the port of 'R( processor to the *1.

'fter powering up the system+ press RS! button.

Cow+ open the =0

window that gives a voice output.



20/69


CHAPTER 5

HARD)ARE DETAILS

5.1 ARM M0" C"9t0"!!$0

5.1.1 B0$ H:t"0 " ARM



21/69


• 'R( is acronym for 'dvanced RIS1 (achines.

• Founded in the year 6BB and it is owned by 'corn+ 'pple and 9LSI.

• :nown before becoming 'R( as computer manufacturer.

5.1.2 ); ARM H$0$<

• 'R( is one of the most licensed and thus widespread processor cores in the world.

• =sed especially in portable devices due to low power consumption and reasonable

performance.

• Several interesting e#tensions are available.

• Includes special instruction set namely Nthumb instruction set-.

!here are many types of 'R( micro controllers such as 'R(A+ 'R()+ 'R(B+ 'R(6+

'R(66 etc.

!he type of micro controller used in this pro"ect is 'R()!0(I.

5.1.3 ARM7 A0;t$t/0$

• /4bit RIS1processor core 2/4bit instructions3.

• /) pieces of /4bit integer registers 26A available3.

• *ipelined 2includes / stages3.

• 1ached 2depending on the implementation3.

• 9on Ceumanntype bus structure.

• /4 bit data types.

• ) modes of operation 2usr+ fi$+ ir$+ svc+ abt+ sys+ und3.

• Simple structure and reasonably good speed to power consumption ratio.

5.1.4 ARM7 R$:t$0 S$t

• Register structure depends on mode of operation.

• 6A pieces of /4bit integer registers R R65 are available in 'R(mode 2usr+ user3.

• R R64 are general purpose registers.

• R6/ is Stac *ointer 2S*3.



22/69


• R67 is subroutine Lin Register.

• Holds the value of R65 when %Linstruction is e#ecuted.

• R65 is *rogram 1ounter 2*13.

• %its 6 and are ,eroes in 'R(state 2/4bit addressing3.

• R6A is state register 21*SR+ 1urrent *rogram Status Register3.

• !here are /) 'R( registers in total of which variable amount is available as baned

registers depending on the mode of operation.

• R6/ functions always as stac pointer.

• R67 functions as lin register in other than sys and usr O modes.

• S*SR P Saved *rogram Status Register.

• Flag register (odebits tell the processor operating mode and thus the registers

available.AM

F/0$ 5.1+ F!a R$:t$0

5.1.5 ARM7TDMI

TDMI stands for

• !humb instruction set

• 0ebuginterface

• (ultiplier 2hardware3

• Interrupt 2fast interrupts3

ARM T;/=



23/69


• ! 2!humb3e#tension shrins the 'R( instruction set to 6Abit word length i.e. /57

amount of memory compared is saved when compared to /4bit instruction set.

• #tension enables simpler and significantly cheaper reali,ation of processor system.

Instructions tae only half of memory than with /4bit instruction set without significant

decrease in performance or increase in code si,e.

• #tension is made to instruction decoder at the processor pipeline.

• Registers are of /4bit si,e.

T;/= E>t$9:"9

• !humbinstruction decoder is placed in pipeline.

• 1hange to !humbmode happens by turning the state of multiple#ers feeding the

instruction decoders and data bus.

• '6 selects the 6Abit half word from the /4bit bus.

F/0$ 5.2+ E>$/t"9 " T;/= I9:t0/t"9

T;/=?Stat$ R$:t$0:

• >nly lower part of the register immediately available.

• =pper register set 2R8R653 can be used with assembler code.

• Instructions (>9+ 1(* and '00 are available between register sets.



24/69


F/0$ 5.3+ T;/= a9 ARM Stat$ R$:t$0:

5.2 LPC2148 D$ta!:

L*14678 combines microcontroller with embedded high speed flash memory ranging

from /4% to 564%. ' 648bit wide memory interface and uni$ue accelerator architecture

enable /4bit code e#ecution at the ma#imum cloc rate. For critical code si,e applications+ the

alternative 6Abit !humb mode reduces code by more than / with minimal performance

penalty.

0ue to its tiny si,e and low power consumption+ L*14678 is ideal for applications where

miniaturi,ation is a ey re$uirement. Serial communications interfaces ranging from a =S% 4.

Fullspeed device+ multiple ='R!s+ S*I+ SS* to I41bus and onchip SR'( of 8% up to 7%+

mae these devices very well suited for communication gateways and protocol converters+

providing both large buffer si,e and high processing power.)M

5.2.1 *$ F$at/0$:



25/69


• 6Abit@/4bit 'R()!0(IS microcontroller in a tiny LQF*A7 pacage.

• 8% to 7% of onchip static R'( and /4% to 564% of onchip flash memory. 648bit

wide interface@accelerator enables highspeed A(H, operation.

•

InSystem *rogramming@In'pplication *rogramming 2IS*@I'*3 via onchip boot loader software. Single flash sector or full chip erase in 7ms and programming of 45A bytes in

6ms.

• mbedded I1 R! and mbedded !race interfaces offer realtime debugging with the

onchip Real (onitor software and highspeed tracing of instruction e#ecution.

• =S% 4. Fullspeed compliant device controller with 4% of endpoint R'(. In addition+

the L*14678 provides 8% of onchip R'( accessible to =S% by 0('.

• !wo 6bit '01s provide a total of A@67 analog inputs+ with conversion times as low as

4.77s per channel.• Single 6bit 0'1 provides variable analog output.

• !wo /4bit timers@e#ternal event counters 2with four capture and four compare channels

each3+ *&( unit 2si# outputs3 and watchdog.

• Low power Real!ime 1loc 2R!13 with independent power and /4H, cloc input.

• (ultiple serial interfaces including two ='R!s 26A1553+ two Fast I41bus 27bit@s3+

S*I and SS* with buffering and variable data length capabilities.

• 9ectored Interrupt 1ontroller 29I13 with configurable priorities and vector addresses.

• =p to 75 of 5 9 tolerant fast general purpose I@> pins in a tiny LQF*A7 pacage.

• =p to 46 e#ternal interrupt pins available.

• A (H, ma#imum 1*= cloc available from programmable onchip *LL with settling

time of 6s.

• >nchip integrated oscillator operates with an e#ternal crystal from 6(H, to 45(H,.

• *ower saving modes include idle and *owerdown.

• Individual enable@disable of peripheral functions as well as peripheral cloc scaling for

additional power optimi,ation.

• *rocessor waeup from *owerdown mode via e#ternal interrupt or %>0.

• Single power supply chip with *>R and %>0 circuitsD

• 1*= operating voltage range of /.9 to /.A9 2/./9 6 3 with 59 tolerant I@> pads.



26/69


5.2.2 B!" Da0a



27/69


F/0$ 5.4+ LPC2148 B!" Da0a

5.2.3 P999 Da0a



28/69


F/0$ 5.5+ LPC2148 P9 Da0a

5.2.4 A0;t$t/0a! O#$0#$6



29/69


!he L*14678 is a general purpose /4bit microprocessor+ which offers high performance

and very low power consumption. !he architecture is based on Reduced Instruction Set

1omputer 2RIS13 principles+ and the instruction set and related decode mechanism are much

simpler than those of micro programmed 1omple# Instruction Set 1omputers 21IS13. !his

simplicity results in a high instruction throughput and impressive realtime interrupt response

from a small and costeffective processor core.

*ipeline techni$ues are employed so that all parts of the processing and memory systems

can operate continuously. !ypically+ while one instruction is being e#ecuted+ its successor is

being decoded+ and a third instruction is being fetched from memory.

!he L*14678 processor employs a uni$ue architectural strategy nown as !humb+ whichmaes it ideally suited to highvolume applications with memory restrictions+ or applications

where code density is an issue.8M

!he ey idea behind !humb is that of a superreduced instruction set. ssentially+ the

L*14678 processor has two instruction setsD

• !he standard /4bit 'R( set.• ' 6Abit !humb set.

!he !humb set-s 6Abit instruction length allows it to approach twice the density of

standard 'R( code while retaining most of the 'R(-s performance advantage over a traditional

6Abit processor using 6Abit registers. !his is possible because !humb code operates on the

same /4bit register set as 'R( code. !humb code is able to provide up to A5 of the code si,e

of 'R(+ and 6A of the performance of an e$uivalent 'R( processor connected to a 6Abit

memory system.

!he particular flash implementation in the L*14678 allows for full speed e#ecution also

in 'R( mode. It is recommended to program performance critical and short code sections 2such



30/69


as interrupt service routines and 0S* algorithms3 in 'R( mode. !he impact on the overall code

si,e will be minimal but the speed can be increased by / over !humb mode.

5.2.5 O9?C; F!a:; M$"0

!he L*14678 incorporate a 564% flash memory system. !his memory may be used for

both code and data storage. *rogramming of the flash memory may be accomplished in several

ways. It may be programmed In System through the serial port. !he application program may

also erase and@or program the flash while the application is running+ allowing a great degree of

fle#ibility for data storage field firmware upgrades+ etc. 0ue to the architectural solution chosen

for an onchip boot loader+ flash memory available for user-s code on L*14678 is 5%. !he

L*14678 flash memory provides a minimum of 6+ erase@write cycles and 4 years of data

retention.

5.2.% O9?C; Stat RAM

>nchip static R'( may be used for code and@or data storage. !he SR'( may be

accessed as 8bit+ 6Abit+ and /4bit. L*14678 provides /4% of static R'(. In L*14678 only+

an 8% SR'( bloc intended to be utili,ed mainly by the =S% can also be used as a general

purpose R'( for data storage and code storage and e#ecution.

5.2.7 M$"0 Ma

!he L*14678 memory map incorporates several distinct regions+ as shown in figure 5.A.



31/69


F/0$ 5.%+ LPC2148 M$"0 Ma

5.2.8 1@?=t ADC



32/69


!he L*14678 contains two analog to digital converters. !hese converters are single 6

bit successive appro#imation analog to digital converters. &hile '01 has si# channels+ '016

has eight channels. !herefore+ total number of available '01 inputs for L*14678 is 67.

F$at/0$:

• 6 bit successive appro#imation analog to digital converter.

• (easurement range of 9 to 9RF 24. 9 T 9RF T 900'3.

• ach converter capable of performing more than 7+ 6bit samples per second.

• very analog input has a dedicated result register to reduce interrupt overhead.

• %urst conversion mode for single or multiple inputs.

• >ptional conversion on transition on input pin or timer match signal.

• Global Start command for both converters.

5.2.& 1@?=t DAC

!he 0'1 enables the L*14678 to generate a variable analog output. !he ma#imum 0'1

output voltage is the 9RF voltage.

F$at/0$:

• 6bit 0'1.

• %uffered output.

• *owerdown mode available.

• Selectable speed versus power.

5.2.1@ UART: U9#$0:a! A:9;0"9"/: R$$#$0 a9 T0a9:tt$0



33/69


!he L*14678 contains two ='R!s+ ='R! and ='R!6. In addition to standard

transmit and receive data lines+ the L*14678 ='R!6 also provide a full modem control

handshae interface. 1ompared to previous L*14 microcontrollers+ ='R!s in L*14678

introduce a fractional baud rate generator for both ='R!s+ enabling these microcontrollers to

achieve standard baudrates such as 6654 with any crystal fre$uency above 4(H,.

F$at/0$:

• 6A byte Receive and !ransmit FIF>s 2First In First >ut3.

• Register locations confirm to 55 industry standard.

• Receiver FIF> trigger points at 6+ 7+ 8+ and 67 bytes

• %uiltin fractional baud rate generator covering wide range of baud rates without a need

for e#ternal crystals of particular values.

• !ransmission FIF> control enables implementation of software 2>C@>FF3 flow control

on both ='R!s.

• L*14678 ='R!6 e$uipped with standard modem interface signals. !his module also

provides full support for hardware flow control.

UART1 F$at/0$:

• ='R!6 is identical to ='R!+ with the addition of a modem interface.

• 6A byte Receive and !ransmit FIF>s.

• Register locations confirm to 55 industry standard.

• Receiver FIF> triggers points at 6+ 7+ 8+ and 67 bytes.

• %uiltin fractional baud rate generator with auto bauding capabilities.

• (echanism that enables software and hardware flow control implementation.

• Standard modem interface signals included with flow control fully supported in

hardware.

5.2.11 C0:ta! O:!!at"0

>nchip integrated oscillator operates with e#ternal crystal in range of 6 (H, to 45(H,.



34/69


!he oscillator output fre$uency+ f osc and the 'R( processor cloc fre$uency is referred to as

11L: for purposes of rate e$uations+ etc. f osc and 11L: are the same value unless the *LL

2*hase Loced Loop3 is running and connected.

5.2.12 P"6$0 C"9t0"!

!he L*14678 supports two reduced power modesD

o Idle mode

o *ower down mode.

In Idle mode+ e#ecution of instructions is suspended until either a reset or interrupt

occurs. *eripheral functions continue operation during idle mode and may generate interrupts to

cause the processor to resume e#ecution. Idle mode eliminates power used by the processor

itself+ memory systems and related controllers+ and internal buses.

In *owerdown mode+ the oscillator is shut down and the chip receives no internal clocs.

!he processor state and registers+ peripheral registers+ and internal SR'( values are preserved

throughout *owerdown mode and the logic levels of chip output pins remain static. !he *ower

down mode can be terminated and normal operation resumed by either a reset or certain specific

interrupts that are able to function without clocs. Since all dynamic operation of the chip is

suspended+ *owerdown mode reduces chip power consumption to nearly ,ero.

Selecting an e#ternal /4 H, cloc instead of the *1L: as a clocsource for the onchip

R!1 2Real !ime 1loc3 will enable the microcontroller to have the R!1 active during *ower

down mode. *owerdown current is increased with R!1 active. However+ it is significantly lower

than in idle mode. ' *ower 1ontrol for *eripherals feature allows individual peripherals to be

turned off if they are not needed in the application+ resulting in additional power savings during

active and idle mode.

5.3 LCD L/ C0:ta! D:!a



35/69


' li$uid crystal display 2L103 is a flat panel display+ electronic visual display or video

display that uses the light modulating properties of li$uid crystals 2L1s3. L1s do not emit light

directly. L10s are more energy efficient and offer safer disposal. Its low electrical power

consumption enables it to be used in batterypowered electronic e$uipment. It is an electronically

modulated optical device made up of any number of segments filled with li$uid crystals and

arrayed in front of a light source 2baclight3 or reflector to produce images in color or

monochrome. !he most fle#ible ones use an array of small pi#els. 's L10 panels produce no

light of their own+ they re$uire an e#ternal lighting mechanism to be easily visible. >n most

displays+ this consists of a cold cathode fluorescent lamp that is situated behind the L10 panel.

For batteryoperated units 2e.g. laptops3 this re$uires an inverter to convert 01 to '1.

!he below figure /.67 shows a general purpose alphanumeric 6A#4 L10. ' 6A#4 L10 means it

can display 6A characters per line and there are 4 such lines. In this L10 each character is

displayed in 5#8 pi#el matri#.

F/0$ 5.7+ A G$9$0a! P/0":$ A!;a9/$0 LCD



36/69


C"99$t9 a9 LCD :!a t" a 0""9t0"!!$0

F/0$ 5.8+ LCD C"99$t"9: t" M0""9t0"!!$0

5.4 RS?232

In telecommunications+ RS4/4 is a standard for serial binary data signals connecting

between a 0! 20ata terminal e$uipment3 and a 01 20ata 1ircuitterminating $uipment3. It

is commonly used in computer serial ports. In RS4/4+ data is sent as a timeseries of bits. %oth

synchronous and asynchronous transmissions are supported by the standard. In addition to the

data circuits+ the standard defines a number of control circuits used to manage the connection

between the 0! and 01. ach data or control circuit only operates in one direction that is+

signaling from a 0! to the attached 01 4/ or the reverse. Since transmit data and receive data

are separate circuits+ the interface can operate in a full duple# manner+ supporting concurrent data

flow in both directions. !he standard does not define character framing within the data stream+ or

character encoding.



37/69


F/0$ 5.&+ RS 232

Ta=!$ 5.1+ RS 232 S9a!:

5.4.1 RS?232 S9a!:

T0a9:tt$ Data T>D

0ata sent from 0! to 01.

R$$#$ Data R>D

0ata sent from 01 to 0!.

R$/$:t T" S$9 RTS

'sserted 2set to 3 by 0! to prepare 01 to receive data. !his may re$uire action on the

part of the 01+ e.g. transmitting a carrier or reversing the direction of a halfduple# line.

C!$a0 T" S$9 CTS

'sserted by 01 to acnowledge R!S and allow 0! to transmit.

Data T$09a! R$a DTR

'sserted by 0! to indicate that it is ready to be connected. If the 01 is a modem+ it

should go Uoff hooU when it receives this signal. If this signal is deasserted+ the modem

should respond by immediately hanging up.



38/69


Data S$t R$a DSR

'sserted by 01 to indicate an active connection. If 01 is not a modem 2e.g. a null

modem cable or other e$uipment3+ this signal should be permanently asserted 2set to 3+

possibly by a "umper to another signal.

Ca00$0 D$t$t CD

'sserted by 01 when a connection has been established with remote e$uipment.

R9 I9at"0 RI

'sserted by 01 when it detects a ring signal from the telephone line.

5.5 MA232

F/0$ 5.1@+ MA232

('S levels. !hese receivers have a typical threshold of 6./9+ a typical

hysteresis of .59 and can accept /9 inputs. ach driver converts !!L@1(>S input levels into

!I'@I'4/4F levels.

FEATURES+



39/69


• (eets or e#ceeds !I'@I'4/4F and I!=recommendation 9.48

• >perates from a single 59 power supply with 6F charge pump capacitors

• >perates upto 64 :bps.

• !wo drivers and two receivers.

• /9 Input Levels

• Low Supply 1urrent . . . 8m' !ypical

• 0esigned to be Interchangeable &ith (a#im ('


40/69


CHAPTER %

SOFT)ARE DETAILS

%.1 *EIL D$#$!"$9t T""!

:eil software provides the ease of writing the code in either 1 or

assembly. Vvision 7+ the new I0 from :eil Software combines *ro"ect

management+ Source 1ode diting and *rogram 0ebugging in one powerful environment. It acts

as a crosscompiler.

%.1.1 Ba: *$!

6. >pen :eil from the Start menu.

2. !he Figure below shows the basic names of the windows referred in this document.



41/69


F/0$ %.1+ Ba: )9"6 " *$!

%.1.2 Sta0t9 a 9$6 A::$=!$0 P0"$t

1. Select Cew *ro"ect from the *ro"ect (enu.



42/69


F/0$ %.2+ )9"6 S;"6: H"6 t" C0$at$ A N$6 P0"$t

4. Came the pro"ect N*ro"ectW0emo-/. 1lic on the Save %utton.

7. !he device window will be displayed.

5. Select the part you will be using to test with. For now we will use the C


43/69


F/0$ %.3+ )9"6 S;"6: H"6 t" C0$at$ A N$6 F!$

4. ' new window will open up in the :eil I0./. &rite@1opy the code into the new window.

7. 1lic on File menu and select Save asX5. Came the file !S!.c.A. 1lic the Save %utton.

%.1.4 A9 F!$ t" t;$ P0"$t

1. #pand !arget 6 in the !ree (enu.



44/69


F/0$ %.4+ )9"6 S;"6: H"6 t" E>a9 T;$ Ta0$t

4. 1lic on *ro"ect and select !argets+ Groups+ and FilesX

/. 1lic on Groups@'dd Files tab

7. =nder 'vailable Groups select Source Group 65. 1lic 'dd Files to GroupX button

A. 1hange file type to 'sm Source file2Y.aY; Y.src3

). 1lic on toggle.a56

8. 1lic 'dd buttonB. 1lic 1lose %utton

6. 1lic >: button when you return to !arget+ Groups+ FilesX dialog bo#

66. #pand the Source Group 6 in the !ree menu to ensure that the file was added to the pro"ect.

%.1.5 C0$at9 HE "0 t;$ Pa0t

6. 1lic on !arget 6 in !ree menu.4. 1lic on *ro"ect (enu and select >ptions for !arget 6.



45/69


F/0$ %.5+ )9"6 S;"6: H"6 t" A A F!$ t" S"/0$

/. Select !arget !ab.

7. 1hange utput !ab.

A. 1lic on 1reate He# File chec bo#.

). 1lic >: %utton.

8. 1lic on *ro"ect (enu and select rebuild all !arget Files

B. In the %uild &indow it should report N rrors 2s3+ &arnings-

6. Eou are now ready to *rogram your *art

%.1.% T$:t9 P0"0a 9 D$=/$0

6. 1omment out line '1'LL 0L'E by placing a Semicolon at the beginning. !his will allow

you to see the port change immediately.

4. 1lic on the File (enu and select Save.



46/69


F/0$ %.%+ )9"6 S;"6: H"6 t" D$=/ A F!$

/. 1lic on *ro"ect (enu and select rebuild all !arget Files.

7. In the %uild &indow it should report N rrors 2s3+ &arnings-.

5. 1lic on 0ebug (enu and Select Start@Stop 0ebug Session.

%.1.7 R/999 t;$ *$! D$=/$0

6. !he :eil 0ebugger should be now be Running.

4. 1lic on *eripherals. Select I@> *orts+ Select *ort 6

/. ' new window should port will pop up.7. Step through the code by pressing F66 on the :eyboard. !he *arallel *ort 6 %o# should

change as you completely step through the code.5. !o e#it out+ 1lic on 0ebug (enu and Select Start@Stop 0ebug Session.

%.2 F!a:; Ma

%.2.1 G$9$0a! D$:0t"9



47/69


'R( micro controller 0evelopment %oard support ma"or chips From *hilips For

programming that are flash programmable microcontrollers that supports serial programming of

devices. Flash microcontroller can be erased and rewritten as many times as possible. Fle#ibility

to reprogram number of times and its low cost mae it ideal for use in a wide areas of

applications.!his product is a combination of intelligent hardware and software. %ootloader

Inside the 1hip that understands a protocol received from computer through serial port . >n

computer side software called Flash (agic is started that identifies the hardware and the chip

inserted. *rogram for the target microcontroller can be now either read bac or sent as Intel

format H< file. Support locing of devices to prevent reading bac of programmed chip. 'fter

locing the chip can still be erased and used again for loading new programs.'tmel series can

only test in this 0evelopment %oard.

F$at/0$:

• Support ma"or *hilips devices

• Loc of programs in chip supported to prevent program copying

• ZIF socet onboard 1ompatible 7 pin (icrocontrollers

• 'uto rase before writing and 'uto 9erify after writing

• Informative status bar and access to latest programmed file

•

Simple and asy to use



48/69


(ain &indow

'dvanced >ptions &indow



49/69


!erminal Settings &indow

0evice 0atabase

%.3 ?CTU



50/69



51/69


!he !erminal tab has three basic functionsD !erminal emulator 'bility to send and receive

predefined data pacts 2'ssemble pacet3 'bility to send and receive data in He# and 'S1II

formats 2Show@Hide he#3

T;$ a9 t$09a! 69"6

!he main white portion of this tab is where most of the communications information will

occur while using


52/69


%.4 TETALOUD SOFT)ARE

!he use of computer generated+ synthetic speech is getting more and more mainstream.

!e#t file readers are a common class of speech apps and as a nifty e#tra many of them let you

turn te#t files into spoen audio directly. !he audio file or files can then be listened on the road

using some hardware mp/ player+ efficiently stored on the computer for later listening or burned

on a set of regular audio 1ds.



53/69


!e#t'loud is a very useful and easytouse te#t to speech utility for an attractively low

price 2about 4 =S dollars3. It shines in turning multiple files to compressed audio very $uicly

and also offers basic te#t editing+ pronunciation and voice changing features. =nlie most free

readers+ it supports both S'*I 7 and S'*I 5 for ma#imal coverage and offers some lowvision

features+ too.

FEATURES

!

*ocet*1s. !his can reduce the time spent on machines and enables you to listen while

travelling.

!his software consists of advanced pronunciation tools. !his can increase our

pronunciation sills without going to any institutes or using any other software.

!his software has optional premium voices for a wide variety of accents and languages.

(any famous voices are also present.

!e#t aloud is used by windows users and also ('1 users. !oolbar plugins for internet

e#plorer+ Firefo#+ and >utloo are also available so you do not have to waste any time.



54/69


CHAPTER 7

RESULTS AND ANAL(SIS

7.1 HAND GESTURE RECOGNITION S(STEM MODULE

!his is the figure of our module for hand gesture recognition system. (ainly this system

consists of two parts+ those areD

• 'R() 1>C!R>LLR *'R!

• GL>9 &I!H SCS>RS.

's shown in the figure+ the glove is worn by a dumb person and the gestures arerecogni,ed using the whole system module.



55/69


F/0$ 7.1 Ha9 G$:t/0$ R$"9t"9 S:t$ M"/!$

7.1.1 ARM 7 BOARD

!his is the figure showing the 'R() %>'R0 with respect to our pro"ect.



56/69


F/0$ 7.2 ARM?7 BOARD

7.2 RESULT ANAL(SIS

Status &hen *ower Switch is >C



57/69


0isplay of the character N'-

0isplay of the character N-

0isplay of the character NI-



58/69


0isplay of the character N>-

0isplay of the character N=-

0isplay of the character NS-



59/69


0isplay of the character NH-

0isplay of the character N!-

0isplay of the character NR-



60/69


0isplay of the character NC-

0isplay of the character NL-

0isplay of the sentence JEour name pl,K



61/69


0isplay of the sentence Jmergency HelpK

0isplay of the sentence J1ost of !his *roduct[K

7.3 COMPARISON CHART



62/69


*arameters

(icrocontrollers

Speed

2>perating

Fre$uency3

(emory Supply

voltage

'rea

2*in *acage3

1ost

R'( FL'SH

856

microcontroller

64(H, 648

bytes

7 :% 4.5A9 7 pin 8@

*8B956R04 47(H, 6 :% A7 :% 7.55.59 7pin 6/@

L*14678 A(H, 7 :% 564 :% A9 A7pin 7@

!(S5)LS666A 67(H, 648 :% 647:% /./9 677pin 85@

'!#megaA7'/= 64/4(H, 7 :% A7 :% 6.A/.A9 A7pin 4/@

Ta=!$ 7.1 C"a0:"9 " LPC2148 6t; Ot;$0 M0""9t0"!!$0:

Ta=!$ D$:0t"9+

• Speed and memory are better in L*14678 than compared to 856 which are the main

parameters to be considered in our pro"ect.

• #cept cost all other parameters are good in L*14678 when compared to *8B956R04.

• !(S5)LS666A is an advanced microcontroller which is better in all parameters when

compared to L*14678+ but it is easier for beginners to wor with L*14678 as it uses

RIS1+ whereas !(S5)LS666A uses 1omple# instruction set which is comparatively

difficult.

• !he cost of !(S5)LS666A is twice than that of L*14678+ so L*14678 is most

suitable for our pro"ect.



63/69


• ven when compared to '!#megaA7'/=+ L*14678 is better in all parameters with

respect to our pro"ect.



64/69


CHAPTER 8

ADVANTAGES DISADVANTAGES

AND APPLICATIONS

8.1 ADVANTAGES

? 1ost effective system.

? 1ompact system.

? High performance.



65/69


? Low *ower 1onsumption..

? Simple+ fast and easy to implement

8.2 DISADVANTAGES

? &earing the glove taes time and can be $uite cumbersome.

? Human hands vary in shape and si,e. So some users cannot wear these input devices.

? In these systems+ where hand tracing is re$uired+ some type of noise is bound to be

associated with the data.

?

8.3 APPLICATIONS

? 0eveloping aids for dumb people.

? Recogni,ing sign language.

? (edically monitoring patients.

? 1ommunicating in video conferencing.

? 0istance learning @ teleteaching assistance.

? It can be applied on real systems to play games.? 1ould be applied on a mobilerobot control./M



66/69


CHAPTER &

CONCLUSION AND FUTURE

ENHANCEMENT

&.1 CONCLUSION

Sign language is a useful tool to ease the communication between the deaf or mute

community and the normal people. Eet there is a communication barrier between these

communities with normal people. !his pro"ect aims to lower the communication gap between the

deaf or mute community and the normal world. !his pro"ect was meant to be a prototype to



67/69


chec the feasibility of recogni,ing sign language using sensor gloves. &ith this pro"ect the deaf

or mute people can use the gloves to perform sign language and it will be converted in to speech

so that normal people can easily understand.

'fter the survey on the approaches used in various vocabulary based sign language

recognition systems+ we can give opinion about the methodologies involved. !he system is

suitable for static ISL signs. !his system is sufficient to claim a Jworing systemK for native

Indian sign language alphabet. !hus+ the proposed approach will be useful and will have a

sufficient amount of accuracy to recogni,e a hand sign gesture.

&.2 FUTURE ENHANCEMENT

!he completion of this prototype suggests that sensor gloves can be used for partial sign

language recognition. (ore sensors can be employed to recogni,e full sign language. ' handy

and portable hardware device with builtin translating system+ speaers and group of body

sensors along with the pair of data gloves can be manufactured so that a deaf and dumb person

can communicate to any normal person anywhere. In future there can be many possible

improvements that will broaden the scope of this wor.

• *erfection in monitoring and sensing of the dynamic movements involved in

J(icrocontroller and Sensors %ased Gesture 9ocali,erK.

• 9irtual reality application e.g.+ replacing the conventional input devices lie "oy stics in

9ideo games with the data glove.

• !he Robot control system to regulate machine activity at remote sensitive sites.

• 0esigning of wireless transceiver system for J(icrocontroller and Sensors %ased

Gesture 9ocali,erK.



68/69


REFERENCES

6M.*aran"ape :eti 9i"ay+ Caphade Cilashi Suhas+ 1hafear Suparna 1handrashehar \

0eshpande :etai 0hanan"ay+ JRecent 0evelopments In Sign Language RecognitionD '

Review+ 9olume6+ Issue4+ 464+ ISSC 2*rint3D 44)8567.

4M. =lrie Zeshan+ (adan (.9asishta+ (eher Sethna+ JImplementation >f Indian Sign

Language In ducational SettingsK+ 9ol.6A+ Co.6+ 45.

/M. J!he Indian Sign LanguageK+&illiam.*.clar.



69/69


7M. *raveen :umar S Havalagi+ Shruthi =rf Civedita+ J!he 'ma,ing 0igital Gloves !hat Give

9oice !o !he 9oicelessK ISSCD 44/66BA/.

5M.Sushmita (itra and !inu 'charya+ JGesture RecognitionD ' SurveyK+ I !ransactions

>n Systems+ (an+ and 1ybernetics]*'R! 1D 'pplications and Reviews+ 9>L. /)+ C>. /+

('E 4)+ pp. /66/47.

AM. Sansh,ar :ettebeov+ (ohammed Eeasin and Ra"eev Sharma+ JImproving 1ontinuous

Gesture Recognition with Spoen *rosodyK+ *roceedings of the 4/ I 1omputer

Society 1onference on 1omputer 9ision and *attern Recognition 219*R-/3+ IS%C ^ 6A/

AB6B@/+ pp.6A.

)M. (asumi Ishiawa and Hiroo (atsumura+ JRecognition of a HandGesture %ased on Self

organi,ation =sing a 0ata GloveK+ IS%C ^ )8/ 58)6A@BB+ pp. )/B)75.

8M. Farid *arvini+ 0ennis (cLeod+ 1yrus Shahabi+ %ahareh Cavai+ %ahara Zali+ and Shahram

Ghandehara,adeh+ J'n 'pproach to Glove%ased gesture recognitionK+ 4B.

8M. Coor 'dnan Ibraheem+ Rafi$ulZaman :han+ JSurvey >n 9arious Gesture Recognition

!echnologies and !echni$uesK+ 9olume 5Co.)+ uly 464+ ISSCD B)5888).

PROJ REPORT.docx

Documents

Transcript of PROJ REPORT.docx