5 - Brain Controlled LCD Message Display for the Disabled

134
Brain Controlled LCD Message Display for Disabled A Project Study Presented to the Faculty of the Department of Electronics Engineering College of Engineering and Architecture Holy Angel University In Partial Fulfillment of the Requirements for the Degree of Bachelor of Science in Electronics Engineering Peter James L. Buduan Adier D. David Christian Paul M. Dizon Jeric M. Esguerra Arvin Cedric Q. Mallari Jordan D. Manalang Ronald Patrick J. Socorro March 2012

Transcript of 5 - Brain Controlled LCD Message Display for the Disabled

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 1/134

Brain Controlled LCD Message Display for Disabled

A Project Study

Presented to the Faculty of the

Department of Electronics Engineering

College of Engineering and Architecture

Holy Angel University

In Partial Fulfillment of the

Requirements for the Degree of

Bachelor of Science in Electronics Engineering

Peter James L. Buduan

Adier D. David

Christian Paul M. Dizon

Jeric M. Esguerra

Arvin Cedric Q. Mallari

Jordan D. Manalang

Ronald Patrick J. Socorro

March 2012

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 2/134

Running head: BRAIN CONTROL TEXT DISPLAY FOR DISABLED 1

Brain Controlled LCD Message Display for Disabled

Peter James L. Buduan, AdierD. David, Christian Paul M. Dizon, Jeric M. Esguerra,

Arvin Cedric Q. Mallari, Jordan D. Manalang, and Ronald Patrick J. Socorro

Holy Angel University

Author’s Note

The researchers of this thesis and authors of this manuscript are all undergraduate

students in the Department of Electronics Engineering at Holy Angel University.

Correspondence concerning this paper should be addressed to Peter James L. Buduan,

Department of Electronics Engineering, Holy Angel University, #1 Holy Angel Avenue, Sto.

Rosario, Angeles City Philippines.

E-mail: [email protected]

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 3/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 2

Abstract

The study entitled Brain Controlled Message Display for Disabled aims provide an alternative

way of communication, in digital form, for people with disabilities using brain signals. This

study focused on using a NeuroSky’s MindWave headset, a non-invasive type of brain-to-

machine interfacing on which the brainwave patterns such as attention, meditation, and eye blink

are acquired directly on the person’s scalp. The method of this study uses qualitative and

descriptive approaches that evaluate the acceptability of the variables being tested. The variables

considered in this study are convenience, portability, accuracy, and functionality of the

 prototype. The data gathering utilized questionnaires that were given to the selected respondents.

Statistical tools such as mode, range, and inter-quartile range were used to manipulate and

analyze the data. As a result, based on the statistical values obtained from each respondent upon

testing and evaluating the device, the variables namely convenience, portability, and accuracy

showed affirmative response that support the overall functionality of the device. Based on the

results, conclusions were made which state that the brain signals could be used and be integrated

to a computer-independent hardware that could display message. The prototype could help the

disabled to express their thoughts.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 4/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 3

Brain Controlled Message Display for Disabled

Electronics would not function without electricity. Electricity is present in every power

lines and flows through every appliances. It also exists in nature as lightning. Signals may be a

form of electricity, they come in low voltages. These are applied in communications and

switching devices. However, there are signals that are subtle and elusive. These signals have

 become focus of different studies. These are the signals created by minds or the neuron signals

that enables a body to move and make every part of it to function.

The trend in the field of electronics at present moves along swiftly with a purpose of

assisting man to achieve what he sees possible. With tons of thoughts luring him to innovate

ideas, construct conceptions, and develop devices, advanced technology continuously evolves

and its benefits would be rendered to everyone especially to those people having disabilities.

“Your next remote control may be inside your head.” (Vizard, 1996)

The concept of mind control or the acquisition of the brain signals for certain applications

interests many researchers. Today, innovations in the study of neural activities of the brain

enable the mind’s controlling abilities that greatly give development in helping the medical

community.

This technology is mostly used in gaming and entertainment. Some of its software

applications are made and developed to assist children at their learning age. In addition, this new

technology is also being integrated to certain applications that help people control things using

only their minds. In brief, this technology of brain control covers many areas on how to improve

life and make it easy for all. With so many possible applications of this technology, the

researchers of this study thought of a question of what would be a good application for this

technology to optimize its functions and be beneficial to people. By carefully analyzing each and

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 5/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 4

every possible application, the researchers decided to utilize this technology to benefit people

with disabilities in terms of communicating. In that way, the technology of brain control would

 be used to its full potential and, at the same time, address the limited means of communication

among disabled.

By considering the above statements, the researchers decided to render an aid using this

kind of technology. The general idea was to create a device that serves as an alternative means of

communication for people with disabilities specifically those who have stern motor skills and or

speech defects. In contrast to other alternatives of communication for disabled such as sign

language, the researchers wanted to have the project in digital form. In that case the device

would be more useful, easy to understand, and can be ported to other applications. The device

was constructed by interfacing a brain-computer interface into a portable hardware capable of

displaying characters to form a message.

A brain–computer interface or BCI converts brain frequency into an output that interprets

the subject’s thoughts. This kind of communication does not utilize the peripheral nerves and

muscles; therefore it can support people with stern motor skills. BCIs allow patients who are

totally paralyzed or “locked in” by stroke or other neuromotor diseases to convey their thoughts

outside themselves. (Leuthardt, Schalk, Wolpaw, Ojemann& Moran, 2004)

There are two methods of BCIs, invasive and non-invasive approach. In an invasive

method, BCIs use a single neuron operation that is monitored inside the brain and produces a

higher space resolution and render signals that have higher degrees of movement compared to

non-invasive. However, non-invasive BCIs have electroencephalographic pattern acquired

directly on the scalp. According to Leuthardt et al. (2004), this approach is safe, convenient to

use, and inexpensive.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 6/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 5

Existing studies about BCIs allow the porting of the technology to another application

specifically in communication. A study entitled “A predictive speller for a Brain-Computer

interface based on motor imagery” by Tiziano D’Albis in which its target users are people with

“locked-in” syndrome uses an electrode cap BCI to type into the computer with a built-in

 predictive input feature. (D’Albis, 2009). Another study called BrainGate lets the user’s mind to

control the computer. It captures brain waves via a chip which is implanted in the brain for

accurate frequency detection. It can move a mouse pointer, click an icon, type within the

onscreen keyboard, and play games. In addition, the company that is responsible for the

BrainGate research has a goal to develop a program that would allow people with amputated

arms and hands to control an artificial hand again. (BrainGate, 2008). These studies utilize an

invasive method of BCI. In addition, computers and software applications are being used to

accommodate the function of the BCI.

The BCI used in this study was NeuroSky’s MindWave. This non-invasive BCI has one

sensor that can sense three brainwave patterns and have a proprietary algorithm for

characterizing mental states in which they call it as “eSense™”. Attention, meditation and

 blinking are the three brainwave patterns that can be detected by this BCI.

Attention eSense determines the user’s mental focus or the level of attention. As the user

concentrates, the value increases ranging from 0 to 100. Distractions and wandering thoughts can

lower the value of the Attention level.

For the meditation eSense, the intensity of relaxation of the mind is measured. It pertains

to calmness, example of which is the state of mind when sleeping. The value can be increased by

closing one’s eyes and acting as if the user goes to sleep. Blinking, from the word itself, is

related to blinking one’s eye or both eyes. From NeuroSky’s point of view, the longer the blink

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 7/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 6

duration, the higher the value of blink strength. Fast blinks have lower blinking value and vice

versa. However, specifically for this study, the blink value was made boolean. The value is true

if the headsethas detected a blink, otherwise it is false.

The researchers focused on the non-invasive method of the BCI for it complies with the

requirements of the project in attaining the desired output. The project applied the function of an

EEG headset that became the communicator between the user and the light emitting diode (LED)

matrix that controls the selection of characters to display it on a liquid crystal display (LCD).

This study specifically aims to create a personal computer (PC)-independent device that is

convenient, accurate, and portable.

These components are the necessary blocks in conceptualizing the project. The concept is

to create a hardware that displays text on an LCD using human thought. An LED matrix that is

 programmed by a microcontroller is used as the final control in getting the command from the

BCI before an output would be displayed on the LCD. The BCI deciphers the acquired signal

from the brain which correlates to a specific pattern.

For this study, it uses an Arduino which is an open-source microcontroller platform

 powered by an Atmel microcontroller with bootloader. The boards can be purchased online or

 built by hand. The schematic diagram and hardware reference designs can be downloaded at

their website (http://www.arduino.cc) or refer to Appendix A. The said platform comes with

different hardware versions which include the two major: Uno and Mega 2560. Other versions

include Mega Android Development Kit (ADK), Nano, Pro, Fio and etc. The Mega 2560 version

features a total of 54 Input/Output (I/O) pins. It also includes 4 serial ports, 16MHz clock, and

256KB flash memory. For full details with this version, see Appendix B for its datasheet.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 8/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 7

This study is limited on using a non-invasive method of brain-to-machine interfacing. It

includes programming knowledge about Arduino’s C++ based programming language on the

micro-controlling part. It covers as well the acquisition of three mind patterns namely: attention,

meditation, and blinking. The first two was done by MindWave headset and the latter was

 processed by the microcontroller. In lieu of using laptop and software to process the data

acquired from the brain, researchers have focused on interfacing the EEG headset into an

Arduino microcontroller using a wiring language. In addition, disabled people, excluding blinds,

who have speech defects and stern motor skill are the intended users of the device.

The researchers did not choose other available mind patterns sensed by other EEG

headsets (e.g. Emotiv) for the reason that three channels are enough to control the LED matrix.

Hence, the more channel and sensors the EEG headset has, the more complicated it is to

interface. Availability, time, and simplicity are the factors considered by researchers for them to

conduct the study.

With these ideas combined altogether, the brain controlled communication would enable

 people with speech defects, disabilities, and poor motor skills to express what they are thinking

and what they want to say. Using this portable device, people with this kind of disabilities would

allow them to interact with other people conveniently and effectively.

Considering the facts and overviewing the current trend with regards to the brain

controlling technology, the researchers have conducted the study. The theoretical framework on

Figure 1 shows how the said technology is being used and how the study is being limited to

certain users. There are few means of communication among certain people having disabilities in

terms of speech and motor skills. Likewise, there are only few ways and available technologies

that could address alternative way of communication among these people. One technology that is

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 9/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 8

 possible to do is the BCI technology. Mind's controlling technology today is mainly used for

gaming and entertainment, which are in demand and more highly commercialized in the market.

All BCIs in today's market are software dependent. Brain to hardware interfacing is hard to

implement without using laptops with its included software. Theories supporting the possible

results came from researchers’ view and understanding on the field of electronics. The results

 point towards the general objective on which the study wishes to address.

Taking into account the principles and materials needed on the collation of the prototype

as a whole, a simplified model has been made. Figure 2 represents the system and shows a

conceptual framework that was made upon logically analyzing the effects and uses of each

concept and hardware, based on the researchers’ percept.

Based on the gathered information about the components used in this study and on how

to integrate those using a programming language, the researchers came up with hypotheses that

the prototype is suitable and convenient to be used by disabled and that the familiarity in using

the device affects the accuracy of character selection.

Upon synthesizing the design and examining the system, researchers have come up with

variables that include functionality, convenience, portability, accuracy, adaptability, and usability

which all became the groundwork of the study. Each and every variable was tested, manipulated,

and analyzed using sets of questionnaires given to the respondents upon having the pilot testing

of the prototype. Monitoring the respondent upon using the prototype was used to gather

significant data.

Subsequently, the data obtained in the questionnaires and other tools were then analyzed

to determine the prototype’s overall functionality. Figure 3 represents the operational framework.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 10/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 9

Considering the effects of the variables on the system, it is predicted that the overall

functionality would be positively correlated with theaccuracy, and convenience. Hence, a failed

functionality leads to a failed prototype. The process of analyzing and testing the variables

comprised of conducting a pilot test on each of the respondents. The selected respondents were

given a questionnaire accompanied with a rubric to gather the data.

With these variables properly tested and analyzed, this study is viable to provide a

hardware that displays characters on a display by controlling the LED matrix through brain

signals that could help people with disabilities in speech and motor skills to communicate as

another alternative mean.

Methods

Research design

The Brain Controlled Device has four systems involved which are the

Electroencephalography (EEG) headset, the microcontroller, the Light Emitting Diode (LED)

matrix, and the Liquid Crystal Display (LCD).

In the LED matrix, there is a selection of characters. The user selects a character by

focusing and blinking. The requirement for the character to be selected is by blinking twice.

There is a corresponding brain signal pattern on every state of mind. This signal is sensed

 by the EEG headset, which would then be transmitted to the USB dongle wirelessly. The dongle

connected to the Arduino microcontroller processes the data. The characters selected are then

displayed on the LCD.

The study uses qualitative approach and descriptive method that attempt to evaluate the

acceptability of each variable. These variables are then analyzed to validate the hypotheses that

have been stated.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 11/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 10

The study was tested considering the following variables: functionality, portability,

convenience, accuracy, adaptability, and usability. Functionality is the overall factor where the

display can be understood by the viewer, thus it accomplishes in producing the correct output

without encountering device errors. The portability pertains to how easy the device is to carry

from one particular place to another. Convenience is based on how easy and comfortable the

device is to wear and use. On the other hand, accuracy is based on the control of the LED matrix

if the device responds considerably to the attention and series of blinks put by the user.

Adaptability is the familiarization of the user to the device and it pertains to the ability on how

much time the user needs to get used to the device. Usability of the device is based on the

capability of the disabled to use the device.

Sources of data 

The way of gathering data was the indirect or questionnaire method. In this method, a

questionnaire is given to the respondent personally after a pilot testing so as to gather feedback

and data that evaluate the test variables.

The questionnaire comprised of different questions that describe each of the variable’s

characteristics. Each question is a closed-ended type of question answerable by the rubric that

was set. The questionnaire used a Likert Scale with is a 5-point scale. Likert scaling is a

 bipolar scaling method which measures either positive or negative response to a question. A

typical question using a Likert Scale poses a statement and subsequently asks the respondent

whether they Strongly Agree - Agree - Undecided - Disagree or Strongly Disagree. (Bertram,

2011)

There were two sets of questionnaires distributed to two different set of respondents. The

first set of questionnaire was used to gather data concerning the convenience, portability, and

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 12/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 11

accuracy of the device (see Appendix C). The second set, on the other hand, was made so to

evaluate the efficacy of the prototype whether it aids in conveying a message of the disabled

 person (see Appendix D).

Prior to evaluating the device, interview among the respondents/professionals with the

most experience and involvement to disabled was conducted. In this method, an interview guide

was made by the researchers to extract the information needed to support the results obtained

upon evaluation of the device (see Appendix E).

Participants

Purposive sampling was done twice to have two different sample sizes to form two

groups of respondents. The first group, considering error of 30%, comprised of five professionals

from the population which consist of full-time instructors from electronics (6), mechanical (3)

and psychology (1) and part-time instructors from electronics department (3) from Holy Angel

University. The population includes teachers (3) from hearing impaired department from SPED

Angeles Elementary School. The Slovin’s formula for finite population was used for the

computation of the sample size:

n = no / (1+ ((no – 1) / N ) ; no = N  / (1 + Ne2)

where:

n = sample size

 N  = population sizee = error

The chosen professionals consist of one instructor teaching children with disabilities, one

 psychology instructor, two electronics engineers, and one mechanical engineer. The first two

 professionals mentioned were the ones interviewed since they have the sufficient knowledge and

experiences in dealing with disabled. The interview was done to make the decision of

recommending the device to the disabled more reliable. The first group addresses the variables

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 13/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 12

convenience, portability and accuracy. The second group, on the other hand, is comprised of two

 people with speech and hearing disabilities. Only two disabled were allowed by the Hearing

Impaired Department to participate in the testing and evaluation of the device since the

administration of the said department has to be strict with regards to their student’s schedule.

This group validates the usability of the device.

Instruments

Three instruments were used in this study. First is the prototype and the Arduino’s

Integrated Development Environment (IDE). The second is the instruments used in gathering

data which are the questionnaires and interview of the professionals. And lastly are the statistical

tools such as mode, median, range and inter-quartile range used in interpreting the data gathered.

The main system of the device is the Brain-Controlled Interface (BCI) which is the EEG

headset. The headset is capable of sensing brain signals equal to a certain thought. These

thoughts are then converted into signals that can be read by computers.

The MindWave EEG headset has a Software Development Kit (SDK) for making

 programs or software with different platforms like Windows, Mac OSX, Android, iOS, Xbox,

and etc. As of this writing, v2.1 is the latest version of the SDK.NeuroSky develops its own

shared library for different platforms. These libraries are closed source and proprietary. For

Arduino platform, the processes and formulas in the shared libraries must be emulated.

 NeuroSky released a brief tutorial on how to connect the MindWave to Arduino.Also, NeuroSky

released the protocols on how to access the data outputted by the MindWave EEG headset.

The Arduino microcontroller is the processing unit of the system. It contains Atmel

microcontroller, which is programmed using C++ based wiring language.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 14/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 13

A questionnaire that was distributed to the respondents tends to evaluate the variables

mentioned in this study. As for the interview, open-ended questions were provided by the

researchersto be answered by two of the mentioned professionals. The interview tends to gather

information about the background and significant experiences of the professional with disabled

 people.

Statistical tools such as mode, range, and inter-quartile range were used. The mode of a

data sample is the element that occurs most often in the collection. The median is the middle

sample arrange chronologically and mean is the average of all the samples. These are statistical

methods which calculate and measure central tendency (Acelajado, Blay & Belacina, 1999). In

this study, mode and median were used to evaluate the variables convenience, portability and

accuracy. Mean was used to evaluate adaptability. The measure of central tendency is a

numerical descriptive measure which indicates or locatesthe center of distribution data.

Range and inter-quartile range are measurement of variability and diversity. It shows how

much variation or dispersion there is from the center or expected value. This is used as well in

comparing sets of data which may have the same center value but a different range. A low

measure of variation entails values which are not spread out too much that suggest good results.

Procedure

Software Simulation

Before making the actual prototype, the researchers made a software simulation of the

actual device. The software was programmed using Microsoft C# .Net using NeuroSky’s .NET

shared library (ThinkGear.dll). The operation of the software simulation is fundamentally the

same with the actual device. For the graphical user interface layout, refer to AppendixF and

Appendix G for the source code.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 15/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 14

Hardware

For the prototype, the device is made up of five major components: LED matrix board,

LCD, setup buttons, power supply and switch, the Arduino, and MindWave wireless USB

dongle. All of the components are connected to the Arduino. AppendixH shows the

componentlayout of the system.

The LED matrix board was sketched using KiCad. AppendixI shows the LED Matrix

 board schematic diagram. The matrix board contains the main matrix with 42 LEDs organized

into 6 LEDs horizontally and 7 LEDs vertically. These LEDs are connected to a common

cathode. The board also contains the attention gauge with 5 LEDs as its meter, and the two LEDs

for direction indicator whether for horizontal or vertical.

For the LCD, the LM052L model was used. It is a 2 by 16 monochrome character LCD

 based from Hitachi LCD model. Appendix J shows the LCD datasheet. The LCD is attached to

the top section or upper portion of the LED matrix board.

There are 3 control buttons for the device. These are called the setup buttons. They are

used for the setup configuration mode which runs every time the device is turned on. The first

two buttons are for selecting Yes/No, or increment (+) /decrement (-) values. The third one is the

confirmation or OK button.

The MindWave headset was linked on the serial UART of the Arduino through wireless

USB. However, the USB dongle outputs USB packets which are different with the serial

transistor-transistor logic (TTL). To acquire serial TTL, the connection is tapped within the serial

TTL part of the dongle, just right before it would be inputted on the serial-to-USB TTL chip.

Tracks connecting the Serial TTL to the Serial-to-USB TTL chip was disconnected using a small

cutter. AppendixK shows the diagram of the USB dongle with its parts where the serial TTL

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 16/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 15

connections are located as well as the tracks to be disconnected. The serial TTL part of the

dongle is connected to the serial UART ports of the microcontroller which includes the receiver

(Rx) and transmitter (Tx). However, the dongle uses 3.3 volts for logic high while Arduino uses

5 volts, and so a voltage divider is added for transmitting data from Arduino to the dongle.

Software

The microcontroller was programmed using Arduino’s Integrated Development

Environment (IDE). The version that was used is alpha 0022. Arduino programming language is

a based on C++. To speed up the programming for the LCD, the LiquidCrystal.h library was

included in the program.

The MindWave transmission from the headset to the dongle operates based on its own

Radio Frequency (RF) protocol. NeuroSky released documentation on how to operate the RF

 protocol such as disconnecting and connecting to a MindWave headset. Each headset has a

specific 2-byte Global Headset ID to distinguish one headset to the other. For this system, it uses

the auto-detect/connect headset, and disconnect command. The auto-detect command will search

an available headset around the dongle’s coverage area (NeuroSky, 2011). This ensures that any

MindWave headset is compatible with the system, as long as there is only one headset within the

dongles’s coverage area. Otherwise, it will select and connect based upon the first unique ID

generated and detected. Refer to Appendix L for the documentation.

Connection between the MindWave dongle and the microcontroller is being governed by

a protocol. NeuroSky published MindSet Communications Protocol to guide programmers in

developing applications using MindSet and MindWave (NeuroSky, 2010). MindSet is another

 product of NeuroSky which is identical to MindWave. The protocols in the said devices are

similar, and so the MindSet Communications Protocol were as well became a reference for the

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 17/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 16

MindWave (NeuroSky, 2011). The protocol documentation includes the packet structure and

instructions on how to parse it. The packet is sent using asynchronous transfer in a serial way. It

includes a header, payload, and checksum frames. A parsing code was made to get the values

from the serial UART. See Appendix M for full documentation.

Payload contains the attention, mediation, raw data, and other unnecessary data for this

study like gamma, alpha, beta waves, and etc. However, the payload data cannot contain all of

those variables. The attention and meditation packets are being sent once every second, and the

raw data is being sent 512 times a second. When there is raw data, other values are not present

on the payload.When the attention and meditation is present, the raw data is absent on the

 payload. The microcontroller receives the packet data and sorts the packet to attention code,

meditation code and raw data. Blink code is not included in the packet being sent and therefore

must be derived from the raw data. Raw data consists of 2 bytes and it is a signed 16-bit integer

that ranges from -32768 to 32767. The first byte represents the higher order bits in two’s

complement form. The second 8 bits, on the other hand represents the lesser in order bits.

Therefore the whole raw data can be reconstructed using the formula:

raw = raw1*256 + raw2;if ( raw >= 32768 ) raw = raw - 65536;

A code is made in order to get series of raw data that would be plotted and observed in order to

determine the characteristic of the wave when blinking occurs. See Appendix N for the brief

 preview of the code. The data are plotted in Microsoft Excel and then been analyzed. See

AppendixO to see the waveform of the raw data plotted. As observed, there are 13 waves that

have higher amplitude for 10 blinks in simulation. The excess 3 wave forms are noise and must

 be filtered out.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 18/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 17

The Arduino was programmed to first display a setup mode on the LCD. This was put so

to ensure customizability for different persons with different range of preference on using it.

First it will ask if the user is willing to enter the setup. Selecting no will automatically set the

variables to their default value and continue to the main program, and selecting yes will continue

to the custom setup. The first setup is the LED movement of selection speed. The default value is

700 milliseconds. After the confirmation, next is the second setup which is the blink pause

duration with default value of 1500 milliseconds. It refers to the time allotted for the LED

selection to pause from moving when blink is detected. This delay was made to wait whether

there is a second blink or no blink. The third and last setup is for the minimum attention level for

the LED selection to move. It has a default value of 30%.

These default values were obtained by a pre-test done by the researchers themselves upon

completion of the prototype. The test aimed to know the value of the LED movement speed,

LED selection pause, and attention level at a desired point where they feel more convenient in

the first few trials of using the device. Each member of the research team tested the device using

different values in the setup-mode. After which, they discussed the level of convenience they

experience upon using the device. As a result, which is based on the consensus, the most

convenient setup for LED movement speed, LED selection pause, and attention level is 700ms,

1500ms, 30% respectively. Since the result is merely based on a decision agreedby the

researchers, and relies more on opinions, the default set-up therefore is set to be changeable.

However, for the sake of making the pilot testing on the respondents more practical and simple,

the agreed default values were used.

Figure 4 shows the designed character layout of the LED matrix. The letters are arranged

alphabetically and the numbers in ascending order. The matrix includes as well full words such

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 19/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 18

as FOOD, CR and WATER. Initially, the horizontal LED indicator and the FOOD are selected.

The value of the attention code is displayed via level gauge using LEDs. Each gauge LED

represents 20% of the attention level. Five LEDs is equivalent to 100% attention level. If the

attention level is greater than or equal to the set level, the character selection LED shiftsand

loops from left to right if the horizontal LED is activated, or from up to down if the vertical

LEDis activated. When the attention level is less than the set level, the shifting and looping LED

character selection stops. Single blink is considered as a toggle between horizontal and vertical

direction. The LED selection pauses for a while upon blinking for a duration based on the set

value. Double blinking means selecting the character and displaying it on the LCD screen. The

devices and processes used can be seen on Appendix P.

Upon completion of words to express, there is a selection to hold the display. This feature

makes the word/s formed to be read-only and cannot be changed or erased. Selecting the hold

LED toggles its function. Other features include the clear-all function which can be activated

once the user’s meditation level reaches 100% for two consecutive seconds. This can also be

accessed via selecting hold andselecting backspace afterwards. For the prototype’s source code,

refer to Appendix Q.

 NeuroSky’s published MindWave User Guide can be seen on Appendix R.

Test Procedures

The first group of respondents was composed of professionals who have been selected by

the researchers in assessing their capability to tell whether the device is functioning properly or

not. The second group, on the other hand, was composed of people with disabilities specifically

on speech and hearing to know whether the device could be helpful to their condition or not. All

of the respondents participated individually upon testing of the device.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 20/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 19

Two tests were conducted. The first testing was done by the five professionals, on which

two of them were interviewed prior to the demonstration and pilot-testing of the prototype.

Demonstration on how to use the device was performed by a member of the research team to

 provide the respondents the basics on how to use the device. A full detailed instruction on how to

operate the device can be found on Appendix S. Then, pilot-testing of the device was done by the

respondents and they were given several minutes to explore the device for the first use. After

 being adjusted to the device and making sure that the blink and attention they put correspond

accordingly to the operation of the device, they were given three tasks to display certain words

on the LCD. The first task is to display the user’s name. The second taskis to display the word

“THESIS” three times, and the final task is to redisplay the user’s name. The time that was taken

 by the user to complete each word was recorded. The recording, by the use of a stopwatch, starts

after the first letter of the word was displayed. These tasks were conducted to determine the

user’s adaptability with the device or, in other words, the time it takes for the user to get used to

the operation of the device.

After the pilot-testing, a questionnaire was given to the professionals which evaluates the

variables convenience, portability, and accuracy. In addition, the two professionals were then

asked, as part of the interview, a final question that determines whether the device is

recommendable to be used by the disabled or not.

The second testing was done by two disabled. The demonstration of the device was

conducted by one of the professional who knows sign language since the two disabled have

hearing defects. After demonstrating, pilot-testing of the device was done by the disabled and

was given thirty minutes to explore and use the device with the assistance of the professional.

Unlike the first group, the disabled were free to use the device and display whatever word/s they

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 21/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 20

think. A questionnaire was given to the disabled after the pilot-testing that evaluates the usability

of the device to them. Table 5 shows the raw data gathered from the questionnaire for disabled.

The data and collection that were obtained and gathered were used to analyze the

variables being tested to obtain results and further draw conclusions.

Data analysis

The recorded time of completion per letter was analyzed by applying mean or average.

The time per character of the Task 3 was compared to the mean value of the time per character of

Task 2 and the value on Task 1. The user is asserted to improve if he/she satisfies the condition:

time of Task 3 < mean time of Task 2 < time of Task 1 and. This indicates that a user is able to

select and display a message faster once he/she gets used to the device.

The data gathered from the questionnaire for professionals were coded as follows: very

much disagree = 1, disagree = 2, neutral = 3, agree = 4, and very much agree =5.

The data were subjected into computation using descriptive statistics: median and mode.

However, mean was not used for the reason that the data collected have inherent order or

sequence. One cannot simply assume that the difference between agreeing and strongly agreeing

is the same as between agreeing and being undecided. High values of median and mode that

range from 4 to 5 indicate that the user has positive response to the statement.

The variability was measured using range and inter-quartile range. The result obtained

was then used to observe if the data are clustered together and if they do not deviate from each

other. A value of 1 and 2 for the range and inter-quartile range indicate close results among the

respondents. Upon obtaining the mode and range of the data, the ungrouped data were presented

in tabular method for better presentation and analysis.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 22/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 21

On the other hand, the data gathered from the people with disabilities were examined

using percentage. This analysis was concerned on knowing their evaluation of whether the

device would be useful to their condition. There was no acceptance range to be considered for

the percentage obtained since there were only two respondents involved. The results were

subjected to the analysis of what improvement could be made with the device.

However, there was no inferential statistics applied on the data since the research project

is a pioneer and there is no previous data that to be compared with.

The information from the interview among the two professionals was used to support

their conclusion upon evaluating the device.

Results

The results obtained attempts to assert the hypotheses of the study and measure using

statistics the variables convenience, portability, accuracy, adaptability, and usability. The results

of the interview and tests are presented as follows:

Interview

The two professionals who underwent interview provided sufficient amount of

information regarding their background and experiences in dealing with disabled. Ms. Alice, a

teacher of disabled, has been teaching students with disabilities for the last 12 years and she

could to communicate with them and teach them through sign language. She added that there is a

 big difference between teaching normal students and students with disabilities. Her experiences

with the disabled through time made her realize that the technology today could help the students

with disability to interact and learn. She recommends the device to be used by students provided

that they are mature enough to understand somewhat the technology. Ms. Karen, on the other

hand, is a psychology instructor who has been practicing her profession for the last 9 years.

Similar to Ms. Alice, she as well had experiences interacting with the disabled. She had observed

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 23/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 22

that a person with hearing problem is having a difficulty in giving correct pronunciation of a

word since the sound gets distorted upon entering the person’s ear. She stated that the device

could be beneficial to people especially when they encountered accidents wherein they could not

talk or use their hands to communicate. She recommends the device to be used by the disabled as

long as the person knows how to write and spell. Appendix T shows the documented interview

questions with answers.

The answers given by the two professionals were found to be favorable. The information

on experiences and background were well stated which supports the validity of the evaluation of

the device.

Completion time test 

This test evaluates the variable adaptability or the capability of the user to get used with

the device over a period of time.There were three tasks in this test, first is to display the user’s

name, the second is the display the word “THESIS”, and lastly redisplay the user’s name. The

test records the time it takes for a user to display certain words. Refer to Table 1 for the time

data. The first respondent displayed the word “REYNILAN” which consist of 8 characters. The

respondent was able to complete the word without error or using backspace. It took him 1 minute

and 32.9 seconds to complete the word. By using average, the time per character is computed

that has a value of 11.61 seconds. For the second task, the time per character of trial 1, trial 2,

and trial 3 are 8.18, 9.57, and 6.67 seconds respectively. The final task recorded a decrease in

time per character. The respondent took 52.9 seconds to complete the word “REYNILAN” and

the time per character is 6.61 seconds. The second respondent had used 3 backspaces for the

Task 1 that was added to the number of characters. The time per character for Task 1 is 21.97

seconds. For Task 2, the three trials have time per character of 7.38, 7.94 and 7.75 seconds in

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 24/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 23

order. The respondent made a decrease of time per character for the last task; the value is 7.28

seconds. Respondent number 3 took 36.9 seconds to complete the word “CHERRY” for Task 1

with a time per character of 6.15 seconds. Trials 1, 2, and 3 of Task 2 recorded a time per

character of 7.67, 8.25, and 6.95 seconds respectively. For the third task, the respondent had an

increase of time of completing the word “CHERRY” and a decrease in time per character, the

time is 46.2 seconds with a time per character of 5.78 seconds. The fourth respondent showed a

slight increase of time per character in Task 3, from 8.01 seconds of Task 1, to 8.22 seconds of

Task 3. For Task 2, the trials 1, 2, and 3, have a time per character of 11.22, 12.89, and 6.28

seconds respectively. The last respondent displayed the word “ALICE” for Task 1 which took

40.5 seconds with a time per character of 5.79. Trials 1, 2, and 3 recorded a time per character of

14.12, 7.80, 14.37 seconds in order. The last task performed by the last respondent recorded a

high increase of time and time per character with values of 1 minute and 49.6 seconds, and 12.18

seconds respectively.

The data shows that the 3 out 5 respondents recorded a decrease in time of completion

and time per character of Task 3 as compared to the values in Task 1. The result favors the

variable adaptability. The summarized mean time of every respondent for all three parts can be

seen on Table 2.

Convenience, portability and accuracy test

This test mainly assesses specific variables namely convenience, portability, and

accuracy. Refer to Appendix C for the questionnaire. Refer to Table 3 for the results. In

convenience, three out of five respondents rated the ease of wearability of the headset as very

much agree. One of them however, was neutral with that question. Four out of five respondents

agreed that the headset is comfortable to wear, and one very much agreed. As for the

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 25/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 24

comprehensibility of the instructions, three of the respondents graded it as agreed and two very

much agreed. On the other hand, in terms of portability, three of the respondents very much

agreed that the prototype is easy to carry. With regards to the weight of the device, four of them

very much agreed that the device is lightweight. Lastly, in terms of accuracy, four out of five

respondents rated the accuracy of blinking once and focusing as very much agreed. On the other

hand three of the respondents agreed that selecting the character or double blinking is accurate.

The data shows that the rating given by the respondents mostly lie on agree and very

much agree which renders good results that satisfy the variables. The summary of the raw data

gathered from the first group of respondents were summarized in Table 4.

As seen in Table 4, the values of mean and mode in each category/variable are high. The

range and inter-quartile range have values lying between 1 and 2.

Usability test

This test participated by the two disabled tends to utilize the data from the questionnaire

for disabled. The questions listed in the questionnaire require a YES or NO response. The data

obtained were then measured using percentage. This test attempts to determine the capability of

the disabled to operate and use the device. Refer to Table 5 for the raw data results. Refer to

Appendix D for the questionnaire. On wearability, both of the disabled responded YES. Same

was true with the comprehensibility of the instructions, and the ease of controlling the device

after getting used to it. The two respondents/disabled marked the ease of familiarization of the

letters, features/shortcuts and settings, and the capability of the device to display the disabled

thoughts as YES. In terms of the ease of controlling the device at first, the one of the disabled

responded YES while the other one responded NO.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 26/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 25

The data shows that both disabled responded YES on all the questions except for

the third question which is the ease of controlling the device at first. Refer to Table 6. The data

coded in Table 6 shows the percentage of the number of YES response of each disabled to the 6

statements in the questionnaire. One of the disabled rendered 100% YES response on the

questionnaire. The other disabled, on the other hand, rendered 83.33% YES response. The

average YES response by both disabled is 91.67%.

Discussion 

The overall findings is favorable to the validity of the hypotheses of the study which state

that the device is suitable to the disabled and is convenient to use; and that the familiarity and

adaptability of using the device affect the accuracy of selecting the characters. Evaluation,

interpretation, and highlights of the findings that attempt to compromise the variables as well as

the objectives are as follows:

Interview

As seen in the results of the interview, necessary facts about the professional’s

experiences affirm the reliability of the professional to recommend the device to the disabled.

Personal observations accompanied with years of experience support their expertise in dealing

with people with disabilities. This well-stated information extracted from the interview validates

the recommendation of the device to the disabled.

Completion time test

In this test, the results of individual testing were predicted to have different values. The

reason is that all the words that were asked to display were not uniform to each respondent. The

test concerns the improvement in time of the respondents by using device despite of their

different level of adaption to the device. As observed in the results in Table 2, respondents 1, 2,

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 27/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 26

and 3 showed improvements in terms of displaying words/letters using the device since the time

 per character in Task 3 is less than the average time per character in Task 2 and the time per

character in Task 1. A decrease in time per character indicates fast forming of words.

Respondents 4 and 5 did not satisfy the condition. However the two respondents cannot be

asserted as a failure or no progress at all since some of the trials in forming the word “THESIS”

shows a decrease in time of forming it which somewhat establishes improvements. Factors such

as accidentally selecting undesired characters and mild stress in the head caused by too much

focusing add up to the hindrance the user experiences upon forming a message. In addition, the

nonuniformity of the words being formed such as the user names affects the adaptability of the

user since the longer the name, the more the user gets used with the device. Considering these

facts, the researchers would want to propose for future research similar to this study a more

composite test procedure and data gathering tools in terms of proving adaptability to obtain more

reliable findings. Same time taken on exploring the device for the first time should also be

considered.

The overall findings imply that the performance of the device depends on the user’s

ability to adapt to the device, and that it could affect significantly the operation of the device.

Based on the results that three out of five respondents rendered improvements as they use the

device throughout the test, it therefore justifies the variable adaptability.

Convenience, portability and accuracy test

The findings on this test support the hypothesis which proposes that the disabled is

suitable to use the device. These findings tend to assert as well the variables convenience,

 portability, and accuracy. As seen in Table 4, for the category of convenience, the values for both

median and the mode are four which is high. These values were expected and suggest good

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 28/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 27

response that the prototype is convenient to the user. In addition, the range and inter-quartile

range were both 2 which is small. These values indicate that the deviation was not significantly

large. This suggests that respondents have responses that are close to each other. As for the

category of portability, having a median and mode of five means that all the respondents very

much agreed that the prototype is portable. For the category of accuracy, both median and mode

have values of 5 which mean that all respondents very much agreed that the prototype is

accurate. The value of range and inter-quartile range for both portability and accuracy is 1 which

is small and supportive to validating the portability and accuracy of the device. The researchers

have observed that factors such as the form of the head, hair, and devolving of forehead skin due

to ageing affect the convenience of the user operating the device. Since the study is a pioneer and

no results or data could be compared to, the researchers have suggested, for future research

similar to this study, to test many and different categories of persons in terms of age, head size,

etc. The questionnaire might have many questions to make the results more reliable.

The affirmative findings implicate that the disabled could be suitable to the device since

the professional who have operated it showed good and high level of convenience and accuracy.

As seen in the interpretation, the results therefore justify the validity of the variables

convenience, portability, and accuracy.

Usability test

The usability test done by the disabled using percentage tends to address the objective of

the study which is to provide an alternative means of communication using brain signals. This

test as well determines the usability of the device to the disabled. Based on the results seen on

Table 6, one of the two respondents rendered a NO response to the third question which concerns

the ease of control of the prototype at first use. Both of the disabled were expected to answer a

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 29/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 28

 NO response to the third question since the disability, based on the interview of the two

 professionals, affects the level of comprehension of the disabled that affects the operation of the

device. Factors such as excitement and enjoyment of the disabled using the device affect his

 judgment on the evaluation of the prototype. Since the study is new, there are no results or data

that could be compared with. Seeing these facts, the researchers have suggested, for future

similar study, to consider further testing on the usability of the device. This includes increasing

the number of sample size of the disabled considering different types of disabilities or might as

well consider people who have been accidentally paralyzed and unable to talk, or people who

have a stroke. The overall YES response for the usability of the device is 91.67%. This suggests

that the device could effectively be used by the disabled to communicate. Although, the findings

indicate room for improvement for future study.

The implication of the findings to the study is that the device could be used by the disable

to communicate. However, the usability of the device varies with different kind of disabilities

and different ages that affect their level of comprehension. In addition, the results imply that one

requirement for the disabled to use the device is to know the alphabet. Considering the

interpretation to the positive results of this test, the objective was satisfied.

Conclusion

Upon completing the construction of the prototype and upon analyzing the data gathered

from the respondents, and upon interpreting the results, the researchers have concluded the

following:

1.  Brain frequency signals could be used and be integrated to a PC-independent hardware

that could display message.

2.  That the prototype could help people with disabilities to express what they think.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 30/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 29

3.  The non-invasive headset is suitable for the disabled. The sensor only needs to have a

 proper contact to the user’s forehead. The prototype as a whole is convenient to use and

is portable

4.  Adaptability and familiarization of the user to the device are crucial factors that affect the

accuracy and speed of character selection.

5.  The time that a user spends to get used to the device is not quite long. The more time the

user spends in using the device, the easier it would be for him/her to express his/her

thought through the device.

6.  The prototype is an alternative way of communication that could be used by disabled and

the fact that it is made in digital form allows it to be developed further in the future

Recommendation

The following are the recommendations suggested by the researchers themselves

upon completion of the study for the improvement of the prototype:

1.  Integrate a GSM module in the device that would allow the user to send the message that

he/she made using the device. That the prototype could help people with disabilities to

express what they think.

2.  Add speaker for another feature that would speak the displayed word or phrase, though

this would eat most of the program space.

3.  Different headsets that acquire brain signal patterns could be more developed in the

future. A more advanced headset could be integrated to the device with more brain

 pattern detection aside from attention, meditation, and blinking.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 31/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 30

References

Acelajado, M., Belecina, R., Blay, B. (1999). Mathematics for the new millennium, 5, 28, 31, 50-

51, 73-78. 

Arduino Homepage. (2011). Arduino. Retrieved August 20, 2011, from http://www.arduino.cc/

Brain-Computer Interface (n.d.). Retrieved July 22, 2011, from Wikipedia:

http://en.wikipedia.org/wiki/Brain-Computer_Interface

D’Albis T. (2009). A predictive speller for a Brain-Computer interface based on motor imagery.

Retrieved March 6, 2012, from http://www.slideshare.net/tizyweb/a-predictive-speller-

for-a-braincomputer-interface-based-on-motorimagery

BrainGate (2008). BrainGate, Wired For Thought. Retrieved March 6, 2012, from

http://www.braingate.com/thought.html

Charras, J. (2010). KiCad build 2356 [Software]. Retrieved from KiCad: http://iut-tice.ujf-

grenoble.fr/cao/

LikertScale(2011). Retrieved August 15, 2011, fromDane

Bertram:http://poincare.matf.bg.ac.rs/~kristina//topic-dane-likert.pdf

Emotiv (2009).New & enhanced detections. Retrieved August 19, 2011, fromhttp://emotiv.com/forum/messages/forum4/topic154/message1613/?phrase_id=278791#

message1613

Kuhnel, C. (2001). BASCOM Programming of microcontrollers with ease: An introduction by program examples. Universal Publishers. pp. 114–119.

Leuthardt, E. C., Schalk, G. S.,Wolpaw, J. R., Ojemann, J. G., & Moran, D. W. (2004). A brain– 

computer interface using electrocorticographic signals in humans. Journal of Neural

 Engineering 163–71.

Microsoft Corporation (2007). Microsoft Visual Studio 2008 [Software]. Retrieved from

Microsoft Corporation: http://www.microsoft.com/visualstudio/en-us/buy

MindSet data types (n.d.). Retrieved August 15, 2011, from NeuroSky Developer:

http://developer.neurosky.com/docs/doku.php?id=mindset_data_types

MindWave dongle communication protocol (n. d.). Retrieved December 29, 2011, from

 NeuroSky: http://s3.amazonaws.com/entp-tender-

 production/assets/01d48807866e958524f29c2fa6f0de1b901ed468/mindwave_rf_protocol

.pdf

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 32/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 31

 NeuroSky(2010). MindSet communications protocol .

Vizard, F. (1996, February).Popular Mechanics, (Volume 173), 64.

What is the difference between the MindSet, MindWave, and XWave? (n. d.). Retrieved

December 18, 2011, from Neurosky Support: http://support.neurosky.com/kb/general-  21/what-is-the-difference-between-the-mindset-mindwave-and-xwave

DiMauro J. (2011). MindWave USB Dongle. Retrieved December 21, 2011 from

http://www.flickr.com/photos/jazzmasterson/5931925954/in/set-72157627137879911

 NeuroSky (2011). MindWave and Arduino. Retrieved December 21, 2011 from

http://developer.neurosky.com/docs/doku.php?id=arduino_tutorial&s[]=arduino

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 33/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 32

Table 1.

Time Data Gathered from the Adaptability Test of the Professionals

Respondent Word Number of backspaces

/errors

during test

 Number ofcharacters and

 backspaces

Time(min:sec)

Time percharacter

(min:sec)

1 Task 1 REYNILAN 0 8 1:32.9 0:11.61

Task 2 Trial 1 THESIS 2 8 1:05.4 0:08.18

Trial 2 THESIS 1 7 1:07.0 0:09.57

Trial 3 THESIS 0 6 0:40.2 0:06.67

Task 3 REYNILAN 0 8 0:52.9 0:06.61

2 Task 1 KAREN 3 8 2:55.7 0:21.96

Task 2 Trial 1 THESIS 0 6 0:44.3 0:07.38

Trial 2 THESIS 1 7 0:55.6 0:07.94

Trial 3 THESIS 0 6 0:46.5 0:07.75

Task 3 KAREN 0 5 0:58.2 0:07.28

3 Task 1 CHERRY 0 6 0:36.9 0:06.15

Task 2 Trial 1 THESIS 1 7 0:53.7 0:07.67

Trial 2 THESIS 2 8 1:06.0 0:08.25

Trial 3 THESIS 0 6 0:41.7 0:06.95

Task 3 CHERRY 2 8 0:46.2 0:05.78

4 Task 1 MANOLITO 2 10 1:20.1 0:08.01

Task 2 Trial 1 THESIS 0 6 1:07.3 0:11.22

Trial 2 THESIS 1 7 1:30.2 0:12.89

Trial 3 THESIS 0 6 0:37.7 0:06.28Task 3 MANOLITO 3 11 1:30.4 0:08.22

5 Task 1 ALICE 0 7 0:40.5 0:05.79

Task 2 Trial 1 THESIS 0 6 1:24.7 0:14.12

Trial 2 THESIS 0 6 0:46.8 0:07.8

Trial 3 THESIS 1 7 1:40.6 0:14.37

Task 3 ALICE 2 9 1:49.6 0:12.18

 Note. Time recording starts at the selection of the first letter and ends with the selection of the

last letter.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 34/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 33

Table 2.

Summarized Time Data of the Completion Time Test Done by the Professionals

Respondent TimeTASK1 (min:sec) TimeTASK2 MEAN

(min:sec) 

TimeTASK3 (min:sec) 

1 0:11.61 0:08.14 0:06.61

2 0:21.96 0:07.69 0:07.28

3 0:06.15 0:07.62 0:05.78

4 0:08.01 0:10.13 0:08.22

5 0:05.79 0:12.10 0:12.18

 Note. The results from each respondent are not compared to one another. Instead, each

respondent’s time of the latter tasks were compared to their own earlier tasks (TimeTASK3 <

TimeTASK1 MEAN and TimeTASK3 < TimeTASK2).

Table 3.

Coded Raw Data Gathered from Chosen Professionals based on the Questionnaires

Respondent No.

1 2 3 4 5

CONVENIENCE

Q1. The headset is easy to wear. 5 3 5 5 4Q2. The headset is comfortable to wear. 4 4 4 5 4

Q3. The instructions are easy to

understand.

4 4 5 5 4

PORTABILITY

Q1. The prototype is easy to carry. 4 5 5 5 4

Q2. The prototype is lightweight. 5 4 5 5 5

ACCURACY

Q1. The LED light toggles when

 blinking.

5 5 5 5 4

Q2. The character is selected when

double blinking.

4 5 4 5 4

Q3. The LED light moves when the user

is focused.

5 5 5 5 4

 Note. The data were coded to designated values of 5 = very much agree, 4 = agree, 3 = neutral, 2

= disagree, 1 = very much disagree.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 35/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 34

Table 4.

 Descriptive Statistics of Data Gathered from Chosen Professionals based on the Questionnaires

Median Mode Range Inter-quartile Range

CONVENIENCE 4 4 2 2

PORTABILITY 5 5 1 1ACCURACY 5 5 1 1

Table 5.

Coded Raw Data Gathered Chosen from People with Disabilities based on the Questionnaires 

Respondent

1 2

Q1. The headset is easy to wear YES YES

Q2. The instructions are easy to understand YES YES

Q3. The prototype is easy to control at first YES NOQ4. The prototype is easy to control after getting used to it YES YES

Q5. The letters, shortcuts, settings are easy to familiarize YES YES

Q6. The prototype could express what you want YES YES

Table 6.

 Percentage of YES Response from People with Disabilities based on the Questionnaires

Respondent 1 Respondent 2

Q1

Response YES 1 1 NO 0 0

Q2Response

YES 1 1

 NO 0 0

Q3Response

YES 1 0

 NO 0 1

Q4Response

YES 1 1

 NO 0 0

Q5

ResponseYES 1 1

 NO 0 0

Q6

ResponseYES 1 1

 NO 0 0

Percentage (Yes) 100 % 83.33%

Mean Percentage 91.67%

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 36/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 35

 Figure 1. Theoretical framework

YES

NO

Problem: Limited means of communication among people with disabilities.

Consideration: Software dependency of BCIs in today’s market 

Research Challenge: Is there a pc-independent device that helps disabled people to

communicate?

RESULTS

CONFIRM?

Portable brain frequency

controlled text display for

disabled with an independent

hardware

Brain frequency controlled

text display using a computer

with a software

BCI technology that

helps people with

disabilities

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 37/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 36

 Figure 2.Conceptual framework

EEG Headset (MindWave)

ArduinoMicrocontroller  

Radio Frequency

Serial Interface

Brain Frequency

LED Matrix

Input: character selection

LCD Display

Output: Message

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 38/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 37

 Figure 3.Operational framework

• Convenience

• Portability

• Accuracy

• Adaptability

• Usability

Input

• Interview

• Monitoring

• Pilot-testing

• Questionnaire

Process • Working

• Easy to use

• Convenient

• Established alternative

means ofcommunication for

disabled

Output

Test Variable:

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 39/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 38

 Figure 4. Character Layout

A B C D E F

G H I J K L

M N O P Q R

S T U V- W X

Y Z 0 1 2 3

4 5 6 7 8 9

H V

Attention Gauge

FOOD CR WATER SPACE   HOLD

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 40/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 39

APPENDIX A

Arduino Reference Design

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 41/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 40

APPENDIX B

Arduino Mega 2560 Datasheet

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 42/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 41

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 43/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 42

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 44/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 43

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 45/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 44

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 46/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 45

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 47/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 46

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 48/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 47

APPENDIX C

Questionnaire for the Professionals

 NAME:________________________________ GENDER: ( M / F ) AGE:___________

PROFESSION:__________________________ SCHOOL/COMPANY: ___________________

DATE: ________________________________

 Please read each statement carefully and check the corresponding box that best describes what

 you think.

Convenience

Statements Very

much

agree

Agree Neutral Disagree Very

much

disagreeThe headset is easy to wear.

The headset is comfortable to wear.

The instructions are easy tounderstand.

Portability

Statements Very

much

agree

Agree Neutral Disagree Very

much

disagree

The prototype is easy to carry.

The prototype is lightweight.

Accuracy

Statements Very

much

agree

Agree Neutral Disagree Very

much

disagree

The LED light toggles when blinking.

The character is selected whendouble blinking.

The LED light moves when the user

is focused.

Signature

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 49/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 48

APPENDIX D

Questionnaire for Persons with Disabilities

 NAME:________________________________ GENDER: ( M / F ) AGE:___________

PROFESSION:__________________________ SCHOOL/COMPANY: ___________________

DATE: ________________________________

 Please read each statement carefully and check the corresponding box that best describes what

 you think.

Statements YES NO

The headset is easy to wear.

The instructions are easy to

understand.

The prototype is easy to control at

first

The prototype is easy to control

after getting used to it

The letters, shortcuts, settings areeasy to familiarize

The prototype could express what

you want

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 50/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 49

APPENDIX E

Interview Guide Questions

Prior to pilot-testing

1. How many years have you been practicing your profession?

2. In those years of working as a professional, have you had an experience which involves

dealing with people who have disabilities, especially those who are mute or have stern motor

skills?

3. Could you state some significant experience in your life involving people with disabilities?

4. As a professional teacher, how do you deal with your students with such type of disability?

5. Do they have their own special education or treatment in teaching them? Are you having a

hard time on how they would understand what you are teaching?

6. Is there a difference between teaching normal students and students with disabilities?

7. Would you agree if there could be an alternative way on how they could communicate to

others without using sign language, as long as they know the basic alphabet?

After pilot-testing

6. Based on your background and experiences with disabled and upon testing the device, would

you recommend the device to be used by people with these disabilities?

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 51/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 50

APPENDIX F

Software Simulation GUI Layout

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 52/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 51

APPENDIX G

Software Simulation GUI Source Code

/* The code shown is only a part of the whole code. First 135 out of 722 lines shown, the rest is omitted. *//* For the whole GUI source code, email [email protected] */

using System;usingSystem.Collections;usingSystem.Collections.Generic;usingSystem.Data;usingSystem.Drawing;usingSystem.Diagnostics;usingSystem.IO.Ports;usingSystem.Threading;usingSystem.Windows.Forms;usingSystem.Linq;

usingSystem.Xml.Linq;usingThinkGearNET;namespaceMindWave_to_LCD{public partial class Form1

{privateThinkGearWrapper _thinkGearWrapper = new ThinkGearWrapper();intvalAttention;intvalBlink;intvalMed;intcountSec;intblinkTimes;inttempBlink;

boolblinkTwice;booltimerElapse;boolpauseBlink;

public Form1(){

InitializeComponent();if (transDefaultFormForm1 == null) transDefaultFormForm1 = this;base.Load += new System.EventHandler( Form1_Load );btnSwitch.Click += new System.EventHandler(btnSwitch_Click );tmrInitial.Tick += new System.EventHandler(initial_Tick );btnBlink.Click += new System.EventHandler(btnBlink_Click );tmrHorizontal.Tick += new System.EventHandler(horizontal_Tick );tmrVertical.Tick += new System.EventHandler(tmrVertical_Tick );btnShift.Click += new System.EventHandler(btnShift_Click );btnReset.Click += new System.EventHandler(btnReset_Click );btnDBlink.Click += new System.EventHandler(btnDBlink_Click );

ComboBox1.SelectedIndexChanged += new System.EventHandler(ComboBox1_SelectedIndexChanged );

}/* L:2 */public intattentionLevel;/* L:3 */public string direction;/* L:4 */public string character;/* L:5 */public bool switched;

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 53/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 52

/* L:6 */public int row;/* L:9 */public int column;/* L:8 *//* L:9 */// TRANSMISSINGCOMMENT: Method Form1_Load

private void Form1_Load( System.Object sender, System.EventArgs e ){

blinkTwice = false;timerElapse = false;pauseBlink = false;countSec = 0;blinkTimes = 0;

/* L:11 */switched = false;/* L:12 */character = "";/* L:13 */direction = "";/* L:14 */row = 0;/* L:15 */column = 0;/* L:16 */lblLCD.Text = "";/* L:17 */TrackBar1.Enabled = false;/* L:18 */btnBlink.Enabled = false;

/* L:19 */btnDBlink.Enabled = false;/* L:20 */btnReset.Enabled = false;/* L:22 */btnShift.Enabled = false;/* L:22 */

foreach (string port in SerialPort.GetPortNames())cboPort.Items.Add(port);cboPort.SelectedIndex = 0;

}

/* L:24 *//* L:25 *//* L:26 */// TRANSMISSINGCOMMENT: Method btnSwitch_Click

private void btnSwitch_Click( System.Object sender, System.EventArgs e ){

/* L:62 */if ( switched == false ){

/* L:29 */btnSwitch.Text = "OFF";/* L:30 */tmrInitial.Enabled = true;/* L:31 */switched = true;/* L:32 */pbLed1.Image =/* L:33 */pbH.Image = global::MindWave_to_LCD.Properties.Resources.redOn;/* L:34 */direction = "H";/* L:35 */character = "A";/* L:36 */row = 1;/* L:37 */column = 1;

/* L:38 */lblLCD.Text = "";/* L:39 */TrackBar1.Enabled = true;/* L:40 */btnBlink.Enabled = true;/* L:41 */btnDBlink.Enabled = true;/* L:42 */btnReset.Enabled = true;/* L:43 */btnShift.Enabled = true;

tmrBlink.Enabled = true;

 _thinkGearWrapper = new ThinkGearWrapper();

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 54/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 53

// setup the event _thinkGearWrapper.ThinkGearChanged += _thinkGearWrapper_ThinkGearChanged;

// connect to the device on the specified COM port at 57600 baudif (!_thinkGearWrapper.Connect(cboPort.SelectedItem.ToString(), 57600, true))MessageBox.Show("Could not connect to headset.");

 _thinkGearWrapper.EnableBlinkDetection(true);

}else

{/* L:45 */btnSwitch.Text = "ON";/* L:46 */tmrInitial.Enabled = false;/* L:47 */switched = false;/* L:48 */pbH.Image = global::MindWave_to_LCD.Properties.Resources.redOff;/* L:49 */btnReset.PerformClick();/* L:50 */character = "";/* L:51 */direction = "";/* L:52 */row = 0;

/* L:53 */column = 0;/* L:54 */lblLCD.Text = "";/* L:55 */TrackBar1.Enabled = false;/* L:56 */TrackBar1.Value = 0;/* L:57 */ProgressBar1.Value = 0;/* L:58 */btnBlink.Enabled = false;/* L:59 */btnDBlink.Enabled = false;/* L:60 */btnReset.Enabled = false;/* L:61 */btnShift.Enabled = false;

tmrBlink.Enabled = false; _thinkGearWrapper.Disconnect();

}}

////////////// Rest of the codes omitted. /////////////////// 

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 55/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 54

APPENDIX H

System Component Layout

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 56/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 55

APPENDIX I

LED Matrix Board Schematic Diagram

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 57/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 56

APPENDIX J

Liquid Crystal Display (LCD) Datasheet

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 58/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 57

APPENDIX K

MindWaveUSB Dongle Diagram

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 59/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 58

APPENDIX L

MindWave RF Protocol

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 60/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 59

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 61/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 60

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 62/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 61

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 63/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 62

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 64/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 63

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 65/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 64

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 66/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 65

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 67/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 66

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 68/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 67

APPENDIX M

MindSet Communications Protocol

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 69/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 68

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 70/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 69

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 71/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 70

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 72/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 71

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 73/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 72

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 74/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 73

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 75/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 74

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 76/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 75

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 77/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 76

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 78/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 77

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 79/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 78

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 80/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 79

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 81/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 80

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 82/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 81

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 83/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 82

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 84/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 83

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 85/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 84

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 86/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 85

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 87/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 86

APPENDIX N

Raw Parsing Code

///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////* Raw Parsing Source Code. Outputs Raw bytes to Serial0 (USB) to be viewed on Arduino’s Serial

monitor or via telnet. *//* Only first 100 out of 521 lines is shown. The rest of the codes are omitted. For the whole code, [email protected], [email protected], or [email protected] *///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

#define DEBUGOUTPUT 0

// checksum variables (mindwave packets)bytegeneratedChecksum = 0;byte checksum = 0;intpayloadLength = 0;bytepayloadData[64] = {0};bytepoorQuality = 0;

byte attention = 0;byte meditation = 0;byteblinky = 0;byte raw1 = 0;byte raw2 = 0;short raw = 0;

// include the library code:#include <LiquidCrystal.h>

//set pin namesintColPin[6] = {34, 36, 38, 40, 42, 44};intRowPin[7] = {39, 37, 35, 52, 50, 48, 46};intGauPin[5] = {49, 47, 45, 43, 41};int H = 51;int V = 53;LiquidCrystallcd(33,31,29,27,25,23);intvarPin = 13;

//global variables//int attention = 0;booleanHorV = true; // H = true and V = falseint col = 0;int row = 0;intzzz = 0;unsigned long time = 0; //unsigned long to have max value of 4billion+unsigned long timetodisplay = 0;

unsigned long timePacket = 0;

// system variables (mindwave packets)longlastReceivedPacket = 0;booleanbigPacket = false;booleansmallPacket = false;int toggled = 0;

void setup()

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 88/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 87

{//set pin modesfor (int i = 0; i<6; i++)

{pinMode(ColPin[i], OUTPUT);}for (int j = 0; j<7; j++)

{pinMode(RowPin[j], OUTPUT);}for (int k = 0; k<5; k++)

{pinMode(GauPin[k], OUTPUT);}pinMode(H, OUTPUT);pinMode(V, OUTPUT);

//pinMode(LED, OUTPUT);//pinMode(BLUESMIRFON, OUTPUT);

pinMode(varPin, OUTPUT);// set up the LCD's number of columns and rows:lcd.begin(16, 2);

//contrast setanalogWrite(varPin, 110);

//reverse bias all LED

for (int l = 1; l<6; l++){digitalWrite(ColPin[l], HIGH);}

for (int l = 1; l<7; l++){digitalWrite(RowPin[l], LOW);}

digitalWrite(ColPin[0], LOW);digitalWrite(RowPin[0], HIGH);digitalWrite(H, HIGH);

Serial1.begin(115200); // USB

Serial1.print(193, BYTE) ;

delay(10);Serial1.print(194, BYTE) ;

Serial.begin(115200);

}

byteReadOneByte() {intByteRead;

////////////// Rest of the codes omitted. /////////////////// 

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 89/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 88

APPENDIX O

Raw Waveform

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 90/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 89

APPENDIX P

System Flow Chart

Raw Code?

Yes

Displays level gauge

Brain Frequencies

Brain

BCI / EEG Headset

Interprets the brainsignals and converts

it into Packet Data

(Attention,

Meditation, Raw)

Forwards the codes

Wireless USB

Arduino

MicrocontrollerIdentifies the code

Double Blink

Code?

Attention

Code?

Selects and displays

the Character

Yes

LCD

Yes

Attention Display

>40%?

Yes

Vertical?

Switch from

vertical to

horizontal

Matrix LED

On “H” LED and

off “V” LED 

Switch from

horizontal to

vertical decoder

On “V” LED and

off “H” LED 

No

Feed

signal to

the clock

Algorithm for blink

detection

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 91/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 90

APPENDIX Q

Prototype Source Code

///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////* Main Program Source Code. Displays a message on the LCD via brain control.*/

/* Only first 100 out of 747 lines is shown. The rest of the codes are omitted. For the whole code, [email protected], [email protected], or [email protected] *///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

//////////////////////////////////////////////////////////////////////////////////////////// Brain-Controlled Message Display for Disabled ////////// Buduan, Peter James ////////// David, Adier ////////// Dizon, Christian Paul ////////// Esguerra, Jeric ////////// Mallari, Arvin Cedric ////////// Manalang, Jordan /////

///// Socorro, Ronald Patrick ////////// Some parts of the code are from Neurosky ////////// Neuroskycodes included are License Free.////////// Proprietary algorithms cannot be disclosed. ////////// Code copyright 2011-2012 ACM|PJB|CPD ///////////////////////////////////////////////////////////////////////////////////////////

// checksum variables (mindwave packets)bytegeneratedChecksum = 0;byte checksum = 0;intpayloadLength = 0;bytepayloadData[64] = {0};bytepoorQuality = 0;byte attention = 0;byte meditation = 0;

byte raw1 = 0; //higher order bits in 2's complementbyte raw2 = 0; //lower order bitsshort raw = 0; //raw value

// include the library code:#include <LiquidCrystal.h>

//set pin namesintColPin[6] = {34, 36, 38, 40, 42, 44};

intRowPin[7] = {39, 37, 35, 52, 50, 48, 46};intGauPin[5] = {49, 47, 45, 43, 41};int H = 51;int V = 53;LiquidCrystallcd(33,31,29,27,25,23);byte cp20[8] = {

B01110,B10001,B01010,

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 92/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 91

B01110,B01010,B10001,B01110,

};

intvarPin = 13; //contrast of LCDint switchPin1 = 7;int switchPin2 = 6;int switchPin3 = 5;

//variableschar message[40] = ""; //selected charactersbooleanHorV = HIGH; // H = true and V = falseint col = 0; //takes note of what column is selectedint row = 0; //takes note of what row is selected

//unsigned long to have max value of 4billion+//unsigned long time = 0; //for double blink delayunsigned long timetodisplay = 0; //for matrix movement delayunsigned long sureblink = 0; //lesser noise

long minimum = 0; //minimum raw peak valuelong maximum = 0; //maximum raw peak valueintLCDlimit = 0; //takes note of what line is the LCD cursor inbooleanlastMed = false; //lesser chance of activation of meditationboolean hold = false;

intincSpeed = 700;intgaugeLevel = 30;intblinkstop = 1500;

// system variables (mindwave packets)longlastReceivedPacket = 0;booleanoneSec = false;

void setup(){//ensure blank display on LCDfor (int i = 0; i < 32; i = i + 1)message[i] = ' ';

//set pin modesfor (int i = 0; i<6; i++)

{pinMode(ColPin[i], OUTPUT);}for (int j = 0; j<7; j++)

{pinMode(RowPin[j], OUTPUT);}for (int k = 0; k<5; k++)

{pinMode(GauPin[k], OUTPUT);}

pinMode(H, OUTPUT);pinMode(V, OUTPUT);pinMode(varPin, OUTPUT);pinMode(switchPin1, INPUT);pinMode(switchPin1, INPUT);pinMode(switchPin1, INPUT);

// set up the LCD's number of columns and rows:lcd.begin(16, 2);lcd.createChar(0, cp20);

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 93/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 92

lcd.cursor();

//contrast setanalogWrite(varPin, 110);

//reverse bias all LEDfor (int l = 1; l<6; l++)

{digitalWrite(ColPin[l], HIGH);}for (int l = 1; l<7; l++)

{digitalWrite(RowPin[l], LOW);}

//initially on letter AdigitalWrite(ColPin[0], LOW);digitalWrite(RowPin[0], HIGH);//initially on H indicatordigitalWrite(H, HIGH);

////////////// Rest of the codes omitted. /////////////////// 

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 94/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 93

APPENDIX R

MindWave User Guide

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 95/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 94

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 96/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 95

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 97/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 96

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 98/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 97

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 99/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 98

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 100/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 99

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 101/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 100

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 102/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 101

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 103/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 102

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 104/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 103

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 105/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 104

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 106/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 105

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 107/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 106

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 108/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 107

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 109/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 108

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 110/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 109

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 111/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 110

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 112/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 111

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 113/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 112

APPENDIX S

User Guide

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 114/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 113

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 115/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 114

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 116/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 115

APPENDIX T

InterviewQuestions with Answers

Interview with Ms. Alice

Jeric: How many years have you been practicing your profession?

Teacher Alice: 12 years

Jeric: So, in those 12 years of working as a professional. Have you had an experience which involves dealing with

people who have like them with disabilities, especially those who are mute or stern motor skills?

Teacher Alice: Yes!

Jeric: Could you state some significant experience in your life which has a relation to the people with hearing

impairment?

Teacher Alice: when I met Paul, our neighbor. Then he suddenly approached me with a sign language he’s a deaf

and mute so that starts my interest in teaching people with hearing impairment.

Jeric: So noongpumasokpokayosa institution naito. Paanoponinyopinakikisamahananginyomgaestudyante?

Teacher Alice: Through sign language. Kasimeronkamingmgaestudyanteng may mild hearing impairment. Yung

dealing with them like sapagtuturong sign language at pagininterviewsamga parents paramalaman kung anong

cause ng deafness nila.

Jeric:Do they have their own special education or treatment in teaching them? Nahihirapanpoba kayo sapagturo as

a teacher kung gaanosilamakakapagintindi?

Teacher Alice: of course. Meron.

Jeric: Meronpo bang pagkakaiba?

Teacher Alice: Oo. Meron.syempreyungsapagsasounds pa langnoh! Merongmga hearing pagsinabimonghalimbawa

“boat” syempresakanilahindinilaalam kung anoyung “boat” perosamganakakarinigalamnila kung anuyung “boat”.

So through sounds kahitnasamgamaliliit, kung sa baby

inumpisahanmoungpagsasoundsmosakanilanakakaadaptnasilang language di tuladngmga deaf

talagangkahitanungsabihinmohindinilamaiintindihannaitong boat naitona kung hindimomaipapakitaung picture

naitopalaung boat.

Jeric: So ibigsabihin.

Teacher Alice: Merontalagang factor ungpandinig at sakaungpagsasalita.

Jeric: So kungmagkakaroonng alternative way napedesilangmakapag-usapmakipagcommunicate without using sign

languages basta’talamnilaang basic alphabets?

Teacher Alice: Oo. Lalonangayonibanaang technology ngayon. Peromeronnakaming application sa iPhone,

yunguna. binigyan kami doonngisang application naangpangalanata ay protocolokol. Yung naman ay pictures

namanitatouchmoung icon ng picture apple yung ice cream yuntaposmeronsilangisang headset na kung

saanmaririningniladoon ice cream. Pederinyun as form of communication para dun samga hearing impaired.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 117/134

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 118/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 117

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 119/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 118

APPENDIX U

Gantt Chart

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 120/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 119

APPENDIX V

Component / Materials Pricelist

QTY MATERIALS PRICE(PHP)

1 NEUROSKY MINDWAVE HEADSET 4082.83

1 ARDUINO MEGA 2560 3433.92

1 PB301 125

2 FeCl 54

3 PHOTO ETCHING BOARD W/ DEVELOPER 300

1 SS406 12.5

20 RESISTOR 0.25W 5

50 LED 3G/FT 100

10 LED 3R/DF 20

20 LED 1GL 40

1 2x16 LCD 350

2 40 PINS FEMALE PINHEADER 37

25 LED SMALL 62.5

10 620Ω 0.25W  10

10 2.2KΩ 0.25W  10

2 DRILL BIT 30

1 SILICON COMPOUND 35

3 MALE PIN HEADER 90

5 LAN CABLE 27.5

1 LOGIC CONVERTER 100

PACKAGING 1250

MISCELLENEOUS EXPENSES 920

11095.25

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 121/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 120

APPENDIX W

Documentation Pictures

Etching of the LED Matrix Board Wiring the LED Matrix Board

Cutting the traces on the dongle Interfacing to Arduino

Testing for professionals Testing for the disabled

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 122/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 121

APPENDIX X

Curriculum Vitae

Peter James L. Buduan83 5th St. Paraiso, Sindalan

City of San Fernando, Pampanga

0927-725-5928 / (045) 860-4029

[email protected]

OBJECTIVE:

To secure a promising position wherein I can enhance my programming, technical, and

electronics and communications designing skills that offers both a challenge and a good

opportunity for growth.

SUMMARY OF SKILLS:

  Programming Skills

Has a profound knowledge in programming using Visual Basic .NET, C# .NET,

C++, Assembly, SQL, HTML, Flash, and PHP. Also, has knowledge in programming

Microchip PIC microcontrollers, and Arduino-compatible (Atmel-based) microcontrollers

using Assembly, PICbasic, and C.

  Networking Skills

Has knowledge in configuring Cisco switches and routers, as well as designingand maintaining a computer network.

  Telephone Cabling System Skills

Has knowledge in installing and troubleshooting PABX telephone system in a

private company.

  Electronic Circuit Design Skills

Can design electronic circuits using designing software such as KiCad and

Proteus.

  Electronic Equipment Knowledge

Can handle electronic equipment such as oscilloscope, tester, and spectrum

analyzer.

  Microwave and Radio Frequency Designing Skills

Has basic knowledge in microwave radio design, as well as antenna design.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 123/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 122

  Language

Fluent in English, Filipino, and Kapampangan. Also, has a basic knowledge in

Korean.

WORK EXPERIENCE:

Clark International Airport Corporation, Clark Freeport Zone, Pampanga

Electronics and Communications Engineering Division,

 Aviation Engineering Department

Trainee (April – June 2011)

  Programmed a PABX Database System using Visual Basic .NET and SQL. The program

is for recording and viewing the PABX links, ports, local numbers, and trunk lines for

easy troubleshooting and marking works.

  Maintained electronic equipment of CIAC/DMIA which includes navigational aids,

antennas, CCTVs, and etc.

  Configured, troublesoot and installed PABX telephone system and LANs of CIAC/DMIA.

EDUCATION:

Bachelor of Science in Electronics Engineering

Holy Angel University, April 2012

ACCOMPLISHMENT:

Dean’s Lister, October 2007

MEMBERSHIPS/ORGANIZATION:

Institute of Electronics Engineers of the Philippines – HAU Student Chapter

Member, 2009-Present

The Solution

The Official Student Publication of the College of Engineering and Architecture,

Holy Angel University

Layout Artist, June 2009 - May 2011

Senior Layout Artist and Webmaster, June 2011 – Present

TRAINING:

IYF Leadership Training for Philippine University Students

International Youth Fellowship

Daegu, South Korea

June 27 – July 15, 2011

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 124/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 123

 AdierDelaResma David6069 Mangga Road, PulungBulu,,AngelesCity

09155752874/ (045) [email protected]

Objective:

To obtain much needed work experience in the electronics field by applying and utilizingmy knowledge, skills and abilities in the best way I can.

Work Experiences:

Employee 2006-PresentRBR MarketingPulungBulu, A. C.

Internship April 2011- June 2011PLDT ClarktelClark Economic Zone

Educational Background:

2007-2012 Holy Angel UniversityBachelor of Science Major in Electronics Engineering

 April 2012

2003-2007 HoyFamilyAcademySecondary Education

 April 2007

 Achievements and Extra-Curricular Activities:

  With Honors in 3rd and 4th year high school

  Pautakan Team Member in high school

  Consistent IECEP- HAU Chapter member

  Productive IECEP - HAU Chapter officer for 2yrs.

  IECEP – CLSC member for 2yrs.

Seminars Attended:

 August 17 -19, 2011 IECEP National Mid Year Fontana, CSEZ

Convention

September 28, 2010 IECEP Pampanga Hotel StotsenburgLaunching

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 125/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 124

Skills:

  AutoCAD Proficient

  Circuit Analysis

  Computer Literacy

  Networking and Programming Skills

  English Language Proficiency

  PCB Lay outing

  Soldering

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 126/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 125

Christian Paul M. Dizon1-7 Dama de Noche St. Town & Country Homes, PulungBulu

City of San Fernando, Pampanga

0923-246-0876 / (045) 887-2922

[email protected]

OBJECTIVE:

To secure a promising position wherein I can enhance my programming, technical, and

electronics and communications designing skills that offers both a challenge and a good

opportunity for development.

SUMMARY OF SKILLS:

  Programming Skills

Has a profound knowledge in programming using Visual Basic .NET, C++,

 Assembly. Also, has knowledge in programming Microchip PIC microcontrollers, and

 Arduino-compatible (Atmel-based) microcontrollers using Assembly, PICbasic, and C.

  Networking Skills

Has knowledge in designing and maintaining a computer network, as well as

configuring Cisco Switches and Routers.

  Telephone Cabling System Skills

Has knowledge in installing and troubleshooting PABX telephone system in a

private company.

  Electronic Circuit Design Skills

Can design electronic circuits using designing softwares such as KiCad and

Proteus.

  Electronic Equipment Knowledge

Can handle electronic equipment such as oscilloscope, tester, and spectrum

analyzer.

  Microwave and Radio Frequency Designing Skills

Has basic knowledge in microwave radio design, as well as antenna design.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 127/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 126

EXPERIENCE:

Clark International Airport Corporation, Clark Freeport Zone, Pampanga

Electronics and Communications Engineering Division,

 Aviation Engineering Department

Trainee (April – June 2011)

  Maintains electronic auxiliary equipment of CIAC/DMIA which includes navigational aids,

antennas, CCTVs, and etc.

  Configure, troubleshoot and install PABX telephone system and LANs of CIAC/DMIA.

EDUCATION:

Bachelor of Science in Electronics Engineering

Holy Angel University, April 2012

MEMBERSHIPS/ORGANIZATION:

Institute of Electronics Engineers of the Philippines – HAU Student ChapterBoard of Director, 2011-Present

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 128/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 127

Esguerra, Jeric M.Phase 2-B, Molave St. Villa Barosa

City of San Fernando, Pampanga

0905-327-4352 / (045) 961-4363

 [email protected]

OBJECTIVE:

To get a position wherein I can apply my knowledge and skills in terms of technical

aspect in the field of electronics and communications and improve as well my designing skills

which I can use as one of my assets in getting the position in the industry.

SUMMARY OF SKILLS:

  Programming Skills

Has a basic knowledge in programming using Visual Basic .NET, C++, Assembly. Also, has knowledge in programming Microchip PIC microcontrollers.

  Networking Skills

Has knowledge in configuring Cisco switches and routers, as well as designing

and maintaining a computer network.

  Electronic Circuit Design Skills

Can design electronic circuits using designing softwares such as KiCad and

Proteus.

  Electronic Equipment Knowledge

Can handle electronic equipment such as oscilloscope, tester, and spectrum

analyzer.

  Microwave and Radio Frequency Designing Skills

Has basic knowledge in microwave radio design, as well as antenna design.  

EXPERIENCE: 

Clark International Airport Corporation, Clark Freeport Zone, Pampanga

Electronics and Communications Engineering Division, Aviation Engineering Department

Trainee (April – June 2011)

  Maintains electronic auxiliary equipment of CIAC/DMIA which includes navigational aids,

antennas, CCTVs, and etc.

EDUCATION:

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 129/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 128

Bachelor of Science in Electronics Engineering

Holy Angel University, April 2012

MEMBERSHIPS/ORGANIZATION:

Institute of Electronics Engineers of the Philippines – HAU Student Chapter

Executive Staff of USC-HAU. 2011-Present

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 130/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 129

ARVIN CEDRIC QUIAMBAO MALLARI

25-26 Antonio St., Holy Angel Village Phase 1, Telabastagan, City of San Fernando

+639228192542

(045) 888-0940

[email protected]

Objectives:

  To apply my knowledge and skills.

  To gain experience that would help me develop my personality and relationship

with other people.

  To acquire knowledge and skills that would help me develop my future company. 

Education:

B.S. in Electronics and Communications Engineering

Holy Angel University

2012

Skills:

  Knowledgeable on programming language on PIC microcontroller and Arduino

platforms  Knowledgeable on electronic circuits and design

  PCB design and etching using KiCad

  Computer literate

  Have basic knowledge on networking, router and switch configuration

  Good at problem solving, situation analysis and problem solving

Achievements:

  Consistent Dean’s Lister, Holy Angel University 

  Academic Scholar, Holy Angel University 1st

 Semester S.Y. 2010-2011

  Mamerto G. Nepomuceno Scholar, Holy Angel University, 1st

&2nd

 Semester S.Y.

2007-2008, 1st

& 2nd

  Semester S.Y. 2008-2009, 1st

 and 2nd

 Semester S.Y. 2009-

2010

  Graduated ranked 10, Holy Angel University Batch 2007

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 131/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 130

  IECEP National Quizzer 2011

  With High Honors, Holy Angel University,2005-2007

from 2nd

 Year to 4th

 Year High School, Academic Scholar

  With Honors, Holy Angel University, 2004

1st

 Year High School

Experience:

  Precinct Count Optical Scanner (PCOS) Technician, National Elections, May 10,

2010 

  On-Job-Training. Operator and technician at Amertron Incorporated, Clark Field,

Pampanga, April-May 2011

Personal Background:

Birthday : March 15, 1990

Age : 21

Status : Single

Religion : Roman Catholic

Height : 5’9” 

Weight : 59 kg

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 132/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 131

JORDAN D. MANALANGB. Aquino St. Purok 7 Capaya II, AngelesCity

09061568158

 [email protected]

OBJECTIVE

To occupy a challenging position and further grow as a highly effective team player and

contribute to the achievement goals of the organization.

EDUCATION

Tertiary

Bachelor of Science in Electronics Engineering

Holy Angel University

2007 -2012Peso Scholar (2007-2010) (2011-2012)

Secondary

Francisco G. Nepomuceno Memorial Highschool

2003 -2007

Award: Salutatorian

Primary

Sto. Rosario Elementary School

1998- 2003

AFFILIATION

  Board of Director, Institute of Electronics Engineers of the Philippines (IECEP)

EMPLOYMENT RECORD:

  VENTURES LINK 

PCOS Technician May 2010 ELECTIONS

ON-THE-JOB TRAINING

Clark International Airport Corporation, Clark Freeport Zone, Pampanga

  Electronics and Communications Engineering Division,

  Aviation Engineering Department

  Trainee (April – June 2011)

  Maintains electronic equipment of CIAC/DMIA which includes navigational aids,

antennas, CCTVs, and etc.

  Configure, troubleshoot and install PABX telephone system and LANs of CIAC/DMIA.

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 133/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 132

SEMINARS ATTENDED

Date Title of Seminar Venue

November 21, 2010 Continuing Professional Education (CPE) Hotel Stotsenberg,

Clarkfield, Pampanga

November 21, 2010 Environmental Regulations Affecting Hotel Stotsenberg,

Electronic Industry Clarkfield, PampangaNovember 21, 2010 Implementing Rules and Regulation Hotel Stotsenberg,

Of National Building Code Clarkfield, Pampanga

SKILLS 

  Basic Networking

  Basic Printed Circuit Board (PCB) layout designs

  Programmable Logic Controller (PLC): Basic Overview

  Circuit design software: KICAD

  Cisco Packet Tracer Literate

8/11/2019 5 - Brain Controlled LCD Message Display for the Disabled

http://slidepdf.com/reader/full/5-brain-controlled-lcd-message-display-for-the-disabled 134/134

BRAIN CONTROLLED TEXT DISPLAY FOR DISABLED 133

RONALD PATRICK J. SOCORRO2493 Maligaya, Mabiga, Mabalacat, Pampanga0926-908-3720 / (045) [email protected]

Objective:

To gain working experience in the field of electronics by applying and utilizing myknowledge, skills and abilities in the best way I can.

Educational Background:

Tertiary: Bachelor of Science Major in Electronics Engineering 2007-2012Holy Angel UniversitySto. Rosario, Angeles City

Secondary: Children of Fatima School Inc. 2003-2007

Francisco, Mabalacat

Work Experience:

May 2011- June 2011(240hrs) Trainee PLDT ClarktelClark Economic Zone

Achievements and Extra-Curricular Activities:

2010-2012 Productive IECEP-HAU Chapter member

2009-2012 Consistent IECEP-HAU Chapter member