PERPUSTAKAAN UMP

FINAL EXAMII'1AT

1111 III III III till11111 111111rSING MICROSOFT

0000103241

ADRIAN YONG WENG HOONG

THESIS SUBMITTED IN FULFILMENT OF THE DEGREE OF COMPUTER

SCIENCE (SOFTWARE ENGINEERING) WITH HONOURS

FACULTY OF COMPUTER SYSTEM & SOFTWARE ENGINEERING

UNWERSITI MALAYSIA PAHANG

DECEMBER 2014

"A

ABSTRACT

The Final Examination Question Paper Generator is developed to assists lecturers of Faculty of Computer System & Software Engineering, Universiti Malaysia Pahang to be more efficient in producing a high quality final examination question paper, able to identify the Bloom's Taxonomy cognitive level of questions and producing a question paper that complies with Universiti Malaysia Pahang's final examination question paper format. This project is to develop a functional Final Examination Question Paper that complies with Universiti Maaysia Pahang's final examination question paper specifications. The system developed is an add-in to Microsoft Word 2010 which is developed using Rapid Application Development model. By using this model fast prototypes and various tests can be made. This system is developed using Visual Basic for Application which is sub-language of Visual Basic but is tailored to further extend the functionalities of Microsoft's application. In conclusion, this project is a Final Examination Question Paper Generator which is able to produce high quality final examination question paper in terms of formatting and questions

V

ABSTRAK

Penjana Kertas Peperiksaan Akhir dibangunkan untuk membantu pensyarah Fakulti Sistem Komputer & Kejuruteraan Perisian, Universiti Malaysia Pahang untuk menjadi lebih effisen dalam menghasilkan kertas soalan peperiksaan akhir yang berkualiti tinggi, mengenalpasti tahap kognitif Taksonomi Bloom dalam soalan dan menghasilkan kertas soalan yang mematuhi format kertas soalan peperiksaan akhir Universiti Malaysia Pahang. Projek mi adalah untuk membangunkan satu penjana kertas soalan peperiksaan yang mematuhi spesifikasi kertas soalan peperiksaan akhir Universiti Maaysia Pahang. Sistem yang dibangunkan adalah "add-in" untuk Microsoft Word 2010 yang dibangunkan menggunakan model "Rapid Application Development". Dengan menggunakan model mi, prototaip pantas dan pelbagai ujian boleh dibuat. Sistem mi dibangunkan dengan menggunakan "Visual Basic untuk Application" yang merupakan sub-bahasa pengaturan Visual Basic tetapi disesuaikan untuk melanjutkan lagi fungsi permohonan Microsoft. Kesimpulannya, projek mi merupakan Peperiksaan Akhir Soalan Kertas Generator yang mampu untuk menghasilkan berkualiti tinggi kertas soalan peperiksaan akhir dari segi format dan soalan

vi

TABLE OF CONTENT

Declaration i

Supervisor declaration

ACKNOWLEDGEMENT

ABSTRACT iv

ABSTRAK v

Table of Content vi

List of Figure viii

List of Tables ix

INTRODUCTION 1

1.2 REVIEW OF PREVIOUS WORK 3

1.3 CURRENT SYSTEM AND ITS LIMITATION 5

1.4 TERMINOLOGY 5

1.5 METHODS OF APPROACH 6

1.6 SCOPE 8

1.7 OUTLINE 9

2 User Requirements 10

2.1 System functions 10

2.3 Data Flow Diagram Level-0 12

2.4 Data Flow Diagram Level-1 13

2.5 Use case diagram 19

2.7 Development environment 26

3 SYSTEM DESIGN 28

3.1 Modules 28

3.2 Dialogue diagram of Final Examination Question Generator 29

3.3 Entity Relation Data Model 29

3.4 Data Dictionary 30

3.5 User interface 32

I!àII

3.5.1 Main menu 32

3.5.2 Front page create menu 33

3.5.3 New Question menu 34

3.5.4 Manage question menu 36

3.5.5 Review summary Menu 37

3.5.6 Manage Lecturer Data Menu 38

3.5.7 Manage course data menu 39

4 IMPLEMENTATION AND TESTING 40

4.1 Implementation 40

4. 1.1 Implementation of exam generator ribbon 40

4.1.2 Implementation of front page creator 41

4.1.3 Implementation of new question menu 42

4.1.4 Implementation of question manger 44

4.1.5 Implementation of review summary menu 45

4.1.7 Implementation of manage course data menu 47

4.2 Testing 48

5 CONCLUSION 53

5.1 Conclusions 53

5.2 Future works 53

REFERENCES 54

Appendix A: Gantt chart 55

Appendix B: User acceptance test form 57

APPENDIX C: SOURCE CODE 65

viii

LIST OF FIGURE

Figure i - i: Question designer in Exam-software test engine 4 Figure 2-1: Context diagram of Final Examination Question Paper Generator 11 Figure 2-2: Data flow diagram Level-0 of Final Examination Question Paper Generator 12 Figure 2-3: Data flow diagram level-i (create front page) 13 Figure 2-4: Data flow diagram level- i(manage questions) 14 Figure 2-5: Data flow diagram level- 1(specify format) 15 Figure 2-6: Data flow diagram level- 1 (generate question summary) 16 Figure 2-7: Data flow diagram level-1 (manage lecturer database) 17 Figure 2-8: Data flow diagram level-i (manage course database) 18 Figure 2-9: Use case diagram 19 Figure 3-1: Draft of Final Examination Question Paper Generator dialog diagram 29 Figure 3-2: Entity Relation Data Model for the databases used in Final Examination Question Generator 29 Figure 3-3: Location of Exam Generator in a typical Microsoft Word 2010 ribbon 32 Figure 3-4: Create front page menu 33 Figure 3-5: New question menu (objective question mode) 34 Figure 3-6: New question menu (subjective question mode) 34 Figure 3-7: Manage question menu 36 Figure 3-8: Review summary menu 37 Figure 3-9: Manage Lecturer Data menu 38 Figure 3-10: Manage course data menu 39 Figure 4-1: Exam generator ribbon 40 Figure 4-2: Create front page menu 41 Figure 4-3: new question menu (objective question mode) 42 Figure 4-4: new question menu (subjective question mode) 42 Figure 4-5: Question manager menu 44 Figure 4-6: Review summary menu 45 Figure 4-7: Manage lecturer data menu 46 Figure 4-8: Manage course data menu 47

LIST OF TABLES

Table 1-1: Software development lifecycle model 7 Table 2-1: Create Frontpage use case description 20 Table 2-2: Create questions use case description 22 Table 2-3: Manage lecturer use case description 23 Table 2-4: Update course database use case description 24 Table 2-5: Generate question paper use case description 25 Table 2-6: Update question bank use case description 26 Table 2-7: Review question paper use case description 26 Table 3-1: Data dictionary for table LecturerData 30 Table 3-2: Data dictionary for table CoursetData 30 Table 3-3: Data dictionary for table objQuestionBank 31 Table 3-4: Data dictionary for table subjQuestionBank 31 Table 3-5: Data dictionary for table minorQuestionBank 31

lx

CHAPTER 1

INTRODUCTION

Examinations are one of the assessment methods to evaluate the knowledge of

students. In preparing the students for examination lecturers have to prepare the

examination paper by themselves. However the lecturers have other responsibilities

other than to prepare examination question paper like prepare teaching material for

students, research, administrative duties and also to teach students.

The current situation for lecturers in preparing the final examination question papers

is to manually format after keying in the question paper. Even a proper template

this process can be a lengthy process. The time taken for preparing question paper

can be shortened so that lecturers can have more time for other responsibilities. The

lecturers also have to determine whether the questions as defined in teaching plan

follow Bloom's Taxonomy.

Bloom's taxonomy consists of cognitive, affective and psychomotor domains

of a learning process. Cognitive domain of learning consists of 6 categories namely:

knowledge, comprehension, application, analysis, synthesis and evaluation. While

psychomotor domain consists of 7 categories: perception, set, guided response,

mechanism, complex overt response, adaptation, and origination. Evaluators

commonly will evaluate students based these levels to grasp their level of learning.

With this system, lecturers can produce high quality format questions paper faster.

This system will be implemented at a pilot stage which is at a faculty level of

institution of higher learning.

I

2

1.1 PROBLEM STATEMENT AND OBJECTIVE

A generator allows lecturer to be more efficient in producing high quality

format question papers within a shorter time compare to the manual method.

A generator that complies with the university's question paper format

specification allows question paper to be more presentable for reviewers.

This system will also allow lecturer to identify the level of difficulty of the

questions and examination paper in general.

This project hopes to fulfil the following objectives:

a) To developer a functional examination paper generator that complies with

Universiti Malaysia Pahang's exam question specification while able to evaluate

question into its taxonomy category.

b) To obtain the requirement to fulfil final examination paper specification.

c) To test the system for future deployment within the faculty

j

1.2 REVIEW OF PREVIOUS WORK

a) Problem-Attic

Problem-Attic was developed by EducAide Software. This proprietary

software is able to access over 90,000 questions of various subjects and topics from

a variety of sources. It allows user to manage question paper, format question paper

according to type of questions (multiple choice question, essay, short answers) and

also print question papers. (EduAid software, 2013)

This system is able to obtain questions from storage (question bank). This system

also allows pictures to be added into the system.

b) Examview assessment suite

Examview assessment suite was developed by Turning Technologies. This

proprietary software contains question banks and more than 10,000 textbooks from

over 65 publishers. It also supports Optical Character Recognition for converting

hardcopy to softcopy. It also can generate tests from random questions stored in its

database. It also allows online test using their CPS student response system and

formats test papers. This system also can dynamically change the values in a

question but maintain its concept. (elnstruction, 2014)

This system does not have optical character recognition function. It also does not

evaluate the Bloom taxonomy category of the questions made.

c) Exam Software Test Engine

Exam Software Test Engine is a freeware test management software. It supports

Multilanguage and is ideal for competitive exams whereby examinee have to

answer multiple choice questions. Parents can keep track of their child's

performance easily while teachers can conduct assessment easily. Exam Software

test engine allows teachers to set the marking system of the assessment. It allows

teachers to include graphics, audio and video in the question. It also has email

notification facility. It also encrypts its file in .exm format. (Exam-software.com ,

2013)

QuestNo; J r'Question Type: Negati Makii Me Choice MjiIeAnswers J I

Tc, mAlocatim Mtste Chcice SieAnswes I Sec in 11HIHIMAIMIRM

FItnTheBIanks Top.Lizt Tiue or False Yes of r2 Essay Type De dive Answer - rted in veins and arteries. What is the difference between veins and arteries? (Select multiple)

r

i r4

and arteries are connected by much smaller blood called 'capillaries', in which substances are

iged between the blood and the body's tissues.

r6=

Arteries carry blood away from the heart, while veins carry it to the heart

ems are much wider than arteries.

Veins carry only red blood cells, while arteries carry only white blood cells.

Arteries are permanent,but veins are constantly. being broken down and replaced.

'I

Veins have valves but arteries do not.

---.- -. .- —

soctxayses I Mach !ma MchAuo&xeo lstcteciI I. I , e1te T Jeer I .Q

Figure 1-1: Question designer in Exam-software test engine

This system does not have encryption function and the questions are not able to be

evaluated automatically into its Bloom taxonomy category.

4

CIII ?.

5

1.3 CURRENT SYSTEM AND ITS LIMITATION

There is no such system to format the examination papers in Microsoft Word;

lecturers have to manually format the papers using Microsoft Word. Manually

formatting the question according to the guidelines can be a tricky process as some

configuration can affect whole paper's layout. With this system lecturers can

optimise their time for other activities such as administrative work, research and

also lecture preparation.

1.4 TERMINOLOGY

Abbreviation Definition

FSKKP 'Fakulti Sistem Komputer dan Kejuruteraan

Perisian'

GB Gigabyte

GHz.. Giga Hertz

IEEE Institute of Electrical and Electronics

Engineering, Inc.

RAD Rapid Application Development

SDD Software Design Description

SRS Software Requirement Specification

UML Unified Modelling Language

1.5 METHODS OF APPROACH

Table 1.1 shows the comparison of several software development lifecycle models.

Source Model Stages Scenario Comments

name

Ritting Rapid 1. Requirement Small & To provide a

house, Applicatio analysis medium prototype for

2004 n 2. Design projects the client. An

Developm 3. prototyping iterative

et (RAD) 4. Development development

5. Integration process.

6. Testing Continuous

engagement

with client

Boehm Spiral 1. Determine High risk Allow for

1988 model objective, project continuous risk

2. Evaluate, assessment for

identify, resolve lesser bugs.

risks Mainly for high

3. Develop risk projects

4. Plan next such as atm

phase system

Schaw Scrum 1. Sprint Complex Uses an

aber & planning but low iterative,

Sutherl 2. Daily serum risk incremental

and, 3. Sprint review project approach to

2013 4. Sprint optimize

retrospective predictability

and control risk

in a software

project

Royce, Waterfall 1. System For large Lack of

1970 model requirements systems backtracking

2. Software incases of errors

requirement in one of the

3. Analysis stages

4. Program

design

5. Coding

6. Testing

7. operations

Table 1-1: Software development lifecycle model

As mentioned above Rapid Application development is a methodology which

allows client's to see a prototype of the system. This helps in requirements

elicitation and also as a milestone for the project. Waterfall model when compared

to RAD, waterfall does not allow the backtracking of one stage to the previous

stage while RAD is a continuous iteration of the process till a finished product is

produced. But when compared to spiral model, RAD lacks in the risk assessment

management of the project. Spiral model allows bugs and errors to be continuously

resolved. For scram model, it is more suitable for project which progress is

predictable. The scram models does not cope to risk better than spiral model, it

need scram team member to communicate often to track progress and to solve

problem that the team members could not solve individually.

For this project Rapid Application Development model will be used. This is

because the project scale is within the small- medium range. The prototypes

developed in this project can be used as a milestone to track its progress and be

used as a next module requirement aid. By using prototypes it allows the developer

to engage with the client continuously to obtain feedback mostly on usability. Tests

are run at the end of each module production to ensure compatibility between

modules and lower the risk of bugs and error. This model allows the progress to

speed up the development process as the goals become clearer.

8

1.6 SCOPE

The scope of this project is defined as below:

User

a) The users of this system will be the lecturers from FSKKP

System

a) A system of the Microsoft Word using visual basic for application (VBA)

extension

b) A system that allows Microsoft word user to produce a properly formatted final

examination paper which complies with UMP examination guidelines.

c) Contains a module to determine the category of questions based on Bloom's

Taxonomy using brute force string matching.

1.7 OUTLINE

This document consists of four (4) parts: introduction, system specifications,

system design and conclusion. The specifications and system design description

will be discussed in chapter 2 and chapter 3 respectively and the project's

fulfilment condition will be stated in part 4, conclusion.

For requirements specification, it will specify what the system will do. This

deliverable of this phase will be a Software Requirements (SRS). Interviews

sessions will be held with the FSKKP lecturers to obtain the problem faced without

this system and their functions they hope be included in this system. A survey is

done to investigate the problems in formatting the final examinations paper and also

additional requirements from the stakeholders (Lecturer) of this project. Also a

document analysis will be done in order to study the examination format guideline

set by the university. Once the requirement has been collected and compiled in the

SRS, the client will need to sign an agreement as a proof of agreement on the

contents stated in the SRS. In the SRS, flowcharts will be used to depict the

functionality of the system. UIVIL diagrams such as Use Case diagram and Use

Case description will be used to represent the functionalities of the system

graphically.

For design description, it will specify how the system will work. The

deliverable of this phase will be a Software Design Document (SDD). The SDD

will be the main reference used during the development phase of this project. In

SDD, the data dictionary, variable and also equations of the system will be shown.

The hardware and software used by this system will be shown.

Chapter 4 will include the condition of the project fulfilment, system results.

The objective of this project will be revised and concluded. The limitations of this

project will also be stated along with the possibilities future enhancement to the

project

CHAPTER 2

USER REQUIREMENTS

In this chapter, the user requirements for Final Examination Questions Generator

will be discussed. The purpose of the chapter is to identify the functionalities, users

and the environment where this system will be deployed.

2.1 System functions

This system shall:

a) Allow users to create the front page of the final examination question paper

b) Allow users to select existing questions from a question bank to be included

the final examination question paper

c) Allow users to insert/ create new examination questions into the question bank

d) Evaluates the questions based on Bloom's Taxonomy(cognitive)

e) Calculate the total marks of the created question paper

f) Allow users to review the summary of the created final examination question

paper

g) Allow users to manage the lecturer database, course database

I

2.2 Context Diagram

Figure 2-1 shows the context diagram of the Final Examination Question Generator

system.

Figure 2-1: Context diagram of Final Examination Question Paper Generator

12

2.3 Data Flow Diagram Level-O

Figure 2-2 shows the data flow diagram level-O of Final Examination Question

Generator.

Leturer

tO

Crept. Front page

dale 60

Manage

Court database

lrt-^

Dl Course database

----CaUrSO roe.nuI firm

lecturer database

du D2Lectu

390

dat,

I'--a--. 2.0

ettion Paper

IJInrmirV Manage questions

QutiDrJ Drift Specify formal

lmlsllnzquestivm New

uiilin 03 Question

summary bank

4.0 p.

Generate ques tion summary

Figure 2-2: Data flow diagram Level-O of Final Examination Question Paper

Generator

13

2.4 Data Flow Diagram Level-i

Create front page module will allow lecturers to create front page using data stored

in lecturer and course database. Refer to Figure 2-3.

1D2 Lecturer detaiis--------ldatabasease 1.1

Lecturer [__addltional details Additional details

Front page details

(

"I

Specify formatj

Figure 2-3: Data flow diagram level-i (create front page)

details— 01 Course database

ILl

The generate question module allow users to select existing question from

question bank or create a new question which will be store in the question bank

later. The created/ selected question will then be evaluated based on taxonomy

category and its summary which includes evaluation results and marks will be sent

to review question summary module. The question details will then be sent to

format specification module for draft creation later. Refer to Figure 2-4.

4.0

Existing 2.2

Existing questions __- Select question I Question[summary

____________Question

3.0 Draft

03 Question New questionbank Format

fication

(Th ,s details ______________1T1'1_.-Q--uestjon details

2.1

Evaluate

Question -4—Cognitive level—

Review question summary

Figure 2-4: Data flow diagram level- 1(manage questions)

15

The specify format module will generate the examination question paper based

on the inputs from the manage question module and create front page module.

Refer Figure 2-5.

1.0

Create front page

Front page draft

2.0 3.1

'Generate Compile front

questions page

Questions Formatted

Draft front page

321 1

Formatted Compile [Question Compile

questions question paper

Qut5ticn paper details

3.5

Generate Examination

Paper

Question

Figure 2-5: Data flow diagram level-i (specify format)

2.0Question

Generate summary

questions

I 0

The review question summary allows lecturers to view the final examination

question paper draft and the question summary (taxonomy category and marks).

Refer to Figure 2-6.

Figure 2-6: Data flow diagram level-i (generate question summary)

Y/

The manage lecturer database module allows lecturers to manage (add, delete,

update) lecturer data in lecturer database for this system's use. Refer to Figure 2-7.

02 lecturer database

Lecture data

1.0 1I 5.1

Create front - -. Manage page lecturer details

Lecturer details

[

Lecturer

Figure 2-7: Data flow diagram level-i (manage lecturer database)