Systems Engineering Final Presentation

33
1 Team Members: Kenneth Bonek Jeffrey Koscho Rodney Morris Atul Sharma Christopher Ziemniak  Group #2 Voting Options Technical Enterprise (iVOTE) Syst em

Transcript of Systems Engineering Final Presentation

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 1/33

1

Team Members:

Kenneth Bonek 

Jeffrey Koscho

Rodney Morris

Atul Sharma

Christopher Ziemniak  

Group #2

Voting Options Technical

Enterprise (iVOTE) System

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 2/33

2

Project Description

•Statistics have been compiled to stress rank of importance of key

factors in voter dissatisfaction in engagement with registration and

voting process

•The Federal Election Committee is overseeing the task of 

modernizing the overall system to improve voter satisfaction

The mission of the Federal Election Committee is to propose,implement, and maintain new standardized multidimensional system 

Problem Statement:

The current national voting system has caused a decrease in voter satisfaction

by 24.2% over the last five years, creating an anticipated 20% decrease invoter turnout over the next four years

Objective:

To be able to increase voter satisfaction by over 25%

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 3/33

3

Objectives Tree

3

3

Objectives Tree

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 4/33

4

Functional Decomposition

•Aids the requirement development process

•Describes what the system does (stays agnostic)

•Key challenge areas: authentication and securing information

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 5/33

5

Requirements Analysis

Unique Identifier Requirement Type

iVOTE-1.0-001-F The voting system shall allow at least 85% of voters to vote remotely Functional

iVOTE-1.0-002-F The voting system shall provide voters at least 3 different voting methods Functional

iVOTE-1.0-007-F The voting system shall protect the voter’s privacy by having less than one unauthorized

disclosure per 1,000,000 voters

Functional

iVOTE-1.0-008-F The voting system shall secure all voting information by having less than one unauthorized

disclosure per 1,000,000 voters

Functional

iVOTE-1.0-009-F The voting system shall secure the voting environment by having less than one

unauthorized disclosure per 1,000,000 voters

Functional

iVOTE-1.0-015-F The voting system shall authenticate the voter based on unique information that only the

voter knows with at least 99.9% accuracy

Functional

iVOTE-1.0-016-F The voting system shall store all voting information with an integrity failure rate of less

than 1.5%

Functional

iVOTE-1.0-018-F The voting system shall authenticate the voter with at least a two-factor authentication

method

Functional

iVOTE-1.0-001-P The voting system shall increase voter satisfaction by more than 25% Performance

iVOTE-1.0-003-P The voting system shall reduce manual recounts by at least 75% Performance

iVOTE-1.0-004-P The voting system shall decrease the amount of time voters spend at polling centers by atleast 20%

Performance

iVOTE-1.0-001-In The voting system shall accommodate at least 99% of disabled voters Interface

iVOTE-1.0-002-D The voting system shall use modern technology that has a TRL of at least 7 Design

iVOTE-1.0-001-O The voting system shall reduce the number of polling station facilities by at least 30% Operational

iVOTE-1.0-001-I The voting system shall maintain a reliability of at least 98.5% -ilities

iVOTE-1.0-001-C The voting system shall reduce maintenance costs by at least 40% Constraint

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 6/33

6

Functions-to-Requirements Matrix

i VOTE-1.0.004-F: The voting system

shall allow at least 85% of voters toremotely register to vote

i VOTE-1.0.004-F: The voting system

shall allow at least 85% of voters to

remotely register to vote

i VOTE-1.0.001-P: The voting system

shall increase voter satisfaction by

more than 25%

Func

Rqmt

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 7/337

Risk Assessment

•Overall A3 has least risk;

A1 has most risk

•Information security

poses most significant risk

•Mitigation against

information security risk

 – Policy → protect

confidentiality, integrity, and

availability of information in

transmission, storage, and

processing states

 – Threat and vulnerability

assessment

 – Apply safeguards• access controls

• encryption

• authentication

• auditing and logging

• guards

• cameras

• alarms

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 8/338

Economic Analysis

ESSENTIAL COSTS A-1 A-2 A-3

Software Development

Web Application

Web ServicesSmartphone Application

$550,000 $550,000

$300,000

$200,000

$550,000

$300,000

$200,000

USB Authentication

Device $6B

Firewalls

Medium

$150,000

Medium

$150,000

High

$200,000

Intrusion Prevention

System

Medium

$60,000

High

$75,000

High

$75,000

Data CenterServers

Power

Cooling

RacksBuilding

$180M $200M $200M

SoftwareServer OS

Antivirus

Database

$350M $400M $400M

Internet ServiceT1

OC-3

$6000/yr

$300k/yr

$6000/yr

$300k/yr

$6000/yr

$300k/yr

• Cost comparison between historic voting

methods versus new modern technical options

• Virtualization can decrease data center costs by

30%; geographic location of datacenter can save

costs

•Data Center and network security costs are

comparable between A-1, A-2, and A-3

•USB Authentication only impacts cost of A-3

($6B) – not feasible with budget constraint

•Software costs for A-2 and A-3 ($1.05M) slightly

higher than A-1 web application cost ($550K)

•A-2 and A-3 cost more than A-1 to design and

develop, but provide more value

•Reduction of ‘Per Voter’ cost by 96.4% 

Online vs. PaperOnline

$0.03 

Paper

$0.83 

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 9/339

Architecture Selection

•Evaluation criteria came from objectives and associated metrics

•Criteria values and weightings based on expert judgment

•Ratings based on 1-9 scale: 5-meets target; 1-completely misses target;

9-completely exceeds target

•Scores determined by multiplying each criterion rating by its associated

weight; final score for each architecture is addition of criteria scores

•A-2 has highest score; coincides with decisionmakers’ outcome from

Accord software

•Based on final score and findings in risk and economic analysis, A-2 was

chosen architecture 

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 10/3310

Sensitivity Analysis

Criteria Weights

% more voters satisfied since last election 4.5%

% remote voters 5%

% less polling station facilities 4.6%

Number of unauthorized disclosures per 1M voters of voter privacy 5.5%

Number of unauthorized accesses per 1M voters 5%

•Sensitivity analysis done on FEC top five most important objectives

•Analyzed each pair of these objectives by trading weights

•Also analyzed each of these against several lowest-weighted objectives

•Outcome of analysis showed that weightings for these criteria are not sensitive to weight change  

BaselineBaseline

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 11/3311

Functions-to-Components Matrix

•Matrix depicting functions from

functional decomposition mapped

to components

•Aids in verification that chosen

components incorporate all the

functions

•Depicts interrelationships

•Many functions are associated

with multiple components

•Contributes to traceability of 

system

Func

Comp

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 12/3312

OV-1

12

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 13/3313

Architecture Diagrams

13

OV-5

SV-1

OV-2

SV-4a

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 14/3314

QUALITY

ASSURANCE

TEAMS

V&V RESPONSIBILITIES

FEC Deliverable acceptance verification; process improvement verification

Voter Focus

Group

Product acceptance validation (customer satisfaction survey, functional and constraint

requirements check-off, validate that their votes were cast correctly post election)

iVOTE Team

Validate national data warehouse against local DBs for inconsistencies; validate that the system

works with minimal errors; validate that all functions are implemented from Functional

Decomposition document; validate network statistics against requirements; validate code

efficiency against requirements

FEC Validation Tool: Obj_1: To have voters spend 20% less time at polling centers

Obj_2: To be able to allow voters to spend 25% less time voting

Pre-i VOTE Post-i VOTE

Verification & Validation

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 15/3315

Topics Factors Affecting Feasibility:

Finances Congress funding approval; identifying accurate projected system cost

Politics Regulating governing states participation

Technology Information protection; throughput management; computer monitor privacy guard software

Knowledge Base Retention of 'forced voting' practices prior to concealed booth voting; resistance to change 

Topics Factors of a Successful Implementation, to be considered in Plan:

Probability of Failure Acquiring federal funding; handling high volumes of simultaneous ballot submissions

NecessaryResources

Funding; smart-phone licenses; data storage; DMV registered voter records; software licenses;hardware acquisition; contractors to develop system

Likely

Obstacles

Funding approval; throughput management; data protection advancements; malfunctioning

input devices

Implementation Overview

Schedule

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 16/3316

Conclusions

•Modernized voting system will make voting more efficient, less error-

prone, and easier to use, therefore increasing voter satisfaction

•Traceability and integration between depictions

•Importance of information security and management of it

•Saving money and helping environment through virtualization of 

servers

•Future :

 – More advanced analysis

 – Analyze registration process further

 – Voter acceptance of new system

 – Continually update FEC to secure congressional funding

 – Maintain and upgrade system through its lifecycle – Using NSA to monitor security during elections

 – Opening election to three days

16

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 17/3317

Backup Slides

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 18/3318

• Architecture Project Identification – Assumptions and Constraints: All voters can get access to the Internet; constrained by government funding and

bandwidth availability

• Scope: Architecture View(s) and Products Identification – Views and Products Developed: AV-1, OV-1, OV-2, OV-3, OV-5, (maybe OV-6b or c), SV-1, SV-5, (maybe SV-2 or 4)

 – Time Frames Addressed: Present-2016

 – Organizations Involved: FEC, voters, designers, developers

• Purpose and Viewpoint – Purpose, Analysis, Questions to be Answered by AoA: The purpose of this AoA is to derive the best solution from a

set of alternative architectures for the i VOTE system; Analyses to be performed include requirements analysis, riskanalysis, sensitivity analysis, and evaluation of the alternative architectures using selection criteria and weighting

• Context – Mission: To be able to increase voter satisfaction by designing a modern national voting system that is more

efficient, automated, less error-prone, standardized, and less confusing to use

 – CONOPS: New national voting system in place by the 2016 elections; standardized registration and voting process

across all the states; new system will be more efficient, less error-prone, be easier to use, and use moderntechnology; preference toward a system that is green and is cheaper to maintain than the current system

 – Information Assurance: Need to protect: Personal Identifiable Information (PII) and voting results information;i VOTE system network, hardware, and software from threats and vulnerabilities; confidentiality, integrity, andavailability of all information associated with the i VOTE system

 – Rules, Criteria, and Conventions Followed: Federal and states’ regulations 

• Findings – Recommendations: Voters can use home-based computers and smart phones to vote remotely

AV-1

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 19/33

19

OV-2

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 20/33

20

OV-3

20

OV 5 A ti it Hi h (1 f 2)

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 21/33

21

A0

Cast and Process Vote

A1

Authenticate Voter

A2

Capture Vote

A3

Protect Data

A1.1

Collect

Voter’s

Credentials

A2.1

Display Voting

InterfaceA2.2

Save Voting

Information

Locally

A2.3

Update the

National

Database

A2.4

Compile

Votes

A3.1

Encrypt

Data

A3.1.1

Encrypt Transmission

A3.1.2

Encrypt Storage

A3.2

Copy Info to

Offsite

Location

A3.3

Validate

Voting

Results

A3.4

Allow Admins

Access to Info

A3.5

Release

Results To

Media

OV-5 Activity Hierarchy (1 of 2)

A1.2

Grant

Appropriate

Access Upon

Validation

21

OV 5 A ti it Hi h (2 f 2)

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 22/33

22

OV-5 Activity Hierarchy (2 of 2)

A0

Register Voter

A1

Complete Registration

Process

A2

Complete Authentication

Process

A1.1

Collect Voter’s

Information

A1.2

Identify Voter

A1.3

Approve Voter’s

Registration

A2.1

Create

Credentials ForVoters

22

SV 1

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 23/33

23

SV-1

SV 4

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 24/33

24

SV-4a

SV 5b Di

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 25/33

25

SV-5b Diagram

A hit t D l t

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 26/33

26

Architecture Development

R d d A hit t

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 27/33

27

Reduced Architectures

A-1 A-2 A-3

VotingInterface

Web-based (SOA)

interface/application- web application

Web-based (SOA)

interface/application- web application

- smart phone

- web services

Web-based (SOA)

Interface/application- web application

- smart phone

- web services

Identification /

Authentication

Username/password

PIN

CAPTCHA

Username/password

PIN

CAPTCHA

Username/password

USB Device

CAPTCHA

Information

Protection

AES Encryption

Medium security

Firewall

Medium security IPS

AES Encryption

Medium security

Firewall

Maximum security IPS

AES Encryption

Maximum security

Firewall

Maximum security IPS

Pros / Cons

Lowest cost and easily

implemented within

schedule, but low

security and lack of 

variety with remote

voting options

Little margin for a

schedule slippage, with

moderate cost and good

security

No margin for a

schedule slippage,

with high cost and high

security

Full Architecture Scoring

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 28/33

28

Full Architecture Scoring

CATWOE

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 29/33

29

CATWOECustomers: Voters

Actors: Administrators (booth workers, technicians), voters, government

regulators

Transformation: Manual voting process -> automated voting process

Inefficient voting process -> efficient voting process

Expensive voting process -> less expensive voting process

Error-pone voting process -> less error-prone voting process

Non-standardized voting process -> standardized voting process

Confusing voting process -> clear voting process

World View: Modernized technology will streamline & enhance voting processes

Standardized automated process will increase voter confidence

Voter turnout may increase due to an improved voting process

Standardized voting process may increase the efficiency and

timeliness of polling results

Automated voting system will save tax dollars

Modernized technology will decrease the current carbon footprint of 

the voting system

Owner: Federal Election Committee (with representative from each state)

Environment Cost of implementing technology; technology availability;

Constraints: geographic area; weather; voting paradigm shift;bandwidth availability; government funding

S B d D fi i i

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 30/33

30

System Boundary Definition

State Government

Regulations

Decreasing

Voter

Satisfaction

FEC

Desire for

Standard

SystemVoters

Demand

Better

Polling

Process

INPUTS

OUTPUTS

Increased

Voter

Satisfaction

Modern

Voting

System

Increased

Voter

Turnout

Taxpayer

Savings

Positive

Environmental

Impact

FederalGovt.

Funding

Register AuthenticateCapture 

Transformation Process

ProtectSystem Boundary

Brief CONOPS

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 31/33

31

Brief CONOPS

•The Federal Election Committee (FEC) wants to have a

new national voting system in place by the 2016 elections

•The Federal Election Committee wants us to provide the

design for the new national voting system within 2 years

and within a budget of $5,000,000

•The new voting system must have a standardized

registration and voting process across all the states

•The new system will be more efficient, less error-prone,

be easier to use, and use modern technology

•The FEC would prefer a system that is green and is

cheaper to maintain than the current system

SOW Details

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 32/33

32

SOW Details

Propose the Project

Define the problem statement and objective

State what is to be done (project tasks) - WBSProvide the schedule

Define the system

Define the lower level objectives, targets, and metrics

Create a functional decomposition

State the requirementsPerform risk assessment

Provide several system design alternatives and analyze them

Architect the chosen solution

Provide a detailed description of the solution

Create the architecture depictions

OV-1, 2, 3, 5

SV-1, 5

AV-1

Describe the testing, validation, and verification of the solution

Create the implementation plan

Provide the final report

Project Schedule

7/28/2019 Systems Engineering Final Presentation

http://slidepdf.com/reader/full/systems-engineering-final-presentation 33/33

Project Schedule