Application Portfolio Assessment - Info-Tech Research...

6
Application Portfolio Assessment

Transcript of Application Portfolio Assessment - Info-Tech Research...

ApplicationPortfolio

Assessment

SUITE OFAPPLICATIONS

70%

Overall ApplicationsPortfolio Satisfaction

Overall portfolio satisfaction is anindication of end user sentiment inthe organization overall.

This metric enables the IT leader todetermine at a glance if they aremeeting the needs of the business.

Application PortfolioComponent Satisfaction

Aggregated across all ratedapplications, scores on usability,

features and data quality providean overall indication of the

effectiveness of the applicationsportfolio.

Number of Applicationsby Importance &

Effectiveness

Evaluating the number of applications within eachquadrant is a first step in assessing the health of theoverall portfolio, and in determining whichapplications require immediate action.

75%Usability

--%vs Last Year

74%Features

--%vs Last Year

78%Data Quality

--%vs Last Year

Impo

rtan

ce

Unu

sed

Nic

e to

Hav

eIm

port

ant

Mis

sion

Criti

cal

ExtremelyIneffective

ExtremelyEffectiveEffectiveness

(Features + Usability)

HAZARDOUS

0CONTENTIOUS

1EFFECTIVE

5UNWANTED

0QUESTIONABLE

4UNLEVERAGED

7

Five Most CriticalApplications

The most critical applicationsto an organization are those

most widely used and rated byusers as very important to

their job. Underperformingapplications in this group

should be an immediate focus.

Applications

Users

Importance

Features

Usability Data

Quality Status

Microsoft Outlook Email 434 97% 85% 86% 87% Effective

Microsoft Outlook Calendaring 434 87% 85% 86% 86% Effective

Ticket System IT ServiceDesk 434 70% 70% 73% 77% Effective

SAP Crystal Reports 434 57% 60% 60% 73% Contentious

Microsoft Lync 434 43% 81% 83% 80% Unleveraged

Five MostUnderperforming Apps

The most underperformingapplications are those that

have the lowest effectiveness.Improvements to these

underperforming applicationswill have the widest affect on

the organization.

Applications

Users

Importance

Features

Usability Data

Quality Status

ISI Journals ManagementSystem 200 13% 40% 38% 47% Questionable

Nevis2012 200 22% 58% 57% 67% Questionable

SAP Crystal Reports 434 57% 60% 60% 73% Contentious

SAP SAP Business Planning andConsolidation 27 37% 64% 67% 83% Questionable

Decision Center 434 18% 65% 66% 69% Questionable

Five Lowest Data QualityApplications

The most data impactedapplications had the lowest

data quality score according toend users. These applications

should be assessed for dataquality immediately.

Applications

Users

Importance

Features

Usability Data

Quality Status

ISI Journals ManagementSystem 200 13% 40% 38% 47% Questionable

Nevis2012 200 22% 58% 57% 67% Questionable

AIM (Animal InventoryManagement) 37 19% 72% 68% 68% Unleveraged

Decision Center 434 18% 65% 66% 69% Questionable

myPreclinical 200 18% 66% 68% 70% Unleveraged

vs Last Year

Applications Overview End User Diagnostic

Slice Co.434 Responses

BUSINESS ENABLEMENT

70%3%

Compared toCompany

IT SERVICES

65%1%

Compared toCompany

IT COMMUNICATIONS

68%--%

Compared toCompany

SUITE OF APPLICATIONS

69%1%

Compared toCompany

(Department) Business Enablement NetSupport Score

CompanyInnovation 30%

IT Agility --%

DepartmentTechnology

Enablement-7%

(Department) IT Communications NetSupport Score

Training -7%

FeedbackReceptivity -30%

Professionalism 61%

(Scored 8 - 10)

Supporters(Scored 7)

Neutral(Scored 1 - 6)

Detractors Supporters - Detractors

IT Support Breakdown

(Department) Services Overview IT Services Importance & Satisfaction

Core Services

Importance

Rating Compared

to

CompanySatisfaction

Application Suite 3 rd 5 th 2 69%

Service Desk Effectiveness 5 th 4 th 1 65%

Analytics & Reports 6 th 6 th -- 59%

Policies 7 th 7 th -- 59%

Service Desk Timeliness 4 th 3 rd 1 58%

Devices 2 nd 1 st 1 57%

Network 1 st 2 nd 1 45%

Number of Applications by Importance & Effectiveness

Impo

rtan

ce

Unu

sed

Nic

e to

Hav

eIm

port

ant

Mis

sion

Criti

cal

ExtremelyIneffective

ExtremelyEffectiveEffectiveness

(Features + Usability)

HAZARDOUS

0CONTENTIOUS

0EFFECTIVE

6UNWANTED

0QUESTIONABLE

3UNLEVERAGED

1

Application Features & Usability

Feat

ures

Extr

emel

yD

issa

tisfie

dEx

trem

ely

Satis

fied

ExtremelyDissatisfied

ExtremelySatisfiedUsability

UPGRADE

0MAINTAIN

6REASSESS

3RETRAIN

1

(Department)Applications Portfolio

Overview

The collection of applications that a department interacts with daily has considerableimpact on end user productivity. Use this data to derive insights for areas to improvein this department.

Importance & Effectiveness by Department

Applications

Importance

Features

Usability Data

Quality Status

Recommend.

Microsoft Outlook Email97%

100%85%

88%86%

90% 89% Effective Maintain

Microsoft Outlook Calendaring87%

97%85%

89%86%

91% 89% Effective Maintain

ICM (Internet Colony Management)

33%92%

73%78%

68%73% 81% Effective Maintain

LTM (Laboratory Testing Management)

37%82%

71%74%

70%74% 80% Effective Maintain

IT ServiceDesk70%

72%70%

68%73%

81% 75% Effective Maintain

Microsoft Lync43%

54%81%

88%83%

88% 82% Effective Maintain

SAP Crystal Reports57%

41%60%

43%60%

37% 70% Questionable Reassess

Employee Self Service37%

18%74%

63%76%

68% 67% Unleveraged Retrain

Decision Center18%

18%65%

63%66%

60% 70% Questionable Reassess

Manager Self Service18%

8%67%

65%72%

60% 60% Questionable Reassess

Company Average

Company Average

70%

70%

64%

69%

65%

67%

66%

Department 7 Overview End User Diagnostic

Slice Co.13 Responses

Satisfaction Metrics

57%Importance

15%Compared toCompany

60%Usability

15%Compared toCompany

60%Features

14%Compared toCompany

73%Data Quality

5%Compared toCompany

Number ofDepartments by

Features & Usability

Ease of use and features capability can variablyimpact application effectiveness. Understand enduser perspectives in this regard to decide onmitigation strategies.

Feat

ures

Extr

emel

yD

issa

tisfie

dEx

trem

ely

Satis

fied

ExtremelyDissatisfied

ExtremelySatisfiedUsability

UpgradeDept. Users Imp.RADS 6 44%

MaintainDept. Users Imp.

27 89%

26 73%

19 60%

11 79%

14 45%

7 71%

10 30%

Department 6

Department 5

Department 12

Department 13

Department 3

Department 6

Department 11

Department 16 1 67%

ReassessDept. Users Imp.

145 58%

26 54%

22 62%

17 61%

15 67%

26 38%

13 41%

15 33%

8 50%

Department 4

Department 2

Department 14

Department 5

Department 15

Department 7

Department 10

Department 9

Department 8

Department 1 9 41%

RetrainDept. Users Imp.

Importance &Effectiveness by

Seniority

Stakeholders often have very different perspectives on the importance and effectiveness ofkey applications. Ensure everyone is on the same page and facilitate discussions where thereare discrepancies to ensure mitigation strategies target the right user groups.

Executive

1%of user base

5Users

Importance

LevelPercent of

UsersFeatures

Usability Data

Quality

Score

Critical 20% 80% 60% 80%

Important 20% 60% 50% 80%

Nice to have 20% 30% 30% 30%

Do not use 40% --% --% 90%

Director

10%of user base

42Users

Critical 23% 72% 73% 82%

Important 30% 58% 57% 76%

Nice to have 21% 33% 37% 62%

Do not use 23% 33% 20% 25%

Manager

29%of user base

128Users

Critical 28% 61% 59% 74%

Important 30% 57% 61% 72%

Nice to have 20% 48% 49% 57%

Do not use 21% 37% 53% 44%

Front Line

60%of user base

259Users

Critical 32% 68% 64% 80%

Important 32% 64% 66% 76%

Nice to have 17% 56% 53% 67%

Do not use 17% 35% 18% 50%

Companyavg.

SAP Crystal Reports Scorecard End User Diagnostic

Slice Co.434 Responses

Status

Importance

Features

Usability Data

QualityResponses

Department 5 Contentious Reassess 58% 56% 57% 72% 145

Takes too much unnecessary time to enter in studies.

Being able to document which studies I spend the most time on so future billing can bedone properly.

Mainly use it for timesheets. input is slow and workflow is long when needs to makecorrections

Takes a long time to complete, taking away from other work that needs to be done.

Nice for timecard entrys.

Logging time in SAP is very time consuming especially in the department we work in.

There are so many categories for time entry that excessive time is taken just to fill outtimesheets. The screen automatically goes to the next week after Saturday and severaltimes myself and others mistakenly enter time in the wrong week. Hours assigned tostudies do not fully reflect the time needed so often studies exceed the hours given, butthe hours were not realistic from the start.

NA

Quick to use

N/A

I cannot get a summary of hours used on a study, which is critical for managing studies.Completion of milestones and invoicing schedules relies on paper printouts beingcirculated for manual completion rather than direct entry by staff.

sometimes takes forever

not user friendly all information do not enter in the screen (have to scroll all the time) toosmall, hard to read complicated to understand

Timesheet, orders

Lags a lot on certain days ( especially friday afternoon when a lot of people are using it )Other than that its easily used and makes a clear timesheet.

Filling time sheet is very time consuming. To many steps to do.

n/a

I mostly use SAP for Time Sheets (entering my time and approving department timesheets)and I find it slow. It sometimes freezes or kicks me out. I am not able to pull reports for mystaff like I could with the old application. I can only look at the history of my own timesheet. I cannot go back and view an older timesheet of another employee or see howmuch vacation, personal, accumulated time they have like I could with the old system. Ifthere is a way to pull reports I don't know about it.

in ability to pull reports independantly, these must be requested from finance or have aseparate application (SAP dashboard) built to accomodate.

It would be useful if reports were more freely available for web users instead of having toreply on the application license holders

Only used for completing timesheet. Would be more user friendly if more than 5 dataentry rows were shown at one time. It's quite slow to load the next 5 which sometimesmakes flicking between rows to check overtime/normal time is recorded correctly hard

no reports available directly from the tool. OT, Personal days, vacations, etc...

Comments specifically for SAP timesheet. Not user friendly. Soemtimes it's down.Soemtimes it's slow. Time consuming to enter SAP timesheet every week.

Able to track hours but it is not very user friendly.

For timesheet, very long to do!

Q: What about the following applications makes it most helpful or detrimental to you performing your job effectively?

SAP Crystal Reports Comments End User Diagnostic

Slice Co.434 Responses

N/A

Slow to complete, could be more user friendly

Used to do time sheet. Not user friendly. If the following changes could be made, it wouldhelp: if we could see more than 7 lines on the same page; if we could select study/activities/code all in one window instead of opening windows 3 times; if there was an autocalculate number of hours once entered instead of having to save every time to see howmany hours there is; if the system could show the total numer of hours entered for eachcode instead of total, etc.

Really not user friendly. Multiple fonctionality not really easy to find.

It's frustrating when the system is very slow due to high volume traffic. We are unable tocomplete our tasks in a timely manner

interface not user friendly. to much details to enter, take too much time

It is usefull to determine time passed on each activity, but not usefull for my jobperformance. I waist a lot of time entering activities on projects and it is not used in anyway in the departement. No possibility to extrac time passed on a study.

Not user friendly, not possible to copy and paste, way too much clicks needed for a singleentry, project window not fitting in the screan, not possible to organize projects innumerical order

Lengthy and time consuming process to input each study function by function.

The fact that network issues kill efficiency and productivity;the fact that the SAP ProjectSystems Express Termination error has lost me personally weeks of business hours in losttime, forcing the work to be repeated and when this error arises there is no way toassociate it with the project that had the error is multiple sessions are conducted at onetime.

Very slow and difficult to navigate; on a broader scale I feel entering my times into SAP is acomplete waste of my time.

The layout of SAP timesheets makes it very awkward to review individual timesheets priorto approval. The number of times you are required to click 'review' or 'save' before yourinformation is actually saved is ridiculous and makes added information timesheets far tootime consuming to be done daily.

Helpful for day to day computing

n/a

8 lines for recording working time is inadequate. We have to do manual overtime/TIL andholiday recording in addition to using SAP.

timesheet should have more rows per page

Excruciatingly slow, cumbersome and when it crashes (and it will crash), you loseeverything you tiresomely entered.

its a great software for timesheet

new coding take a little more time but I gues it is necessary

I'm a PC person and SAP is not really frendly user. For exemple if a use the wrongQuotaton type with the wrong material system allow me too but then I 'm unable to dosales order so I need to cancel everything (we should have a worning there or systemshould not alow us to save) and start over properly. In the other hand, we have someworning that are not necessary.

Can review past few weeks worload for certain studies. Cannot view long periods of timeeasily

It takes a long time to fill out a timesheet, but I'm not sure there is anything we can doabout it since the company seems to want such detailled information. The more detailledthe longer it takes.

Incredibly time consuming and not very user friendly.

least time consuming

SAP Crystal Reports Comments End User Diagnostic

Slice Co.434 Responses