Table of Contents Setup Improvement & Measurement Model...

Lean Agile Intelligence Facilitators Guide

Table of Contents

•Setup

• Improvement & Measurement Model

•Team Level

•Strategic Objectives & Desired Outcomes

•Self-Assess

• Identify Tactical Goals

•Measure

•Organization Level

•Business Unit Level

•Program Level

•Self (Individual Role) Level

•Appendix (Advanced Calculations)

Setup - Terminology

Lean Agile Intelligence Terminology

Organization Lean Agile Intelligence unique instance for an enterprise’s assessments and users

Organization Structure Hierarchical structure that enables grouping of “Teams”

Team A group of users that will take a “Self-Assessment”

Group A collection of “Teams”

Organization Members Users invited to an Organization

Organization Admin Controls setup of the Lean Agile Intelligence unique instance, and has access to all functionality

Super User Ability to build “Assessment Templates,” conduct “Self-Assessments,” and view all team “Results”

Team Member Participates in “Self-Assessments” and can only view “Results” for “Teams” they are assigned to

Practices An Agile or Lean Technique

Agility Stage The different levels of maturity for each “Practice”

Agility Stage Criteria Criteria provided to teams in each “Agility Stage” to help assess themselves

Assessment Template A group of “Practices” that can be used for “Teams” to conduct a “Self-Assessment”

Self-Assessments The act of the “Team” assessing themselves using an “Assessment Template”

Self-Assessment Votes The “Agility Stage” vote provided by each “Team Member”

Assessment Results The “Results” of a given assessments or group of assessments viewed in the Lean Agile Intelligence Dashboard

Setup: Organization Structure

Create Group

• “Groups” consist of multiple teams and allow

organization users to see aggregated results

across multiple teams

• Some examples of “Groups” are Business Units,

Component Units, or Programs

Create Team

• A “Team” is any group of users that will take a

“Self-Assessment” together

• They can be used to define any type of team in

the “Organization” including development,

leadership, or operations

Setup: Invite Members To Organization

Invite Members

• “Members” of an “Organization” are those that will participate in an assessment and/or

analyze “Results”

• Note in order for “Members” to become part of an “Organization” they have to be invited by

the “Admin”

Setup: Assign Member Attributes

Status

• Active: Member can access LAI and is

included in billing

• Inactive: Member can no longer access LAI

and is not included in billing

Permissions

• Admin: Permission to all functionality including

conducting “Self-Assessments” and “Organization” setup.

Can view all “Team” results.

• Super User: Permission to build “Assessment

Templates,” facilitate “Self-Assessments”, and view all

“Team” results.

• Team Member (Default When Invited): Permission to

participate in “Team” “Self-Assessments.” They can only

view their “Team” results.

Team Role (Optional)

Teams

• Members assigned to a “Team,” will receive

an email when that “Team” launches a “Self-

Assessments”

• “Members” can belong to more than one

“Team”

Setup: Simple vs Advanced Calculation

• Simple (Default): One level of Practice To Business Outcome impact. No weighting is applied in Practice to

Business Outcome Impact Ratio calculation and Business Outcome aggregated scores. Business Outcome

aggregated score is the average of all practices answered that impact the outcome.

• Advanced: Three levels (Must Do Well, Should Do Well, Nice if Done Well) of Practice To Business Outcome

impact. Weighting (Must Do Well (5x), Should Do Well (3X), Nice if Done Well (1X)) is applied in Practice to

Business Outcome Impact Ratio calculation and Business Outcome Agility Stage average score. Business

Outcome Agility Stage average score (0-4) is a weighted average that takes into account the number of

practices that impact the outcome, the average agility stage vote for each practice, and the magnitude of the

impact.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Lean Agile Intelligence Improvement & Measurement Model

Enterprise

Unit

Program

Team

Self

For Every Level of Today’s Agile Organization……

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

Lean Agile Intelligence Improvement & Measurement Model: Team Level

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Consider Team Context

• What outcome are we looking to achieve

given our context?

• Do we have clear priorities and does it align

to the organization's goals for the year?

• What do we need to focus on to help us get

there?

• What are some of the team challenges?

• How are we going to measure that outcome?

Consider Organization Context

• What is the purpose and mission?

• What are the strategic goals and how can we

contribute?

Strategic Objectives: Assessment Templates

Frameworks• Assessment Templates derived from

the core reference guide of the

following frameworks:

• Scrum

• Kanban

• XP

• SAFe

• Essential SAFe

• Lean Startup

Curated• Curated (framework agnostic)

Assessment Templates focus on specific

areas of practice and are influenced by

Agile and Lean thought leaders. Existing

Templates include:

• Team Fundamentals

• Team Culture

• Spotify Team Health

• DevOps

• Technical Excellence

• Scrum Plus

• Enterprise Agility

Custom• Want the best of both worlds? Build your

own template using the Lean Agile

Intelligence Assessment Template

Builder.

• Pick and choose practices from our

Framework and Curated assessments to

tailor an assessment template unique to

your objectives, culture, and challenges.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Answers to those questions will give you the insights needed to determine what business outcomes your

assessment template should be geared towards and which practices it contains. Lean Agile Intelligence offers a

variety of different assessment template types.

View an Assessment Template in the

Builder by choosing an Assessment

Template and Selecting “Open”

Strategic Objectives: Assessment Template BuilderMeasure

Strategic Objectives

Self-Assess

Tactical Goals

Add your own

Custom Practices

Select Practices for

your Template

Framework/Curated

View of Practice

Catalog

Name of TemplateOpen Existent

Template

Practice Dimensions:

Logical Grouping of

Practices

Practice to Business Outcome

Impact Ratio: Weighted Ratio

of Practices in the Template

that Impact the Business

Outcome

Impacted Outcomes

Practices in

Template

Reference(s) Used To

Create Practice Criteria

Save an Existing

Template and

Customize it

Hover over practice impact ratio to see a breakdown of the

number of practices in the assessment template and the

weighting impacting the outcome.

Strategic Objectives: Practice CriteriaMeasure


Self-Assess

Tactical Goals

Impacted Outcomes

Practice Name

Agility Stages

Agility Stage

Criteria presented to

the Team during

“Self-Assessment”

Copy & Customize

Click a Practice to see the Criteria in each Agility Stage that will be presented to the

Team during a Self-Assessment.

Strategic Objectives: Assessment Template Auto GeneratorMeasure


Self-Assess

Tactical Goals

Customize Number Of

Practices in Template

Choose/Weight the

Outcomes that you

want your Assessment

Template Practices to

Impact

Hover over the Business

Outcome Names

to see the LAI Definition

Choose to Include/Exclude

SAFe Practices

Lean Agile Intelligence will generate a tailored Assessment Template given your unique desired

outcomes

Generate the

Assessment

Template when you

have a total of 100%

and the

Assessment

Template will

open in the Builder

• What practices will help us achieve our desired

outcomes?

• How are we performing in those practices?

• Who is best to provide this information?

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Self-Assess: Facilitator Checklist

• Ensure that all members of your team are active members of LAI, and are assigned to the correct teams.

• Remind participants (team members) that they will be receiving a link from Lean Agile Intelligence to

participate in an assessment.

• Remind participants (team members) of the Voting Guidelines; stage criteria should be read left to right.

When criteria is encountered that they feel their team does not meet, the previous stage should be selected.

• Encourage participants to record notes on “why” they voted for the selected Agility Stage on each

practice.

• The assessment will have to be “launched” for the specific team in order for the assessment to be answered

by team members.

• Decide if the team will get more value of taking the assessment as a group in real time, or individually, and

then reviewing the results together.

• Facilitators can monitor the completion of individual assessments using the Self Assessment Platform. They

will also receive an email when each participant has completed the assessment.

• When the individual facilitation type is used, facilitators should schedule a meeting to review the results

when all votes are received. The Practice Details Results Tab should be used for this review. At this time

practices can be marked as goals or impediments.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Self-Assess: Conducting Self AssessmentsMeasure


Self-Assess

Tactical Goals

1. Choose Assessment Template

& Launch2. Select Type and Team 3. Launch Self-Assessment

Platform

All Members who are assigned to the team will receive an email with

a link to the “Self-Assessment” after the assessment is launched.

Self-Assess: Facilitation Measure


Self-Assess

Tactical Goals

Group Assessment Type : Self-Assessment is conducted in real time with all Team Members present

in the Self-Assessment Platform.

Lowest, Highest, &

Average Agility Stage

Votes Appear After All

Votes Are Received or

Admin ends the Voting

Agility Stage Criteria

used to Self-Assess

Team Members present

in the Self-Assessment

Platform

Number of People out of Total Participants that have

provided an Agility Stage Vote for the Practice

Unique Link to Self-Assessment

Admin Controls

Jump Back to a Previous

Practice

Proceed to Next Practice:

Can also be used to force

Result Calculations

although not all Votes are

received

Suspend Assessment to

resume at another time or

Terminate Assessment

Participants can record notes on

each practice by selecting this

icon

If selected all team members will

be able to view notes

Practice can be marked as a “Growth Goal” Practice can be marked as an “Impediment”

Clears All Votes


used to Self-Assess

Practice Name: Order is

By Practice Dimension

Self-Assess: Facilitation Measure


Self-Assess

Tactical Goals

Individual Assessment Type : Self-Assessment is completed separately by each Team Member. Note,

Results will not be available until all Members have completed the Self-Assessment.

Practice Name: Order is

By Practice Dimension

Agility Stage


used to Self-Assess

Voting Buttons

Team Members who are

participating in the

assessment. Those

highlighted in white

have completed

the assessment

Jump Back to a

Previous Practice

Suspend Assessment to

resume at another time

Cancel For Entire Team:

No Results will be saved

Saves and Calculates

Team Results to be

viewed in the Dashboard.

This is used if you want

to end an assessment

prematurely

Anyone can record notes by

selecting this icon

Self-Assess: Facilitator & Team Member Notes

• It is encouraged that facilitators and team members add notes to each practice in the Self Assessment

Platform providing context on “why” they voted for the selected Agility Stage.

• In order to prevent opinion anchoring and group think, notes are only viewable in Group mode once the

facilitator selects the “Mark to View Notes” button.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Participants can record notes on

each practice by selecting this

icon

Facilitator should select this

button when they want the team

to see all team member notes

View Notes Icon is enabled

when Facilitator Select “Mark

to View Notes”

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

• What short term tactical goals can we set to

achieve our desired outcomes?

• Do we have any impediments that are out of

control preventing us from improving in the

practice?

• What leading metrics can we use to measure our

progress?

Tactical Goals: Mark As Growth Goal

• Practices marked as “Growth Goals” are those that the team is attempting to advance to the next Agility

Stage

• When using the Group Facilitation Type, the practice can be marked as a “Growth Goal” in the Self-

Assessment Platform in real time.

• When using the Individual Facilitation Type the facilitator can mark practices as “Growth Goals” by opening

the practice from the Practice Details Result Dashboard and selecting the “Mark as Growth Goal” button.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Mark Practice as

“Growth Goal”

during group

assessment

Select Practice in Practice Details Results

Dashboard to Mark it as a “Growth Goal”

when reviewing individual assessment

results with the team

Tactical Goals: Mark As Impediment

• Practices marked as “Impediments” are those that the team cannot advance to the next Agility Stage

because of a blocker that is out of their control.

• When using the Group Facilitation Type, the practice can be marked as a “Impediment” in the Self-

Assessment Platform in real time.

• When using the Individual Facilitation Type the facilitator can mark practices as “Impediment” by opening

the practice from the Practice Details Result Dashboard and selecting the “Mark as Impediment” button.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Mark Practice as “Impediment”

during group assessment

Select Practice in Practice Details Results

Dashboard to Mark it as a “Impediment”

when reviewing individual assessment

results with the team

Tactical Goals: Results Practice Details Tab

Goals and Impediments can be viewed at the Group and Organization level by first selecting the

selecting the Group on the left and then hovering over the goal or impediment you want to see. All

teams in that Group or Organization will appear.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Hover to see teams in Group

or Organization that have

Impediments in that Practice

Hover to see teams in Group

or Organization that have

Growth Goals in that Practice


Lean Agile Intelligence Practice Details tab provides teams a holistic view of team/group

health, while also enabling teams to easily identify tactical goals that lead to their desired

outcomes.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Practices that have been

included in Self-Assessments

Completed by the Team or

Group. Click practices to see

your response. Practice Sort

Order is by Practice Dimension.

Current Agility Stage of the

Team or Group. If Group, it is

the average of all the Teams

in the Group.

Agility Stage Trend since the

last time the Team or Group

voted on the Practice. Hover

for previous stage.

Variability is the amount

of consensus the team has

on their Average Agility

Stage. Hover for rating.

The Criteria of the current

Agility Stage in which the

Team votes averaged.

The Criteria of the next

Agility Stage in which the

Team should inspire to get to.

Average of all the Practices

answered by the Team or Group

and the Trend since the last

completed Assessment.

Indicates that the practice has

been marked as an “Impediment”

Indicates that a

practice has

been marked as

“Growth Goal”

Notes from all Team Members

will appear here.


Facilitators can update “Notes” of a Practice or Mark them as “Impediments” or “Growth

Goals” from the Practice Details Results Tab.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Practices that have been

included in Self-Assessments

Completed by the Team or

Group. Click practices to add

Notes or Mark Practice

Tactical Goals: Practice Results Ranking System

• Lean Agile Intelligence provides intelligence to help the teams identify practices to focus on and

goals to set

• The Practices to Improve Gadget utilizes the Practice Results Ranking System, and displays the

top four practices the team should focus on

Order of priority goes from left to right

Name of Practice

Outside colors and sizes

represent the different

Business Outcomes and the

magnitude of the impact

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

• Did we meet our tactical goals and did we do

what we said?

• Is it helping us achieve our desired outcome?

• Do we have organization constraints that are

slowing us down?

• Do we need to continue improving in these

practices, or should we try some others?

Measure: Determine Leading Indicators

• Team and groups should proactively pick the metrics that will help them track their progress

towards their desired outcomes so they can baseline and incrementally measure progress

• Identify Leading Indicators that will help measure if you are on track to achieve your tactical goal

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Time to Market Customer

Satisfaction

Employee

Satisfaction

Innovation Responsiveness Reliability Predictability

Throughput

(Velocity)

NPS Happiness Index # of New Products

Released

Product/ Project

Lead Time

Test Coverage Story Point

Attainment

Build Time Value Points Team Health

Assessment

Bug Fixing vs New

Product

Development %

Feature Lead

Time

Builds Per Day Velocity Variation

Deployment Lead

Time

Cost of Delay Code Complexity

New Environment

Automation

Failed

Deployments

Measure: Metrics Module

Lean Agile Intelligence Metrics Module, located on the Results page, provides the ability for teams

to track their metric progress and see it in conjunction with their Assessment Results.

Define Name of

Metric

Define 5 unique Metrics

for each Team/Group

and update Values and

Trends

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Set Value of

Metric

Set Trend of

Metric

Metric Value

Metric Trend

Metric Name

Measure: Determine Lagging Indicators

• Team and groups should proactively pick the metrics that will help them track their progress

towards their desired outcomes so they can baseline and incrementally measure progress

• Identify Lagging Indicators to see if your tactical improvements are moving the needle

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Time to Market Customer

Satisfaction

Employee

Satisfaction

Innovation Responsiveness Reliability Predictability

Number of

Releases

ROI Attrition New Customer % New

Project/Product

Cycle Time

Escaped Defects

in Prod

On Time Delivery

Rate

Project/Product

Cycle Time

Revenue Yearly Surveys New Markets

Entered

New Feature

Cycle Time

Availability

Feature Cycle

Time

Profit Number of

Production

Deployments

# of Prod

Deployments

Measure: Tracking Progress of Leading IndicatorsMeasure


Self-Assess

Tactical Goals

Track leading indicators to see if the team is progressing towards the goal

Measure: Track Progress of Lagging IndicatorsMeasure


Self-Assess

Tactical Goals

Track lagging indicators to see if the tactical improvement is leading to desired outcomes

Measure: Track Organization PatternsMeasure


Self-Assess

Tactical Goals

Look at patterns across the organization to identify possible organization constraints

Measure: Team Insights Canvas

Date of the last assessment

completed

Organization Structure Tree; lists

clickable teams and groups

Number of practices for each

business outcome that have been

marked as an impediment or goal

Top 4 practices that had the most

and least vote variation

Percentage of teams that have

Completed an assessment in the

indicated time frame

Select business outcome in the “Business Outcome

Summary” to filter the summary by a specific

business outcome

Number of assessment templates

used by the team or group

Team/Group/Organization Name


Impact Ratio: Ratio of

Practices in the Result Set


Outcome

Average of all practice scores that

impact the outcome

Average Stage of all practices that

impact the outcome and trend

since last assessment

Answered practices and scores by

time period for each practice

dimension

Team/Group Metrics and Trends

On group level, hover over practice

marked as a goal or impediment to

see what teams have marked this

practice as a goal or impediment.

Overall Average of all practices

answered

Trend Periods:

Team – By assessment

Group – By quarter

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

Lean Agile Intelligence Improvement & Measurement Model:

Enterprise Level

Improvement Model – Enterprise Level

• Lean Agile Intelligence provides a platform that enables leadership to assess

their Agility, and better understand changes necessary to achieve desired

Business Outcomes

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

• The Enterprise Agility Assessment can be conducted with

leadership to identify what Agile and Lean Practices they want to

adopt given their desired business outcomes

• Team Assessments can then be deployed to teams so that patterns

can be identified preventing the organization from reaching those

goals

Legend for Agility Stage

Impacted Business

Outcome

Average score (0-4)

of all the practices

that impact the

business outcomes

mapped to the LAI

Agility Stages

Hover to see the

average score

The percentages of

practices in the

assessment template

that impact the business

outcome

Improvement Model – Enterprise Level

Improvement Model – Business Unit Level• Lean Agile Intelligence provides a holistic view to help determine if your organization

is progressing towards its goals. Each team in a unit may use a different

methodology or have different needs. By consolidating cross assessment and cross

team results in a consumable and actionable format, organizational constraints,

coaching needs, and investment opportunities can be identified.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

• Tailor team assessments unique to each teams methodology,

objectives, and challenges using the Assessment Template

Builder

• Conduct Quarterly Assessments, resulting in Measureable

Goals

• Analyze constraint patterns across the organization that may

be impacting teams

Improvement Model – Program Level

• Large Enterprises often have several teams collaborating together on a large

initiative. There are a number of Agile at Scale practices available that will help

facilitate this arrangement and deliver value to the customer sooner. These Agile

at Scale practices are part of our Practice Catalog and can be used to assess

multiple teams and aggregate the results.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

• Tailor an assessments that includes both Agile at Scale and

team practices

• Conduct Quarterly Assessments, resulting in Measureable

Goals for the program

Improvement Model – Self (Individual Role) Level

• Do people have the training, knowledge, availability, and support they need to do

their job effectively? What are the growth goals of each individual that will make

them and their team better? Lean Agile Intelligence can be used to conduct

individual self assessments.

MeasureStrategic

Objectives

Self-Assess

Tactical Goals

Organization

Unit

Program

Team

Self

• Build Role Specific Assessments for POs, SMs, Team

Members, and Leadership to identify areas individual growth

Appendix

Advanced Calculations

Setup: Simple Calculations vs Advanced

Status

• Simple: One level of Practice To Business Outcome impact. No weighting is applied in Practice to Business

Outcome Impact Ratio calculation and Business Outcome aggregated scores. Business Outcome aggregated

score is the average of all practices answered that impact the outcome.

• Advanced: Three levels (Must Do Well, Should Do Well, Nice if Done Well) of Practice To Business Outcome

impact. Weighting (Must Do Well (5x), Should Do Well (3X), Nice if Done Well (1X)) is applied in Practice to

Business Outcome Impact Ratio calculation and Business Outcome Agility Stage average score. Business

Outcome Agility Stage average score (0-4) is a weighted average that takes into account the number of

practices that impact the outcome, the average agility stage vote for each practice, and the magnitude of the

impact.

Strategic Objectives: Assessment Template BuilderMeasure


Self-Assess

Tactical Goals

Add your own

Custom Practices

Select Practices For

your Template

Framework View

of Practice Catalog

Name of Template

Open Existent

Template

Agility Dimensions:

Practice Areas of Focus

Magnitude of Impact to Outcome.

In simple calculations,

only Directly impacted is used


Impact Ratio: Weighted Ratio

of Practices in the Template


Outcome

Impacted Outcomes

Practices in

Template

Reference(s) Used To

Create Practice Criteria

Save an Existing

Template and

Customize it

Hover over practice impact ratio to see a breakdown of the

number of practices in the assessment template and the

weighting impacting the outcome.

Strategic Objectives: Practice CriteriaMeasure


Self-Assess

Tactical Goals

Magnitude of Impact to Outcome

Impacted Outcomes

Practice Name

Agility Stages

Agility Stage

Criteria presented to

the Team during

“Self-Assessment”

Copy & Customize

Click a Practice to see the Criteria in each Agility Stage that will be presented to the

Team during a Self-Assessment.

Table of Contents Setup Improvement & Measurement Model...

Documents

Transcript of Table of Contents Setup Improvement & Measurement Model...