Visual studio alm 2012 reporting overview

Post on 25-May-2015

125 views 0 download

Tags:

description

Overview of TFS Reports, comparing what is available between different Process Templates. This is a WIP, and will be updated soon with additional info on customizing reports.

Transcript of Visual studio alm 2012 reporting overview

Microsoft Visual Studio 2012

Team Foundation Server Reporting

Angela Dugan

ALM Practice Manager

Polaris Solutions

Angela.Dugan@PolarisSolutions.com

Angela Dugan

Mobile

Solutions

Project

Leadership

.NET

Solutions

Application

Lifecycle

Management

AGENDA

What reporting options are available?

Built-in

Excel

SSRS

What reports come out of the box?

Creating your own reports

REPORTS BY TEMPLATE

Tasks SCRUM Agile CMMI

Monitor bug activity, reactivations, and trends. Track bugs that the

team is finding and the progress that the team is making toward

fixing them.

• Bug Status Report

• Bug Trends Report

• Reactivations Report

• Bug Status Report

• Bug Trends Report

• Reactivations Report

Monitor build activity, success, and trends. You can use build reports

to track the quality and success of your team's builds over time.

• Build Success Over Time

Report

• Build Summary Report

• Build Quality Indicators Report

• Build Success Over Time

Report

• Build Summary Report

• Build Quality Indicators Report

• Build Success Over Time Report

• Build Summary Report

Track project health, team burn rate, and task completion.

Use to review the level of effort that the team has spent on each

requirement type work items that the team is implementing. By

using this report, you can quickly determine whether any work was

recently completed on each item, what work is remaining and how

far each item has been implemented and tested.

You can review this report daily or weekly to monitor the progress of

the team during an iteration.

• Release Burndown (Scrum)

• Sprint Burndown (Scrum)

• Velocity (Scrum)

• Burndown and Burn Rate

Report (Agile)

• Remaining Work Report

• Status on All Iterations Report

• Stories Overview Report

(Agile)

• Stories Progress Report

(Agile)

• Burndown and Burn Rate Report

(CMMI)

• Remaining Work Report

• Status on All Iterations Report

• Requirements Progress Report

(CMMI)

• Requirements Overview Report

(CMMI)

Determine added work. You can use the Unplanned Work report to

determine how much work the team added to an iteration after it

started.

• Unplanned Work • Unplanned Work

Monitor testing activity. You can use the test reports to track the

team's progress toward developing test cases and to determine how

well they cover the requirement type work items.

• Test Case Readiness

Report

• Test Plan Progress Report

• Test Case Readiness Report

• Test Plan Progress Report

• Test Case Readiness Report

• Test Plan Progress Report

SCRUM - RELEASE BURNDOWN

U n d e r s t a n d h o w q u i c k l y y o u r t e a m h a s

d e l i v e r e d b a c k l o g i t e m s a n d t r a c k h o w m u c h

w o r k t h e t e a m m u s t s t i l l p e r f o r m t o c o m p l e t e

a p r o d u c t r e l e a s e .

R e v i e w t h e r e p o r t t o d e t e r m i n e t h e p r o g r e s s

t h a t y o u r t e a m h a s m a d e i n a r e l e a s e a n d t o

a n s w e r t h e f o l l o w i n g q u e s t i o n s :

H o w m u c h w o r k r e m a i n s i n t h e r e l e a s e ?

H o w q u i c k l y i s y o u r t e a m w o r k i n g t h r o u g h

t h e p r o d u c t b a c k l o g ?

SCRUM - SPRINT BURNDOWN

D i s p l a y s t h e f o l l o w i n g p i e c e s o f d a t a :

T h e I d e a l T r e n d l i n e i n d i c a t e s a n i d e a l s i t u a t i o n i n

w h i c h t h e t e a m b u r n s d o w n a l l o f t h e e f f o r t t h a t

r e m a i n s a t a c o n s t a n t r a t e b y t h e e n d o f t h e

s p r i n t .

T h e I n P r o g r e s s s e r i e s s h o w s h o w m a n y h o u r s

r e m a i n f o r t a s k s t h a t a r e m a r k e d a s I n P r o g r e s s i n

a s p r i n t .

T h e T o D o s e r i e s s h o w s h o w m a n y h o u r s r e m a i n

f o r t a s k s t h a t a r e m a r k e d a s T o D o i n a s p r i n t .

R e v i e w t h e r e p o r t t o d e t e r m i n e t h e p r o g r e s s t h a t

y o u r t e a m h a s m a d e i n a r e l e a s e a n d a n s w e r t h e

f o l l o w i n g q u e s t i o n s :

H o w m u c h w o r k r e m a i n s i n t h e s p r i n t ?

I s y o u r t e a m o n t r a c k t o f i n i s h a l l w o r k f o r t h e

s p r i n t ?

W h e n w i l l y o u r t e a m f i n i s h a l l w o r k f o r t h e s p r i n t ?

H o w m u c h w o r k f o r t h e s p r i n t i s i n p r o g r e s s ?

SCRUM - VELOCITY

B a s e d o n t h e v e l o c i t y o f p r e v i o u s s p r i n t s t h a t

t h e r e p o r t i l l u s t r a t e s , y o u c a n :

T r a c k h o w m u c h e f f o r t y o u r t e a m h a s

r e p o r t e d a s c o m p l e t e f o r e a c h s p r i n t .

E s t i m a t e h o w m u c h b a c k l o g e f f o r t y o u r t e a m

c a n h a n d l e i n f u t u r e s p r i n t s i f y o u r t e a m

c o m p o s i t i o n a n d s p r i n t d u r a t i o n s t a y

c o n s t a n t .

R e v i e w t h e r e p o r t t o d e t e r m i n e h o w m u c h

p r o g r e s s y o u r t e a m h a s m a d e a n d t o a n s w e r t h e

f o l l o w i n g q u e s t i o n s :

H o w m u c h e f f o r t h a s y o u r t e a m c o m p l e t e d i n

e a c h s p r i n t ?

W h a t i s t h e m a x i m u m v e l o c i t y o f y o u r t e a m ?

W h a t i s t h e m i n i m u m v e l o c i t y o f y o u r t e a m ?

W h a t i s t h e a v e r a g e v e l o c i t y o f y o u r t e a m ?

AGILE - BURNDOWN

Y o u c a n u s e t h i s r e p o r t t o a n s w e r t h e f o l l o w i n g

q u e s t i o n s :

I s t h e t e a m l i k e l y t o f i n i s h t h e i t e r a t i o n o n

t i m e ?

W i l l t h e t e a m c o m p l e t e t h e r e q u i r e d w o r k ,

b a s e d o n t h e c u r r e n t b u r n r a t e ?

W h e n c a n t h e t e a m f i n i s h t h e c u r r e n t i t e r a t i o n ?

H o w m u c h w o r k c a n t h e t e a m c o m p l e t e i n t h e

a v a i l a b l e t i m e ?

H o w m u c h w o r k d o e s e a c h t e a m m e m b e r h a v e ?

H o w f a s t i s t h e t e a m c o m p l e t i n g r e m a i n i n g

w o r k ?

I s t h e t e a m a d d i n g w o r k d u r i n g t h e i t e r a t i o n ?

I s t h e r e s c o p e c r e e p ?

H o w i s t h e w o r k d i s t r i b u te d a c r o s s t h e t e a m ?

AGILE – REMAINING WORK

N u m b e r o f H o u r s v s . N u m b e r o f W o r k I t e m s

R e v i e w t h e r e p o r t t o d e t e r m i n e t h e p r o g r e s s

w i t h i n a n i t e r a t i o n o r o v e r t i m e . S p e c i f i c a l l y , y o u

c a n f i n d a n s w e r s t o t h e s e q u e s t i o n s :

H o w f a s t i s t h e t e a m b u r n i n g d o w n r e m a i n i n g

w o r k ?

I s w o r k b e i n g a d d e d d u r i n g t h e i t e r a t i o n ? I s t h e

t e a m e x p a n d i n g t h e s c o p e o f t h e w o r k ?

H o w m u c h p r o g r e s s c a n t h e t e a m m a k e i n t h e

a v a i l a b l e t i m e ?

A p p r o x i m a t e l y w h e n c a n t h e t e a m f i n i s h t h e

w o r k ?

I s t o o m u c h w o r k i n p r o g r e s s ?

I s t h e f l o w o f w o r k b e i n g i m p e d e d o r b l o c k e d ?

W h e n w i l l t h e t e a m f i n i s h t h e c u r r e n t i t e r a t i o n ?

AGILE – ITERATIONS STATUS

T h i s r e p o r t d i s p l a y s t h e f o l l o w i n g i n f o r m a t i o n :

S t o r i e s C l o s e d : n u m b e r o f u s e r s t o r i e s t h a t h a v e

b e e n c l o s e d ; d e r i v e d f r o m t h e c u r r e n t v a l u e s

s p e c i f i e d f o r t h e i t e r a t i o n a n d t h e s t a t e o f e a c h

u s e r s t o r y .

P r o g r e s s ( H o u r s ) : r e p r e s e n t s t h e v a l u e s f o r O r i g i n a l

E s t i m a t e ( g r e y ) , C o m p l e t e d ( g r e e n ) a n d R e m a i n i n g

( l i g h t b l u e ) b a s e d o n t h e r o l l u p o f h o u r s t h a t a r e

d e f i n e d f o r a l l t a s k s ; d e r i v e d f r o m t h e c u r r e n t

v a l u e s t h a t a r e s p e c i f i e d f o r t h e i t e r a t i o n a n d t h e

h o u r s f o r e a c h t a s k .

B u g s : r e p r e s e n t a t i o n f o r a l l b u g s , g r o u p e d b y t h e i r

c u r r e n t s t a t e s o f A c t i v e ( b l u e ) , R e s o l v e d ( g o l d ) a n d

C l o s e d ( g r e e n ) ; d e r i v e d f r o m t h e c u r r e n t v a l u e s t h a t

a r e s p e c i f i e d f o r t h e i t e r a t i o n a n d t h e s t a t e o f e a c h

b u g .

AGILE– ITERATIONS STATUS

R e v i e w t h e r e p o r t t o d e t e r m i n e h o w m a n y s t o r i e s a r e

r e a d y t o r e l e a s e a n d t o b e t t e r u n d e r s t a n d t h e r a t e o f

t h e t e a m ' s p r o g r e s s . F o r e x a m p l e , y o u c a n f i n d

a n s w e r s t o t h e f o l l o w i n g q u e s t i o n s :

D i d t h e s c o p e o f w o r k f o r e a c h i t e r a t i o n c l o s e l y

m a t c h t h e t e a m c a p a c i t y ?

D o e s t h e n u m b e r o f s t o r i e s c l o s e d i n e a c h i t e r a t i o n

c o r r e s p o n d t o y o u r e x p e c t a t i o n s ?

I s t h e t e a m r e s o l v i n g a n d c l o s i n g m o r e b u g s w i t h

s u c c e s s i v e i t e r a t i o n s ?

H o w m a n y s t o r i e s c a n t h e t e a m s h i p t o d a y ?

T h i s i s B A D ! ! !

CMMI– BURNDOWN AND BURN RATE

B u r n d o w n s h o w s t h e t r e n d o f c o m p l e t e d a n d

r e m a i n i n g w o r k o v e r a s p e c i f i e d t i m e p e r i o d .

B u r n d o w n

H o w f a s t i s t h e t e a m c o m p l e t i n g r e m a i n i n g

w o r k ?

I s t h e t e a m a d d i n g w o r k d u r i n g t h e i t e r a t i o n ? I s

t h e r e s c o p e c r e e p ?

H o w m u c h w o r k c a n t h e t e a m c o m p l e t e i n t h e

a v a i l a b l e t i m e ?

W h e n c a n t h e t e a m f i n i s h t h e w o r k ?

W h e n c a n t h e t e a m f i n i s h t h e c u r r e n t i t e r a t i o n ?

CMMI– BURNDOWN AND BURN RATE

B u r n r a t e p r o v i d e s c a l c u l a t i o n s o f t h e c o m p l e t e d

a n d r e q u i r e d r a t e o f w o r k b a s e d o n t h e s p e c i f i e d

t i m e p e r i o d .

B u r n R a t e

I s t h e t e a m w o r k i n g q u i c k l y e n o u g h t o f i n i s h t h e

r e m a i n i n g w o r k o n t i m e ?

W o r k A s s i g n m e n t

H o w i s t h e w o r k d i s t r i b u t e d a c r o s s t h e t e a m ?

S h o u l d t h e t e a m b a l a n c e t h e r e m a i n i n g w o r k

l o a d ?

CMMI– REMAINING WORK

N u m b e r o f H o u r s v s . N u m b e r o f W o r k I t e m s

Q u e s t i o n s T h a t t h e R e p o r t A n s w e r s

R e v i e w t h e r e p o r t t o d e t e r m i n e t h e p r o g r e s s

w i t h i n a n i t e r a t i o n o r o v e r t i m e . S p e c i f i c a l l y ,

y o u c a n f i n d a n s w e r s t o t h e s e q u e s t i o n s :

H o w f a s t i s t h e t e a m b u r n i n g d o w n r e m a i n i n g

w o r k ?

I s w o r k b e i n g a d d e d d u r i n g t h e i t e r a t i o n ? I s t h e

t e a m e x p a n d i n g t h e s c o p e o f t h e w o r k ?

H o w m u c h p r o g r e s s c a n t h e t e a m m a k e i n t h e

a v a i l a b l e t i m e ?

A p p r o x i m a t e l y w h e n c a n t h e t e a m f i n i s h t h e

w o r k ?

I s t o o m u c h w o r k i n p r o g r e s s ?

I s t h e f l o w o f w o r k b e i n g i m p e d e d o r b l o c k e d ?

W h e n w i l l t h e t e a m f i n i s h t h e c u r r e n t i t e r a t i o n ?

AD-HOC REPORTS IN MICROSOFT EXCEL

AD-HOC REPORTS IN MICROSOFT EXCEL

“REQUIREMENT” PROGRESS - ALL TEMPLATES

Test % passing…

Code % covered…

Code % changed…

SHAREPOINT DASHBOARDS

Bugs are resolved steadily…

Bugs count by person…

Lines of code tested…

Lines of code changed…

Task hours getting completed…

Tasks are getting closed…

Test are passing…

Are the builds healthy?

Bugs reactivations are low…

RESOURCES

Process Templates Overview: http://msdn.microsoft.com/en-us/library/vstudio/ms400752.aspx

Reports and Artifacts:

Scrum: http://msdn.microsoft.com/en-us/library/vstudio/ff731587.aspx#monitoring

Agile: http://msdn.microsoft.com/en-us/library/vstudio/dd997580.aspx

CMMI: http://msdn.microsoft.com/en-us/library/vstudio/ee332487.aspx

Process area Visual Studio Scrum 2.0 MSF for Agile v6.0 MSF for CMMI v6.0

Workflow states

• New

• Approved

• Committed

• Done

• Removed

• New

• Active

• Resolved

• Closed

• Removed

• Proposed

• Active

• Resolved

• Closed

Product planning

To customize the backlog pages,

see Customize the Backlog

Pages.

• Bug (Scrum)

• Product Backlog Item (Scrum)

• Agile backlogs

• User Story (Agile)

• Agile backlogs

• Requirement (CMMI)

• Agile backlogs

Task and iteration planning

To customize the task board, see

Customize the Task Board Page.

• Task (Scrum)

• Agile task board

• Task (Agile)

• Agile task board

• Task (CMMI)

• Agile task board

COMPARE & CONTRAST

Process area Visual Studio Scrum 2.0 MSF for Agile v6.0 MSF for CMMI v6.0

Bug backlog management Bug (Scrum) • Bug (Agile)

• Triage Workbook

• Bug (CMMI)

• Triage Workbook

Project management Impediment (Scrum)• Issue (Agile)

• Issues Workbook

• Issue (CMMI)

• Risk (CMMI)

• Review (CMMI)

• Issues Workbook

Test management• Test Case

• Shared Steps

• Test Case

• Shared Steps

• Test Case

• Shared Steps

Code review and feedback

• Code Review Request

• Code Review Response

• Feedback Request

• Feedback Response

• Code Review Request

• Code Review Response

• Feedback Request

• Feedback Response

• Code Review Request

• Code Review Response

• Feedback Request

• Feedback Response

Audit trail Not supported Minimal Supported

COMPARE & CONTRAST