Introducing MTM and TFS

32
INTRODUCING MTM & TFS Microsoft Test Manager Team Foundation Server Abhishek Sinha

Transcript of Introducing MTM and TFS

Page 1: Introducing MTM and TFS

INTRODUCING MTM & TFSMicrosoft Test ManagerTeam Foundation Server

Abhishek Sinha

Page 2: Introducing MTM and TFS

Introducing Visual Studio Test Professional

Microsoft Visual Studio Team Foundation Server, the core of the application lifecycle management tools, provides version control, a build system, and tools and metrics for managing and organizing projects. With a license for Team Explorer, you can view and update data in Team Foundation Server by using Team Web Access, Visual Studio and other integrated development environments.

Page 3: Introducing MTM and TFS

Application Lifecycle Management (ALM) with Visual Studio and Team Foundation Server (TFS)By using the suite of tools in Visual Studio and combining those tools with Visual Studio Team Foundation Server, following results can be achieved –

Requirement Gathering – Understanding Customer’s NeedDesigning of ApplicationCoding – Version ControlApplication BuildTest Planning and ExecutionRequirement TrackingTest Reporting

http://msdn.microsoft.com/en-us/library/fda2bad5.aspx

Page 4: Introducing MTM and TFS
Page 5: Introducing MTM and TFS

Testing Application using Microsoft Test ManagerUsing MTM –

Plan a Test - Plan your testing based on either requirements or user stories. You can link your tests to these requirements or user stories and then plan which configurations you want to use to run these tests. Alternatively, you can create test suites using other criteria to plan your testing effort.

Create and Manage Test - Create and manage both manual and automated tests as part of your plan. You can create test cases to be run as manual tests with individual test steps from Microsoft Test Manager. Automated tests, such as unit tests, load tests and automated UI tests, can be created by using Visual Studio. Later, if you want, you can convert test cases to automated tests by linking automation to the test case.

Execute a Test - Run your manual, exploratory and automated tests from a test plan using Microsoft Test Manager, save these test results, and use to measure your testing progress.

Bug Logging

Test Reporting - Measure your testing readiness, track your testing progress, and view the status of bugs. The bugs include detailed information that is collected when you run your tests using Test Runner. You can also submit bugs from Microsoft Test Manager.

Review and track test results - After you run tests, review your test results to see which tests passed and which tests failed. You can then assign a reason for a failed test, and assign a resolution.You can view all the test results for a test plan using pre-defined test reports or by creating your own custom reports. If your team uses a project portal, you can view the pre-defined reports on the Test Dashboard. Access the project portal from the Track view in the Testing Center in Microsoft Test Manager.

Page 6: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

KEY STEPS

Connect to your team project and create a plan

Add details to your test plan

Add manual test cases

Run tests and submit any bugs

Track your testing progress for the plan

Page 7: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Connect to Team Foundation Server and Create a Plan -

1. Open Microsoft Test Manager - To display the Microsoft Test Manager window, choose Start, and then choose All Programs. Point to Microsoft Visual Studio 2012 and then choose Microsoft Test Manager.

2. Add a new Team Foundation Server - To add a new Team Foundation Server for the first time, type the URL, or just the name of the Team Foundation Server, and then choose Add.

Page 8: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Connect to Team Foundation Server and Create a Plan -

3. Select a Team Project - To select a team project collection, choose the arrow to view the list of team projects for this team project collection. Select the name of your team project in the list, and then choose Connect.

4. If you successfully connect to this team project, the Testing Center is displayed.

Page 9: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Connect to Team Foundation Server and Create a Plan -

5. Create a Test Plan - You can select an existing test plan to use or add a new one. To select an existing test plan to use, choose the plan in the list and then choose Select Plan.To add a plan, choose Add.The Add test plan dialog box is displayed.Type the name for your plan in Enter the plan name, and then choose Add.Your plan is now added to the list and highlighted.

Page 10: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Connect to Team Foundation Server and Create a Plan -

7. To select the plan you added, choose Select plan. The Contents view for your test plan is displayed. Now follow the steps in the next procedure to add the details of your test plan

6. (Optional) To create a URL that other team members can use to connect to this plan, choose Copy Link for plan. This copies the URL to the plan you created to the clipboard. You can now paste this URL into an email and send it to others in your team so that they can easily connect to the plan.

mtms://training.tfspreview.com:443/defaultcollection/p:Training%20Project/Testing/testplan/connect?id=1

Page 11: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

Page 12: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

KEY STEPS

Connect to your team project and create a plan

Add details to your test plan

Add manual test cases

Run tests and submit any bugs

Track your testing progress for the plan

Page 13: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Add Details to Test Plan

Before you create test cases and run them, you must have a detailed test plan. The details that you can

add to your test plan are shown in the following illustration. You can update the test plan at any time.

The following procedure describes the minimum changes that you might want to make to your test

plan properties.

To change to the properties view for your test plan, choose Properties.

Page 14: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Add Details to Test Plan

Before you create test cases and run them, you must have a detailed test plan. The details that you can

add to your test plan are shown in the following illustration. You can update the test plan at any time.

The following procedure describes the minimum changes that you might want to make to your test

plan properties.To change to the properties view for your test plan, choose Properties.(Optional) To change to a different iteration for your team project, choose Iteration.(Optional) The default configuration provided for the test plan specifies that the tests should be run on the Windows 7 operating system using Internet Explorer 8.0 as the browser. You can just use this as a placeholder to get started, or you can create a different configuration with different default values, or different configuration variables. To add new configurations, choose In this plan under Configurations, and then choose Manage.

Page 15: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

(Optional) To change to a different iteration for your team project, choose Iteration.

(Optional) The default configuration provided for the test plan specifies that the tests should be run on the Windows 7 operating system using Internet Explorer 8.0 as the browser. You can just use this as a placeholder to get started, or you can create a different configuration with different default values, or different configuration variables. To add new configurations, choose In this plan under Configurations, and then choose Manage.

Page 16: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

Choose Manage

Page 17: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

KEY STEPS

Connect to your team project and create a plan

Add details to your test plan

Add manual test cases

Run tests and submit any bugs

Track your testing progress for the plan

Page 18: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Add Manual Test Cases

You can –

1. Add test cases to the default test suite (that has the same name as the test plan) of the Test Plan

2. Add requirements to the test plan and add your test cases to these requirements.

Page 19: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Add Manual Test Cases

Option 1 - You can just add test cases to the default test suite that has the same name as the test plan, as shown in the following illustration.

Create new Test Case in the Test Suite of the Test Plan

Page 20: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

Click here to add new steps within the Test Case – Action and the Expected Result

Save the new Test

Add Title

Page 21: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

New Test Case is added to the Test Suite of the Test Plan

Page 22: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTo Add Manual Test Cases

Option 2 - You can add requirements to the test plan and add your test cases to these requirements.

Add New Requirement to the Test Plan

Page 23: Introducing MTM and TFS
Page 24: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

KEY STEPS

Connect to your team project and create a plan

Add details to your test plan

Add manual test cases

Run tests and submit any bugs

Track your testing progress for the plan

Page 25: Introducing MTM and TFS

Quick Start for Manual Testing using MTMRun a Test

You can run the tests in your test plan. Each pairing of the default configurations and test cases in

the test plan is displayed in the Test view. You can select the tests that you want to run. Following are

the steps –

1. Select the ‘Test’ tab2. Select the appropriate ‘Test Suite’ and then the ‘Test’3. Run the Test by pressing the Run button

Page 26: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

1. Select the ‘Test’ tab

2. Select the appropriate ‘Test Suite’

3. Select the appropriate ‘Test’

4. Run the selected ‘Test’ using Run Button

Page 27: Introducing MTM and TFS

5. You can now start the test from Test Runner. You will be prompted to start a test and you will have the option to create an action recording. An action recording can be used to play back the actions that you perform when you run your test.

6. Start the application under test (AUT) and perform the test steps. As the test runs, mark steps as either passed or failed; add comments, files or screen shots; or create a bug, as shown in the following illustration.

Page 28: Introducing MTM and TFS
Page 29: Introducing MTM and TFS

Summary - To run manual tests

1. In the center group menu bar, choose Test.2. To run the tests, select the test suite that contains the tests that you want to

run.3. Select the tests you want to run and then choose Run. Test Runner opens. In

Test Runner, you are prompted to Start test and optionally you can select Create an action recording. Choose Start test.

4. Perform the steps in the test case. Any data associated with a test step is displayed with the step.

5. To mark the result of a test step, choose the drop-down for the active icon to the right of the test step and then choose either Pass or Fail.

6. To pause the test at any time, choose Pause. If you are recording the test case, choosing Pause also pauses an action or video recording. To resume the test and the action or video recording, choose Resume.

7. If you find a bug, choose Create bug. The New Bug dialog box is displayed. Any data that you have attached or collected will automatically be added to the bug.

8. When you have finished testing, choose End test.9. A result for the test is now shown in Test Runner, based on the test step results.

If you chose to record the test, the recording is automatically stopped and saved. The overall result for a test is based on the status for all the test steps that were marked. Therefore, if one test step is marked as failed then the test will have a status of failed. You must mark a test step with a status if it is a validation test step. Otherwise, the test will be automatically marked as failed.

10.To save your test results, choose Save and Close.

Page 30: Introducing MTM and TFS

Quick Start for Manual Testing using MTM

KEY STEPS

Connect to your team project and create a plan

Add details to your test plan

Add manual test cases

Run tests and submit any bugs

Track your testing progress for the plan

Page 31: Introducing MTM and TFS

Quick Start for Manual Testing using MTMTrack Testing Progress

You can track your progress for your test plan. After you run your manual tests with Test Runner, you can immediately view your progress in the Run Tests activity. You can view the tests that have passed and failed. You can mark tests as blocked or reset tests to active when you are ready to run them again, as shown in the following illustration.

Page 32: Introducing MTM and TFS

To Track Testing Progress -

1. The progress bar is a graphic representation of your testing status, based on the percentage of tests in a particular state. Tests in a similar state are shown with the same color, so that you can quickly view your status. The states are defined in the following table.

2. You can also view the Test Results History of each time the test has been run for this test plan in these test results.

To view a summary of your testing progress, move your mouse pointer over the progress bar in the Run Tests activity.The dialog box that shows a summary of the status of all your tests is displayed. To view the results for a specific test, select the test and then choose View results.The most recent test results are shown for that test together with all the details and any data that was collected when the test was run.