1

Internet Assisted Review

Focus Group

March 14, 2002

2

Agenda Reviewer Conflicts - Self Identified Documents available in IAR Peer Review IAR Control Center User Registration Log on to IAR Account Management and Account Info Look

Up Post and Edit Phase Read Only Phase

3

Reviewer Conflicts - Self Identified

How should system allow Reviewer to identify conflicts?

Only once when they log in to IAR for the first time?

Anytime?

4

Documents in IAR

Items currently mailed to Reviewer: Reviewer Guidelines Cover Letter Grant Application Prior Summary Statements Program Announcements Meeting Roster Blank Conflict of Interest Form

Questions: Are the documents above needed in IAR? Who provides electronic copies of these documents? What should be the process for getting these documents into IAR?

5

Peer Review IAR Control Center(Release Meeting to IAR)

Refer to Scope Document Excerpt, Product Features 5.2

6

Pre-Registration System Process and

User Registration

Refer to Scope Document Excerpt, Product Features 5.3, 5.4

7

Registration - Enter PIN Sample Screen

8

Registration – Invalid PINSample Screen

9

Registration - Account CreationSample Screen

10

PIN MismatchSample Screen

11

Registration SuccessSample Screen

12

Log on to IAR

Refer to Scope Document Excerpt, Product Features 5.5

13

IAR Log on Sample Screen

14

Account Information Look Up

Refer to Scope Document Excerpt, Product Features 5.6

15

Account Information Look UpSample Screen

16

User Name/Password SentSample Screen

17

Account Access and Expiration

Refer to Scope Document Excerpt, Product Features 5.7

18

Post and Edit Phase

Refer to Scope Document Excerpt, Product Features 5.8

19

Reviewer’s List of Meetings

This is the first screen that appears for Reviewers after login (Commons Account).

The screen lists all meetings that include applications assigned to the logged in Reviewer.

Screen will show: Meeting Identifier, SRA Name, Critique Due Date, Meeting Dates, Post-Mtg Edit End Date.

Reviewer clicks Meeting Identifier for list of their assigned applications.

Could this same screen work for SRAs?

20

Reviewer’s List of MeetingsSample Screen

21

Application List (during Post-Edit Phase)

Reviewer will see their assigned applications for the meeting they selected. (Reviewers with Non-Commons accounts will automatically see their applications list when they log in.)

Screen will show Meeting Identifier and critique submission due date and the following for each application: application number, project title, PI name (*new PI indicator), Assignment Role (Primary, Secondary, etc.), Score, Critique Submitted Date

and Action (View or Post)

22

Application List (during Post-Edit Phase) continued

Reviewer clicks on Action choices to View or Post critique.

Reviewer can only post and view critiques for applications assigned to them.

User will be able to sort list by any of the column headings (Score, Application Number, etc.)

Will this same screen work for SRAs (show all applications for their meeting)?

23

Application ListSample Screen

24

Upload Critique & Preliminary Score

Reviewer clicks on “Post” hyperlink.

Screen shows Application Number, Title, PI Name, Reviewer Type and Preliminary Score (if available)

Screen allows critique and/or score to be submitted. Button is provided for browsing their computer to

locate and upload the file containing the critique. Score can be entered.

25

Upload Critique & Preliminary Score Sample Screen

26

Read Only Phase

Refer to Scope Document Excerpt, Product Features 5.8

27

Read-Only Phase After the Critique Submission deadline, Reviewers may

read all critiques for the meeting (except COI and where blocked by SRA).

Reviewer names are not displayed on screen or in critique, only type (Primary, Secondary, etc.) is displayed

User clicks “View” hyperlink to view a critique Questions:

Where should Reviewer name be displayed with critique? Will Reviewers or SRA/GTA need to view multiple critiques?

If so, how? All critiques for one application merged into one document? All critiques for entire meeting merged into one document?

28

Read-Only Phase Sample Screen

29

During Post and Edit Phase: What are the differences between what the SRA/GTA should see and the Reviewer should see?

What are the differences during the Read Only Phase?

30

Minutes and meeting related documents will be posted at http://era.nih.gov/areas/rev/index.cfm

Next Focus Group Meeting: Monday, March 18, 2002, 1:30 – 4 pm NGIT/Logicon Large Conference Room (1700

Research Blvd) Agenda will include Demonstrations of the NIAID

Electronic Review (ER) system and the NCI Clinical Trials Evaluation Program(CTEP)

31

Thanks for your participation!