Purpose of Network Evaluation Increase understanding of the relationship between the network design,...
-
Upload
oswin-hodge -
Category
Documents
-
view
214 -
download
1
Transcript of Purpose of Network Evaluation Increase understanding of the relationship between the network design,...
![Page 1: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/1.jpg)
Purpose of Network Evaluation
• Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved
• Provide data to examine trends, identify strengths and weaknesses and assist in leadership decisions
![Page 2: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/2.jpg)
Standing HPTN committees
Ongoing, internal peer review
• Protocol Review Committee• Study Monitoring Committee• Manuscript Review Committee
![Page 3: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/3.jpg)
Network Evaluation Approach in 2000
• Qualitative rather than quantitativeWhy? Breadth of science Initial focus on infrastructure
development
• Comprehensive evaluation Site and protocol performance Working group functioning Central resources: CL, CORE, SDMC Standing committees
![Page 4: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/4.jpg)
2001 Evaluation Report
• Survey results Science working groups Central resources Standing committees
• Quantitative data Protocol implementation Site performance
![Page 5: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/5.jpg)
HPTN Evaluation -How did we measure up?
![Page 6: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/6.jpg)
Slow overall progress – complex reasons
The large number of contributors (NIAID, FDA, CABS) that are an intrinsic part of a network has a direct relationship to protocol progress.
Many steps in review process – most seem to be unavoidable
Protocols – Development and Progress
![Page 7: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/7.jpg)
Monitor protocol progress and take corrective action when needed to move slow developers along.
Shorten review process whenever possible; clear communication of the need for each review step; combine steps whenever possible.
Define realistic expectations for fielding a protocol.
Protocols – Development and Progress
- Suggested Corrective Measures
![Page 8: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/8.jpg)
CWG – Survey Comments
Concern that CWG was not properly integrated into the HPTN research agenda
CWG/Network leadership not proactive enough in integrating the community into network activities
CWG should develop a clearer mission for the group and a master plan for achieving mission goals
Need clear definition of the roles of the CWG and CORE community program staff
![Page 9: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/9.jpg)
Central Laboratory – Survey Comments
CL contributions to protocols were applauded
Site laboratory training – Good quality, more quantity
More and earlier involvement More site visits by CL Work on timing of training to
coincide more closely with study initiation.
![Page 10: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/10.jpg)
CORE – Survey Comments
Protocol meetings and trainings are well managed
Receptive staff members More involvement by CORE staff
More site visits Closer monitoring More frequent and focused
trainings More vocal involvement in
protocol development
![Page 11: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/11.jpg)
CORE – Survey Comments (cont.)
More scientific/technical training for CORE staff
More technical information on the web site and in the newsletter
Better definition of the roles of the CORE’s community program and the CWG
![Page 12: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/12.jpg)
SDMC – Survey Comments
“Knowledgeable,” “Professional”
Accurate and prompt
More flexibility in approach to protocol development
Increase number of site and training visits to HPTUs
Increase interface with site staff in dealing with data management issues
![Page 13: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/13.jpg)
Standing Committees – Survey Comments
SMC General satisfaction with decisions Earlier involvement in protocols during
implementation and site visitsPRC Reviews were timely, thorough and
helpful Concern that expertise of some
reviewers may not be adequate, suggest use of additional outside reviewers
![Page 14: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/14.jpg)
Standing Committees – Survey Comments (cont.)
MRC Improve response time to authors Reviews need to be helpful, provide
guidance for improvement Provide written comments with
review decision
![Page 15: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/15.jpg)
Prevention Leadership Group – Survey Comments
Conflict resolution is handled well by the PLG
Good decisions on making the best use of available resources
Clarify and communicate the role of PLG to the Network
Need to focus on tough issues and make “tough” decisions
![Page 16: Purpose of Network Evaluation Increase understanding of the relationship between the network design, objectives and functions and the outcomes achieved.](https://reader036.fdocuments.in/reader036/viewer/2022082817/56649e5d5503460f94b55732/html5/thumbnails/16.jpg)
Summary and ConclusionKey Evaluation Results to Consider• Increase communications to entire
network Clarify the review process from
concept to study initiation Clarify leadership roles and activities
• Increase network partner involvement with HPTUs More visits by CORE, SDMC and CL to
improve HPTU performance• Increased focus on ethics and
community issues in regard to conducting international research