EVALUATOR EVALUATOR ORIENTATIONORIENTATION
Serving on Off-Site and On-Site CommitteesServing on Off-Site and On-Site Committees
OVERVIEWOVERVIEW
TYPES OF COMMITTEESTYPES OF COMMITTEES
Reaffirmation Committee (Off-Site Reaffirmation Committee (Off-Site Review Committee or On-Site Review Review Committee or On-Site Review Committee)Committee)
Substantive Change CommitteeSubstantive Change Committee Special CommitteeSpecial Committee Candidacy CommitteeCandidacy Committee Accreditation CommitteeAccreditation Committee
INVITATIONS TO SERVE AS AN INVITATIONS TO SERVE AS AN EVALUATOREVALUATOR
Invitations Come From Commission Invitations Come From Commission Staff MemberStaff Member
Usually Invitations Are By E-MailUsually Invitations Are By E-Mail Reply Promptly And Check For Conflict Reply Promptly And Check For Conflict
of Interest Because Declines Must Be of Interest Because Declines Must Be Replaced As Quickly As PossibleReplaced As Quickly As Possible
Evaluators Are Selected from Evaluators Are Selected from Evaluator Registry Evaluator Registry
EVALUATOR REGISTRYEVALUATOR REGISTRY
Arranged by level, type institution, Arranged by level, type institution, categorycategory
Contains records of visits and ratings Contains records of visits and ratings by chair and staffby chair and staff
Contains relevant comments Contains relevant comments concerning performance of concerning performance of committee memberscommittee members
Helpful InformationHelpful Information
• Handbook for Peer EvaluatorsHandbook for Peer Evaluators
• Modules which can be accessed at Modules which can be accessed at www.sacscoctraining.orgwww.sacscoctraining.org
• COC Staff and Committee ChairsCOC Staff and Committee Chairs
Logistics of VisitsLogistics of Visits
Staff Member Sends InvitationsStaff Member Sends Invitations Staff Sends Packets with Forms, Staff Sends Packets with Forms,
Handbooks, Principles, Travel Handbooks, Principles, Travel Information, Information Outline Information, Information Outline FormForm
Committee Member Arranges Travel Committee Member Arranges Travel and Submits Expense Voucher After and Submits Expense Voucher After the Visit for Expensesthe Visit for Expenses
Logistics……..Logistics……..
Institution (for On-Site Review Committees Institution (for On-Site Review Committees and other types of committees) or and other types of committees) or Commission Staff (for Off-Site Review Commission Staff (for Off-Site Review Committees meeting in Atlanta) Arranges Committees meeting in Atlanta) Arranges for Accommodations and Provides for Accommodations and Provides Information Concerning Transportation To Information Concerning Transportation To and From Airportand From Airport
Institution (for On-Site and others) Or Staff Institution (for On-Site and others) Or Staff (for Off-Site) Seeks Information on Dietary (for Off-Site) Seeks Information on Dietary Needs and Computer Needs (for On-Site)Needs and Computer Needs (for On-Site)
Staff, Chair, and Institution Communicate Staff, Chair, and Institution Communicate with Evaluatorswith Evaluators
QUALITIES OF AN EFFECTIVE QUALITIES OF AN EFFECTIVE COMMITTEE MEMBERCOMMITTEE MEMBER
Responds Promptly to InvitationsResponds Promptly to Invitations Within Reason, for On-Site Review Is Within Reason, for On-Site Review Is
Considerate of Institution in Making Considerate of Institution in Making Travel Plans and Providing Travel Plans and Providing InformationInformation
Reviews Materials Thoroughly Before Reviews Materials Thoroughly Before the Visitthe Visit
Qualities…….Qualities…….
On Time for Meetings, TransportationOn Time for Meetings, Transportation Has an Understanding of Best Has an Understanding of Best
Practices in Higher Education in Practices in Higher Education in His/Her Area of ExpertiseHis/Her Area of Expertise
Uses Professional Judgment in Uses Professional Judgment in Applying Best PracticesApplying Best Practices
Qualities…..Qualities…..
Is Fair and Objective In EvaluationIs Fair and Objective In Evaluation Is Willing To Make Difficult DecisionsIs Willing To Make Difficult Decisions Works with Other Committee Works with Other Committee
Members in Reaching Consensus Members in Reaching Consensus about Issuesabout Issues
Submits Expense Voucher Submits Expense Voucher Immediately after Visit with Immediately after Visit with Appropriate ReceiptsAppropriate Receipts
COMMONLY USED MATERIALSCOMMONLY USED MATERIALS
Principles of AccreditationPrinciples of Accreditation Handbook for Peer EvaluatorsHandbook for Peer Evaluators Training ModulesTraining Modules Review and Writing AssignmentsReview and Writing Assignments Tentative AgendaTentative Agenda Materials from Institution(s)Materials from Institution(s) Materials from Commission StaffMaterials from Commission Staff
The Review Process The Review Process for Reaffirmation of for Reaffirmation of
AccreditationAccreditationOVERVIEWOVERVIEW
Review of Compliance by Off-Site Review of Compliance by Off-Site Review CommitteeReview Committee
Report of Report of Off-Site Review CommitteeOff-Site Review Committee Shared with InstitutionShared with Institution
The Review Process…..The Review Process…..
Review by On-Site CommitteeReview by On-Site Committee of Quality of Quality Enhancement Plan and Compliance Issues Enhancement Plan and Compliance Issues (as identified by Off-Site Review (as identified by Off-Site Review CommitteeCommittee or which arise during On-Siteor which arise during On-Site visit) visit)
Report Completed by On-Site Review Report Completed by On-Site Review CommitteeCommittee Sent to Institution and Sent to Institution and Commission as Basis on which Action Is Commission as Basis on which Action Is TakenTaken
EVALUATOR EVALUATOR ORIENTATIONORIENTATION
The Off-Site ReviewThe Off-Site Review
SERVING AS AN EVALUATOR SERVING AS AN EVALUATOR ON AN OFF-SITE COMMITTEEON AN OFF-SITE COMMITTEE
OFF-SITE REVIEW COMMITTEEOFF-SITE REVIEW COMMITTEE7-9 MEMBERS7-9 MEMBERS
ChairChair Finance EvaluatorFinance Evaluator Institutional Institutional
Effectiveness Effectiveness EvaluatorEvaluator
Organization and Organization and Administration Administration EvaluatorEvaluator
Student Support Student Support EvaluatorEvaluator
Learning Support Learning Support EvaluatorEvaluator
Educational Program Educational Program Evaluators (Number Evaluators (Number Varies Depending on Varies Depending on Complexity of Complexity of Cluster Institutions)Cluster Institutions)
OFF-SITE REVIEW COMMITTEEOFF-SITE REVIEW COMMITTEETASKS Phase ITASKS Phase I
Phase I: Phase I: Each Committee Member Receives Each Committee Member Receives
Materials and Reviews Compliance in Materials and Reviews Compliance in Assigned Area(s) for Each of the Three or Assigned Area(s) for Each of the Three or
Four Institutions in the Four Institutions in the Cluster(approximately Cluster(approximately six to eight weeks six to eight weeks before meeting in Atlanta)before meeting in Atlanta)
Each Committee Member Completes a Each Committee Member Completes a Draft Draft Report for His/Her Review Report for His/Her Review Assignments for Assignments for Each Institution in the Each Institution in the Cluster and Cluster and Sends It Sends It to the Chairto the Chair
Phase IIPhase II
Phase II: Phase II:
Committee Meets in Atlanta for Committee Meets in Atlanta for Parts of Parts of Three Days to Review, Three Days to Review, Discuss and Discuss and Determine Compliance Determine Compliance for Each for Each Institution in the ClusterInstitution in the Cluster
Committee Completes a Report Committee Completes a Report for for Each Institution in the ClusterEach Institution in the Cluster
WHAT ARE CLUSTERS?WHAT ARE CLUSTERS?
A Group of Three or Four Institutions A Group of Three or Four Institutions Sharing Similar Characteristics Sharing Similar Characteristics
Assigned to an Assigned to an Off-Site ReviewOff-Site Review CommitteeCommittee for Review (Called a for Review (Called a Cluster Committee)Cluster Committee)
THE OFF-SITE REVIEWTHE OFF-SITE REVIEWPurposePurpose
Provide Assessment of ComplianceProvide Assessment of Compliance Core Requirements 1-11Core Requirements 1-11 Comprehensive Standards and Federal Comprehensive Standards and Federal
RequirementsRequirements
Provide Advice To Staff as Provide Advice To Staff as Appropriate Concerning Make-Up of Appropriate Concerning Make-Up of On-Site CommitteeOn-Site Committee
THE OFF-SITE REVIEWTHE OFF-SITE REVIEWPROCESSPROCESS
“Key Players”“Key Players”
InstitutionInstitution Commission StaffCommission Staff Off-Site Review CommitteeOff-Site Review Committee
Role of InstitutionRole of Institution
Conducts Compliance ReviewConducts Compliance Review Completes Compliance CertificationCompletes Compliance Certification Submits Compliance Certification Submits Compliance Certification
and Materials Demonstrating and Materials Demonstrating Compliance To Off-Site Review Compliance To Off-Site Review Committee Members (Hard Copy or Committee Members (Hard Copy or Transmitted Electronically)Transmitted Electronically)
MATERIALS SENT BY MATERIALS SENT BY INSTITUTIONINSTITUTION
HARD COPYHARD COPY
Compliance CertificationCompliance Certification
Summary Form (with identification of Summary Form (with identification of technical support person if some of technical support person if some of materials have been sent electronically)materials have been sent electronically)
CatalogCatalog
Financial Audit and Management Letter Financial Audit and Management Letter and Financial Aid Auditand Financial Aid Audit
Materials Sent by Materials Sent by Institution…Institution…
HARD COPY OR ELECTRONICALLY HARD COPY OR ELECTRONICALLY TRANSMITTEDTRANSMITTED
Institutional Effectiveness MaterialsInstitutional Effectiveness Materials
By-Laws, Minutes, Make-Up of BoardBy-Laws, Minutes, Make-Up of Board
Faculty Roster Denoting QualificationsFaculty Roster Denoting Qualifications
Policy ManualsPolicy Manuals
Other Materials Demonstrating Other Materials Demonstrating ComplianceCompliance
Role of Commission StaffRole of Commission Staff
Select and Invite Chair and Members of Select and Invite Chair and Members of Off-Site Review Committee for Each ClusterOff-Site Review Committee for Each Cluster
Send Roster and Pertinent Information to Send Roster and Pertinent Information to Chair and Committee MembersChair and Committee Members
Send Roster of Off-Site Review Committee Send Roster of Off-Site Review Committee to Institutions in Clusterto Institutions in Cluster
Role of Staff……..Role of Staff……..
Make Arrangements for Meeting in Make Arrangements for Meeting in AtlantaAtlanta
Communicate with Chair and Communicate with Chair and Committee Members and Institutions Committee Members and Institutions in the Clusterin the Cluster
Provide Support during Meeting in Provide Support during Meeting in AtlantaAtlanta
Materials Sent to Chair and Materials Sent to Chair and Committee Members by StaffCommittee Members by Staff
Roster of Off-Site Review CommitteeRoster of Off-Site Review Committee Handbook for Peer EvaluatorsHandbook for Peer Evaluators Principles of AccreditationPrinciples of Accreditation Blank Report of Report of the Blank Report of Report of the
Reaffirmation CommitteeReaffirmation Committee
Materials Sent by Staff…..Materials Sent by Staff…..
Review Assignments for Each Review Assignments for Each Committee MemberCommittee Member
Review Schedule for Institutions in Review Schedule for Institutions in ClusterCluster
Information Concerning Travel and Information Concerning Travel and Housing for the Meeting in AtlantaHousing for the Meeting in Atlanta
Expense VouchersExpense Vouchers
THE OFF-SITE REVIEW PRIOR TO THE THE OFF-SITE REVIEW PRIOR TO THE
MEETING IN ATLANTA (PHASE I)MEETING IN ATLANTA (PHASE I)
Review the Principles of AccreditationReview the Principles of Accreditation Review the Handbook for Review CommitteesReview the Handbook for Review Committees Review List of Institutions in the ClusterReview List of Institutions in the Cluster Contact Staff IMMEDIATELY if you discover a Contact Staff IMMEDIATELY if you discover a
conflict of interest with any of the institutions conflict of interest with any of the institutions in the Clusterin the Cluster
Check the List of Materials Sent by the Check the List of Materials Sent by the Institution and by StaffInstitution and by Staff
Call the Staff Member if an Item Is Call the Staff Member if an Item Is MissingMissing
Call the Technical Support Person at the Call the Technical Support Person at the Institution If You Cannot Access Institution If You Cannot Access Materials Sent ElectronicallyMaterials Sent Electronically
Do Not Otherwise Contact the InstitutionDo Not Otherwise Contact the Institution Familiarize Yourself With the InstitutionFamiliarize Yourself With the Institution
TASKSTASKS
Scan the Compliance Certification Scan the Compliance Certification DocumentDocument
Review Your Assignment (For Institutional Review Your Assignment (For Institutional Effectiveness Evaluators, Primarily Core Effectiveness Evaluators, Primarily Core Requirements 4 and 5 and Section 3).Requirements 4 and 5 and Section 3).
Review the Institution’s Compliance in the Review the Institution’s Compliance in the Area(s) of Your AssignmentArea(s) of Your Assignment
Communicate with Other Committee Communicate with Other Committee Members and the Chair as AppropriateMembers and the Chair as Appropriate
TasksTasks
Complete a Draft Report Reflecting Complete a Draft Report Reflecting Preliminary Assessment and Send It Preliminary Assessment and Send It to the Chair, Other Committee to the Chair, Other Committee Members, and StaffMembers, and Staff
Chair Will Compile Drafts Into One Chair Will Compile Drafts Into One Draft Report and Will Send It To Draft Report and Will Send It To Committee Members and StaffCommittee Members and Staff
Assessing ComplianceAssessing ComplianceInstitutional EffectivenessInstitutional Effectiveness
Familiarize yourself with mission of Familiarize yourself with mission of the institutionthe institution
Familiarize yourself with size of Familiarize yourself with size of institutions and programs offeredinstitutions and programs offered
Review institutional effectiveness Review institutional effectiveness documents provided by institutiondocuments provided by institution
Assessing Compliance……..Assessing Compliance……..
Read the narrative provided by the Read the narrative provided by the institution describing its processinstitution describing its process
Determine who is responsible for the Determine who is responsible for the process at the institutionprocess at the institution
Determine whether there is a Determine whether there is a timeline provided by which process timeline provided by which process functionsfunctions
Assessing compliance……Assessing compliance……
Is the process ongoing?Is the process ongoing? Is there evidence that it functions? Is there evidence that it functions?
What evidence might signal a What evidence might signal a functioning process?functioning process?
Is the process integrated? Is there Is the process integrated? Is there evidence that all areas of the evidence that all areas of the institution are engaged in planning institution are engaged in planning and evaluation?and evaluation?
Assessing compliance……Assessing compliance……
Is there evidence that the process is Is there evidence that the process is research-based?research-based?
Does it appear that meaningful goals Does it appear that meaningful goals and objectives are set by various units?and objectives are set by various units?
Are there various types of assessment Are there various types of assessment means used?means used?
Is there evidence that results of Is there evidence that results of assessment are used for improvement?assessment are used for improvement?
Assessing compliance……Assessing compliance……
Are there representative samples Are there representative samples from various units indicating that from various units indicating that student learning outcomes have student learning outcomes have been identified and that they are been identified and that they are assessed on a regular basis?assessed on a regular basis?
Is there evidence of improvement in Is there evidence of improvement in the various units?the various units?
COMMUNICATE WITH OTHER COMMUNICATE WITH OTHER COMMITTEE MEMBERSCOMMITTEE MEMBERS
Throughout the process of off-site Throughout the process of off-site evaluation, it is crucial that Committee evaluation, it is crucial that Committee members communicate with each other.members communicate with each other.
Communication is especially important Communication is especially important for the institutional effectiveness for the institutional effectiveness evaluator.evaluator.
The roster of Committee members will The roster of Committee members will contain e-mail addresses for assistance contain e-mail addresses for assistance in communication.in communication.
Communicate…Communicate…
Committee members should monitor Committee members should monitor e-mail frequently during the time of e-mail frequently during the time of review and respond as quickly as review and respond as quickly as possible.possible.
Staff and Chair should be copied on Staff and Chair should be copied on all e-mail so that they can render all e-mail so that they can render assistance and be aware of concerns.assistance and be aware of concerns.
WRITE A DRAFT REPORTWRITE A DRAFT REPORT
For each institution in the Cluster, For each institution in the Cluster, mark Compliance, Non-Compliance, mark Compliance, Non-Compliance, or Did Not Review for each of your or Did Not Review for each of your assigned Core Requirement(s), assigned Core Requirement(s), Comprehensive Standard(s), and/or Comprehensive Standard(s), and/or Federal Requirements.Federal Requirements.
Write narrative explaining specifically Write narrative explaining specifically why you made the determination of why you made the determination of compliance or non-compliancecompliance or non-compliance
Draft………Draft………
Make suggestions to staff as Make suggestions to staff as appropriate concerning the On-Site appropriate concerning the On-Site Review CommitteeReview Committee
Send your draft electronically to the Send your draft electronically to the Chair and other Committee members Chair and other Committee members and Staffand Staff
COMPLETING THE OFF-SITE COMPLETING THE OFF-SITE REVIEW IN ATLANTA (Phase II)REVIEW IN ATLANTA (Phase II)
Orientation Meeting of CommitteeOrientation Meeting of Committee The Committee, Led by the Chair and The Committee, Led by the Chair and
With Discussion by All Committee With Discussion by All Committee Members, Determines Compliance of Members, Determines Compliance of Each Institution in the ClusterEach Institution in the Cluster
The Committee Produces a The Committee Produces a ReportReport for for Each Institution in the ClusterEach Institution in the Cluster
Completing the Review in Completing the Review in Atlanta…Atlanta…
The Committee Agrees on All Areas The Committee Agrees on All Areas Marked Compliance or Non-Marked Compliance or Non-Compliance and Agrees on Narrative Compliance and Agrees on Narrative Supporting Each (Both Compliance Supporting Each (Both Compliance and Non-Compliance)and Non-Compliance)
THE FINAL REPORT OF THE THE FINAL REPORT OF THE OFF-SITE COMMITTEEOFF-SITE COMMITTEE
Compliance: The Committee has Compliance: The Committee has determined that the institution has determined that the institution has presented acceptable narrative and presented acceptable narrative and documentation demonstrating compliance.documentation demonstrating compliance.
Non-Compliance:Non-Compliance: The Committee has The Committee has determined, after review of the narrative determined, after review of the narrative and documentation presented by the and documentation presented by the institution, that the institution is not in institution, that the institution is not in compliance.compliance.
Completion of WorkCompletion of Work
The Committee’s Work Is Finished The Committee’s Work Is Finished After the Report Is CompletedAfter the Report Is Completed
The Committee Has No Contact with The Committee Has No Contact with Institutions Following Off-Site ReviewInstitutions Following Off-Site Review
A Special NoteA Special NoteCONFIDENTIALITYCONFIDENTIALITY
Maintain Confidentiality At All TimesMaintain Confidentiality At All Times Discuss the Institutions in the Cluster Discuss the Institutions in the Cluster
ONLY with Other Committee ONLY with Other Committee Members, Chair of the Committee, Members, Chair of the Committee, and Commission Staffand Commission Staff
Do Not Contact the Institution Do Not Contact the Institution (except tech support) Before, During, (except tech support) Before, During, or After the Review Activitiesor After the Review Activities
CHALLENGES OF THE OFF-SITE CHALLENGES OF THE OFF-SITE REVIEWREVIEW
Difficulty in assessing compliance Difficulty in assessing compliance only on paperonly on paper
Sometimes problems in accessing Sometimes problems in accessing materials (especially electronically)materials (especially electronically)
Amount of time needed to review Amount of time needed to review three or four institutionsthree or four institutions
EVALUATOR EVALUATOR ORIENTATIONORIENTATION
The On-Site VisitThe On-Site Visit
THE ON-SITE REVIEWTHE ON-SITE REVIEW
The Make-Up of the On-Site CommitteeThe Make-Up of the On-Site Committee The Tasks of the On-Site CommitteeThe Tasks of the On-Site Committee Preparing for the VisitPreparing for the Visit Conducting the VisitConducting the Visit
Reviewing ComplianceReviewing ComplianceReviewing the QEPReviewing the QEPWriting the ReportWriting the Report
Make-Up of the On-Site Make-Up of the On-Site CommitteeCommittee
ChairChair CEOCEO Institutional EffectivenessInstitutional Effectiveness Educational Programs and FacultyEducational Programs and Faculty Learning or Student Support ServicesLearning or Student Support Services Quality Enhancement Plan EvaluatorQuality Enhancement Plan Evaluator Others as NecessaryOthers as Necessary
TASKS OF ON-SITE TASKS OF ON-SITE COMMITTEECOMMITTEE
Review of Quality Enhancement Plan (Core Review of Quality Enhancement Plan (Core Requirement 12)Requirement 12)
Review Areas of Non-Compliance Cited by Review Areas of Non-Compliance Cited by Off-Site CommitteeOff-Site Committee
Consider Any Other Areas of Non-Consider Any Other Areas of Non-Compliance which Come to its AttentionCompliance which Come to its Attention
Refine or Revise Narrative Provided by Off-Refine or Revise Narrative Provided by Off-Site Committee for Compliance Site Committee for Compliance
Write a Report To Be Sent to Committees Write a Report To Be Sent to Committees on Compliance and Reportson Compliance and Reports
Conduct an Exit ConferenceConduct an Exit Conference
PREPARING FOR VISITPREPARING FOR VISIT
Make Arrangements (Communicate with Make Arrangements (Communicate with Staff, Chair, Institution as Appropriate)Staff, Chair, Institution as Appropriate) Travel—Arrive by first meeting timeTravel—Arrive by first meeting time See Handbook concerning preparationsSee Handbook concerning preparations
Review Materials ThoroughlyReview Materials Thoroughly
Off-Site Committee ReportOff-Site Committee Report
Institution’s Focused ReportInstitution’s Focused Report
Quality Enhancement PlanQuality Enhancement Plan
Review/Writing AssignmentsReview/Writing Assignments
Preparing for Visit……Preparing for Visit……
Determine Interviews Desired and Determine Interviews Desired and Communicate to ChairCommunicate to Chair
Make Notes and Be Prepared To Make Notes and Be Prepared To Discuss Compliance Issues and QEP Discuss Compliance Issues and QEP Observations during a Conference Observations during a Conference Call (if the chair arranges one) and at Call (if the chair arranges one) and at the Orientation Meeting of the the Orientation Meeting of the CommitteeCommittee
CONDUCTING THE VISITCONDUCTING THE VISIT
Visit Takes Place Over Parts of Three Visit Takes Place Over Parts of Three DaysDays
Review Compliance Issues (Arrive at Review Compliance Issues (Arrive at Consensus Regarding Consensus Regarding Recommendations)Recommendations)
Review Quality Enhancement Plan Review Quality Enhancement Plan (Determine Acceptability Consistent (Determine Acceptability Consistent With Core Requirement 12)With Core Requirement 12)
Conducting the Visit……….Conducting the Visit……….
Complete Report (Indicate Compliance or Non-Complete Report (Indicate Compliance or Non-Compliance and Write Narrative as Appropriate) Compliance and Write Narrative as Appropriate)
QEP recommendations are placed under Core QEP recommendations are placed under Core Requirement 12.Requirement 12.
QEP supporting narrative is under Part III of the QEP supporting narrative is under Part III of the reportreport
Conduct an Exit ConferenceConduct an Exit Conference
Discussion of Findings (Staff, Chair, On-Site Discussion of Findings (Staff, Chair, On-Site Committee, Institution’s Leadership Team)Committee, Institution’s Leadership Team)
COMPLIANCE ISSUESCOMPLIANCE ISSUES
Consider Best Practices and Apply Consider Best Practices and Apply Professional Judgment in Determining Professional Judgment in Determining ComplianceCompliance
Draft Recommendations for Areas Where the Draft Recommendations for Areas Where the Institution Appears To Be Out of ComplianceInstitution Appears To Be Out of Compliance
Draft Narrative Explaining Specifically Why Draft Narrative Explaining Specifically Why There Is Non-ComplianceThere Is Non-Compliance
Reach Consensus with Entire Committee Reach Consensus with Entire Committee Concerning Compliance or Non-Compliance, Concerning Compliance or Non-Compliance, the Wording of Recommendations, and the the Wording of Recommendations, and the Narrative for All Requirements and StandardsNarrative for All Requirements and Standards
Compliance Issues….Compliance Issues….
Compliance Issues Not Cited by the Compliance Issues Not Cited by the Off-Site Committee May Come To the Off-Site Committee May Come To the Attention of the On-Site CommitteeAttention of the On-Site Committee
EVALUATING THE ACCEPTABILITY EVALUATING THE ACCEPTABILITY OF THE QEPOF THE QEP
Part of the Planning and Evaluation Part of the Planning and Evaluation Process?Process?
Focused (significant and manageable)Focused (significant and manageable) Institutional CapacityInstitutional Capacity Institutional Assessment ProvisionsInstitutional Assessment Provisions Broad-BasedBroad-Based Linked to Student Learning OutcomesLinked to Student Learning Outcomes Provide Input to Two Quality Enhancement Provide Input to Two Quality Enhancement
EvaluatorsEvaluators
SUMMARYSUMMARYTASKS OF ON-SITE EVALUATORTASKS OF ON-SITE EVALUATOR Prior to visit reviews Off-Site Report, Prior to visit reviews Off-Site Report,
Focused Report of Institution, and QEPFocused Report of Institution, and QEP During visit reviews any compliance issuesDuring visit reviews any compliance issues
Reviews documentsReviews documents
Interviews as necessaryInterviews as necessary
During visit assists in reviewing QEPDuring visit assists in reviewing QEP
Writes for assigned areas Writes for assigned areas (recommendations and/or narrative)(recommendations and/or narrative)
A Special NoteA Special NoteCONFIDENTIALITYCONFIDENTIALITY
Maintain Confidentiality At All TimesMaintain Confidentiality At All Times Discuss the Institution ONLY with Discuss the Institution ONLY with
Other Committee Members, Chair of Other Committee Members, Chair of the Committee, and Commission the Committee, and Commission StaffStaff
Do Not Contact the Institution After Do Not Contact the Institution After the Review Activitiesthe Review Activities
EVALUATOR EVALUATOR ORIENTATIONORIENTATION
Using Professional Judgment Using Professional Judgment and Applying Best Practicesand Applying Best Practices
Evaluating InstitutionsEvaluating Institutions
An Evaluator An Evaluator must consider what are best practices in must consider what are best practices in
any given areaany given area must carefully consider the institution’s must carefully consider the institution’s
“case” that it complies with a “case” that it complies with a requirement or standardrequirement or standard
must apply professional judgment in must apply professional judgment in determining compliancedetermining compliance
EXERCISING PROFESSIONAL EXERCISING PROFESSIONAL JUDGMENT IN DETERMINING JUDGMENT IN DETERMINING
COMPLIANCECOMPLIANCEExercised by peers during Exercised by peers during
evaluationevaluation
Based on your study in higher Based on your study in higher educationeducation
Based on your experiencesBased on your experiences
Based on your expertise in dealing Based on your expertise in dealing with with particular issues in higher particular issues in higher educationeducation
Professional Judgment…….Professional Judgment…….
Based on your understanding and Based on your understanding and application of Principles of application of Principles of AccreditationAccreditationBased on your evaluation of the Based on your evaluation of the soundness of the institution’s soundness of the institution’s analysis analysis relating to compliancerelating to complianceBased on your evaluation of the Based on your evaluation of the cogency cogency of the evidence of the evidence presented by the presented by the institutioninstitution
Evidence should be….Evidence should be….ReliableReliable The evidence is consistent The evidence is consistent
throughout the compliance throughout the compliance certification.certification.
CurrentCurrent The information supports an The information supports an assessment of the current assessment of the current status of the institution.status of the institution.
VerifiableVerifiable The evidence can be The evidence can be corroborated.corroborated.
CoherentCoherent The evidence is logical and The evidence is logical and consistent with other consistent with other patterns of evidence patterns of evidence presented.presented.
Evidence….Evidence….
ObjectiveObjective The evidence is based on The evidence is based on observable data and observable data and information.information.
RelevantRelevant The evidence directly The evidence directly addresses the requirement addresses the requirement or standard under or standard under consideration and should consideration and should provide the basis for the provide the basis for the institution’s actions institution’s actions designed to achieve designed to achieve compliance.compliance.
Evaluating the “Case” for Evaluating the “Case” for ComplianceCompliance
Reviewers ascertain Reviewers ascertain accuracy and adequacy of summaries and accuracy and adequacy of summaries and interpretations of the data to which they interpretations of the data to which they refer and whether the narratives and the refer and whether the narratives and the data combined support the institution’s data combined support the institution’s claim of compliance.claim of compliance.
As a reviewer on-site, you may wish to As a reviewer on-site, you may wish to examine documents and identify a group examine documents and identify a group of persons whom you wish to interview to of persons whom you wish to interview to gain additional insight.gain additional insight.
Conducting the ReviewConducting the Review
For Committees reviewing a cluster of For Committees reviewing a cluster of institutions during an Off-Site Review, each institutions during an Off-Site Review, each institution should be reviewed separately, institution should be reviewed separately, taking into consideration the mission of the taking into consideration the mission of the institution. institution.
Avoid “comparative compliance,” i.e., Avoid “comparative compliance,” i.e., determining compliance based on whether an determining compliance based on whether an institution is “at least more in compliance than institution is “at least more in compliance than another one.” Avoid comparing the institution another one.” Avoid comparing the institution to your institution.to your institution.
Conducting the Review….Conducting the Review….
On-Site evaluators should likewise avoid On-Site evaluators should likewise avoid “comparative compliance.”“comparative compliance.”
Remember that it is the responsibility of Remember that it is the responsibility of the institution to establish compliance. the institution to establish compliance. It is the Committee’s responsibility to It is the Committee’s responsibility to determine whether the institution has determine whether the institution has established compliance or not.established compliance or not.
Conducting the Review…..Conducting the Review…..
Look first at the “case” the institution Look first at the “case” the institution makes for compliance.makes for compliance.
Then assess whether you think the Then assess whether you think the institution’s “case” and the institution’s “case” and the documents which it provides in documents which it provides in support of its “case” are sufficient.support of its “case” are sufficient.
Conducting the Review….Conducting the Review….
Review components of your Review components of your assignment which can be quickly assignment which can be quickly determineddetermined
Then review components of your Then review components of your assignment which may require assignment which may require discussion with other Committee discussion with other Committee members and more in-depth analysismembers and more in-depth analysis
PEER EVALUATIONPEER EVALUATION
Integrity of Accreditation Depends on Integrity of Accreditation Depends on the Willingness of Peer Evaluators to the Willingness of Peer Evaluators to Make Fair, Well-Thought-Out, Objective, Make Fair, Well-Thought-Out, Objective, and Sometimes Difficult Decisionsand Sometimes Difficult Decisions
Decisions about Compliance Are Made Decisions about Compliance Are Made To Assist Institutions in Improving the To Assist Institutions in Improving the Quality of Their Operations and Quality of Their Operations and ServicesServices
Top Related