Annual Academic Assessment Report Cover Sheet...and MBA Programs office developed rubrics and...
Transcript of Annual Academic Assessment Report Cover Sheet...and MBA Programs office developed rubrics and...
10/2014 1
Annual Academic Assessment Report Cover Sheet Assessment reports are due the 1st Wednesday after the Fall Term
Program Information:
Program Assessed
Master of Business Administration (MBA)
Department
MBA Programs Office
College
Lee Business School (LBS)
Department Chair Chin-Chun (Vincent) Hsu, Ph.D., CMA
Assessment Coordinator
Chin-Chun (Vincent) Hsu, Ph.D., CMA
Date Submitted December 20, 2017
Contact Person for This Report
Name Chin-Chun (Vincent) Hsu, Ph.D., CMA
Phone 895-3842
Please attach a narrative (not to exceed 4 pages, excluding appendices) addressing the following:
What are the student learning outcomes? Please provide a numbered list.
Which learning outcomes were assessed?
How were they assessed? (Programs must use at least one direct assessment of student learning.)
Undergraduate programs should assess at least one University Undergraduate Learning Outcome (UULO) each year, which may or may not overlap with a program learning outcome.
Graduate programs should assess at least one outcome related to one of the following graduate level requirements each year:
o student engagement in research, scholarship, creative expression and/or appropriate high-level professional practice.
o activities requiring originality, critical analysis and expertise. o the development of extensive knowledge in the field under study.
What was learned from the assessment results?
How did the program respond to what was learned?
Please limit the narrative portion of your report to no more than four pages. You may attach appendices with data, tables, charts, or other materials as needed. Please explain the relevant conclusions from any appendices in your narrative. Please contact the Office of Academic Assessment if you have questions or need assistance.
10/2014 2
What are the student learning outcomes? Please provide a numbered list.
Goals of the MBA Program are driven by the mission and strategic plan of the Lee Business School. Upon completion of the MBA program, students should be able to:
1. SLO 1: Recognize and evaluate ethical, legal and regulatory dimensions of business
decisions
2. SLO 2: Communicate effectively business ideas and analyses in writing
3. SLO 3: Communicate effectively business ideas and analyses in oral presentations
4. SLO 4: Work effectively in a team setting
5. SLO 5: Apply business concepts to managerial decision making
Which learning outcomes were assessed?
In Fall 2014, the MBA Programs were redesigned to support the mission and student learning outcomes and the new curriculum was implemented in Fall 2015. We perform the assessment by following the curriculum map in the newly developed 2015-2018 Three-year Assessment Plan. We intend to complete a cycle of assessment data collection in 2017-2018 academic year that will allow us to measure the attainment of these goals and outcomes. A curriculum map showing the assessment points for each learning outcome is attached in Appendix A.
In Fall 2017, we assessed all SLOs through several groups of students:
We assessed SLO 1 through MBA 787
We assessed SLO 2 through MBA 763 and MBA 769.
We assessed SLO 3 through MBA 769.
We assessed SLO 4 through MBA 767.
We assessed SLO 5 through MBA 787.
How were they assessed? (Programs must use at least one direct assessment of student learning.)
Utilizing the course-embedded system of assessment will allow for detailed outcome-level data on achievement of the outcomes connected to each program goal. The MBA teaching faculty and MBA Programs office developed rubrics and assessment data collection forms to assess student achievement of the learning outcomes. Please refer to Appendix 1-5 for sample rubrics and sample forms. The forms identify the performance levels in the following fashion – Level 5 (Excellent), Level 4 (Good), Level 3 (Adequate), Level 2 (Weak), and Level 1 (Poor).
10/2014 3
We assessed SLO 1 through core course MBA 787 [Direct Assessment: course-embedded assessment].
MBA students will recognize and evaluate ethical, legal and regulatory dimensions of
business decisions.
In Fall 2017, SLO 1 was also assessed in MBA 787 class. As the culminating experience
for all Lee Business School’s MBA students, MBA 787 Capstone Business Projects give
students the opportunity to demonstrate mastery of the skills and knowledge gained
throughout their program. SLO 1 is part of the assessment requirements. The project is
completed in four to five months (one academic semesters). [See Appendix 1].
We assessed SLO 2 through core course MBA 763 and MBA 769 [Direct Assessment: course-embedded assessment].
MBA students will demonstrate ability of communicating effectively business ideas and
analyses in writing.
In Fall 2017, written assignments for case analyses in MBA 763 Leadership, Teams and
Individuals served as course-embedded assessment. Throughout the semester the
students turn in team case analyses as well as individual assignments, all of which are
written assignments. In addition, the two exams are individual case analyses. The
professor rated students’ performance using the Assessment Rubric [See Appendix 2].
In Fall 2017, a case study decision essay assignments that center on economic analysis
decisions in MBA 769 Applied Economic Analysis served as course-embedded
assessment. The professor rated students’ performance using the Assessment Rubric
[See Appendix 2].
We assessed SLO 3 through core course MBA 769 [Direct Assessment: course-embedded assessment].
MBA students will demonstrate ability of communicating effectively business ideas and
analyses in oral presentation.
In Fall 2017, applied economic analysis reports in MBA 769 Applied Economic Analysis
serve as course-embedded assessment.. The Finance professor rated students’
performance using the Assessment Rubric [See Appendix 3].
10/2014 4
We assessed SLO 4 through core course MBA 767 [Indirect Assessment].
SLO 4 is to measure the student’s ability to work effectively in a team setting.
The students were informed that upon completion of the MBA 767, they would also be
asked to complete a Group Processes and Peer Evaluation Form (See Appendix 4). This
form was intended to measure the degree of effectiveness of the groups and the extent
to which all members did their share of the work.
We assessed SLO 5 through core course MBA 787 [Indirect Assessment].
SLO 5 is to measure the student’s ability to work effectively in a team setting.
The students were also informed that upon completion of the MBA 787’s Capstone
project, they would also be asked to complete a Group Processes and Peer Evaluation
Form (See Appendix 5). This form was intended to measure the degree of effectiveness
of the groups and the extent to which all members did their share of the work.
Undergraduate programs should assess at least one University Undergraduate Learning Outcome (UULO) each year, which may or may not overlap with a program learning outcome.
Not Applicable. The Master of Business Administration (MBA) degree is a business graduate program. UULO does not apply to graduate programs.
Graduate programs should assess at least one outcome related to one of the following graduate level requirements each year: o student engagement in research, scholarship, creative expression and/or appropriate high-level
professional practice. o activities requiring originality, critical analysis and expertise.
the development of extensive knowledge in the field under study.
The Master of Business Administration (MBA) degree is a non-thesis program designed to serve students, alumni, and businesses by providing educational programs that enhance leadership and competence among business people, especially business practitioners, and provides solutions for important business problems.
What was learned from the assessment results?
10/2014 5
We assessed SLO 1 through core course MBA 787. Results:
1. Table 1 and Table 2 report the results from MBA 787. The SLO 1 was assessed using
assessment rubric with five-point scale. Table 2 shows the percentage of students
meeting and exceeding expectation. In terms of Identification of Ethical Issues, most
students do very well with a median of 4.0; 46% of students have reached “Good” or
“Excellent” levels. In terms of Consideration of Stakeholders, most students do well with
a median score of 3 with 44% of students have reached “Good” or “Excellent” levels. In
terms of Analysis of Issue from Multiple Ethical Perspectives, the median score is 3.0 and
36% of students have reached “Good” or “Excellent” levels. In terms of Discussion of
Options, the median score is 3.0 and 44% of students have reached “Good” or
“Excellent” levels. In terms of Proposal of Decision, the median score is 3.0 and 36% of
students have reached “Good” or “Excellent” levels.
10/2014 6
We assessed SLO 2 through core course MBA 763 and MBA 769. Results:
1. Table 3 and Table 4 report the results from MBA 763 Leadership, Teams and Individuals.
The SLO 2 were assessed using assessment rubric with five-point scale. As shown in
Table 5, the median scores for all five dimensions are in 4. Table 6 shows the
percentage of students meeting and exceeding expectation. In terms of Clarity and
Conciseness, most students do very well with a median of 4.0; 65% of students have
reached “Good” or “Excellent” levels. In terms of Professional Tone, most students do
well with a median score of 4 with 60% of students have reached “Good” or “Excellent”
levels. In terms of Organization, the median score is 4.0 and 72.5% of students have
reached “Good” or “Excellent” levels. In terms of Grammar and Mechanics, the median
score is 4.0 and 67.5% of students have reached “Good” or “Excellent” levels.
10/2014 7
1.
2. Table 5 and Table 6 report the results from MBA 769 Applied Economic Analysis. The
SLO 2 were assessed using assessment rubric with five-point scale. As shown in Table 5,
the median scores for all five dimensions are in 4 or 5. Table 6 shows the percentage of
students meeting and exceeding expectation. In terms of Clarity and Conciseness, most
students do very well with a median of 4.0; 79.5% of students have reached “Good” or
“Excellent” levels. In terms of Professional Tone, most students do well with a median
score of 4 with 82% of students have reached “Good” or “Excellent” levels. In terms of
Organization, the median score is 5.0 and 94.8% of students have reached “Good” or
“Excellent” levels. In terms of Grammar and Mechanics, the median score is 5.0 and
76.9% of students have reached “Good” or “Excellent” levels.
10/2014 8
We assessed SLO 3 through core course MBA 769. Results:
1. Table 7 and Table 8 report the results from MBA 769. Table 7 shows the median scores
for all dimensions are in 4 or better. Table 8 shows the percentage of students meeting
and exceeding expectation. For Organization, most students do very well with a median
of 5.0; 97.5% of students have reached “Good” or “Excellent”. For Subject Knowledge,
most students do well with a median score of 4.0 with 92.4% of students have reached
“Good” or “Excellent” levels. For Mechanics, the median score is 5.0; 100% of students
have reached “Good” or “Excellent” levels. For Eye Contact, the median score is 5.0;
97.4% of students have reached “Good” or “Excellent” levels. For Elocution, the median
score is 5.0; 97.4% of students have reached “Good” or “Excellent” levels.
10/2014 9
We assessed SLO 4 through core course MBA 767. Results:
1. Table 9 and Table 10 report the results from MBA 767. The SLO 4 were assessed using
assessment rubric with five-point scale (5 = strongly agree and 1 = strongly disagree).
The students were asked to rate their team’s performance. The percentage of students
rating their team as “strongly agree” or “agree” for each question is shown in Table 10.
It should be noted that the results represent all students who completed ratings for
each question. As shown in Table 9, the median scores for all 8 out of 10 questions are
in 5.
10/2014 10
10/2014 11
We assessed SLO 5 through core course MBA 787. Results:
1. Table 11 and Table 12 report the results from MBA 787 Capstone Project assessment.
The SLO 5 were assessed using assessment rubric with five-point scale (5 = strongly
agree and 1 = strongly disagree). The students were asked to rate their team’s
performance. The percentage of students rating their team as “strongly agree” or
“agree” for each question is shown in Table 12. It should be noted that the results
represent all students who completed ratings for each question. As shown in Table 11,
the median scores for all 10 questions are in 5.
10/2014 12
How did the program respond to what was learned?
In 2015, MBA program developed new assessment forms and rubrics. Learning
outcomes are assessed in required courses identified in the Curriculum Map.
Overall speaking, from the assessment results in 2017, we are meeting goals.
The 2016-17 year provided more evidence of a successful MBA program
revision and improved learning outcomes. Faculty participation in
assessment activities increased, as did systematic review of assessment
results.
Major assessment results documented improved learning outcomes when
compared to the 2015 year. Collectively, our assessment results have
documented better outcomes.
However, greater emphasis on ethical, legal and regulatory issues (SLO #1)
is desired in the program. The faculty reviewed the results and concluded
that “it seems clear that students clearly understand ethical, legal and
regulatory issues, but do not understand well how to apply them in business
decision making.” In order to integrate these issues into all facets of the
curriculum, the faculty have suggested that
o (1) case studies designed to foster recognition and application of
ethical, legal and regulatory issues to business operation and
performance be introduced in key courses of the program, and
o (2) the culmination of strategic and operational application of
ethical, legal and regulatory knowledge be evaluated during the the
strategic management “capstone” course (MBA 787). Data will
continue to be collected in the spring of 2018 in MBA 787. Data from
this course will be compared to data collected from the previous two
academic years to gauge improvement in the areas discussed above.
The Lee Business School MBA program is set up as a non-cohort program.
Students can attend either part time or full time, and have flexibility in how
they take MBA courses. Students can graduate in as little as a year and a half
and have up to six years to complete the MBA program. On average our
students take three years to complete the program. It is important to look at
a student’s longevity in the program and how it relates to their scores.
10/2014 13
Appendix A
10/2014 14
Appendix 1
10/2014 15
Appendix 2
10/2014 16
Appendix 3
10/2014 17
Appendix 4
10/2014 18
Appendix 5