Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and...

22
NASPA Journal, 2006, Vol. 43, no. 2 Impact of Service-Learning and Social Justice Education on College Students’ Cognitive Development Yan Wang Robert Rodgers This study used the Measure of Epistemology Reflection to explore the impact of service-learning and social justice education on college students’ cognitive development. Six service-learning courses taught with or without a social justice emphasis were studied. Results showed that ser- vice-learning courses in general had a positive impact on students’ cognitive development, while service-learning courses with a social justice emphasis appeared to have more impact on students’ cognitive development than those without a social justice emphasis. Introduction Service-learning is an area where academic affairs and student affairs cooperate and often jointly sponsor programs. Service-learning inten- tionally focuses on both service experience and academic learning and makes connections between these two components through reflective activities. Student affairs often administers the program and may help plan reflective activities. Faculty designs classes, sometimes in collab- 316 Yan Wang is a research manager in the Office of Strategic Planning and Research at Milwaukee Area Technical College. Robert Rodgers is an associate professor of higher education and psychology at Ohio State University.

Transcript of Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and...

Page 1: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

Impact of Service-Learning and Social Justice Education on CollegeStudents’ Cognitive Development

Yan WangRobert Rodgers

vThis study used the Measure of Epistemology Reflection toexplore the impact of service-learning and social justiceeducation on college students’ cognitive development. Sixservice-learning courses taught with or without a socialjustice emphasis were studied. Results showed that ser-vice-learning courses in general had a positive impact onstudents’ cognitive development, while service-learningcourses with a social justice emphasis appeared to havemore impact on students’ cognitive development thanthose without a social justice emphasis.

IntroductionService-learning is an area where academic affairs and student affairscooperate and often jointly sponsor programs. Service-learning inten-tionally focuses on both service experience and academic learning andmakes connections between these two components through reflectiveactivities. Student affairs often administers the program and may helpplan reflective activities. Faculty designs classes, sometimes in collab-

316

Yan Wang is a research manager in the Office of Strategic Planning and Researchat Milwaukee Area Technical College. Robert Rodgers is an associate professor ofhigher education and psychology at Ohio State University.

Page 2: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

oration with student affairs and service site personnel. Research hasshown that student participation in service-learning programs helpsmeet community needs; facilitates their learning of course content;and enhances their own personal, interpersonal, cognitive, and moraldevelopment (for example, Cram, 1998; Eyler, Giles, & Braxton,1997; Johnson & Bozeman, 1998; Myers-Lipton, 1998; Osborne,Hammerich, & Hensley, 1998; Rhodes, 1999; Payne, 2000). Cognitivedevelopment is the focus of this study, because it is a primary goal ofmost colleges and is an outcome that might be influenced by service-learning courses (for example, Batchelder & Root, 1994; Eyler &Giles, 1999; Markus, Howard, & King, 1993; Shastri, 1999).

This research investigated cognitive development outcome for service-learning courses with various degrees of social justice emphasis usingMeasure of Epistemological Reflection (MER) (Baxter Magolda &Porterfield, 1985), a measure of cognitive development on the PerryScheme (1970, 1999). The research questions were as follows: (a) Willservice-learning courses have a positive impact on students’ cognitivedevelopment during the 10 weeks of the course? and (b) Will service-learning courses with a social justice emphasis have more positiveimpact on students’ development of cognitive complexity than thosewithout a social justice emphasis?

Service-Learning and Cognitive Development

Studies on the cognitive outcomes of service-learning have focused onself-report measures of critical thinking skills and knowledge ofcourse content (Bringle & Kremer, 1993; Cohen & Kinsey, 1994;Nankwe, 1999). Other studies focused on grades as a measure of cog-nitive development, with some finding that service-learning studentshad higher grades than nonservice-learning students (Markus,Howard, & King, 1993; Strage, 2000). Others found no differences(Kendrick, 1996; Miller, 1994; Shastri, 1999).

Eyler (2000) believes that grades and self-report on learning and crit-ical thinking are not good measures of cognitive outcomes. Self-reportof learning “is not only a weak measure of the complex cognitive out-comes we expect from service-learning; it also confuses satisfactionwith learning” (p. 13). Grades may measure memory of content andother skills but not the “ability to recognize ill-structured problems

317

Page 3: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

(Voss & Post, 1988) embedded in messy social contexts, to sort outconflicting information and views, and to resolve an issue whileunderstanding that such resolutions are inherently tentative (Lynch,1996)” (p. 12). Hence, research on the cognitive outcomes of service-learning needs to use established developmental measures of cognitivetheories such as the Perry Scheme, which does account for suchcapacities.

Only a few studies have attempted to explore the impact of service-learning on student development of cognitive complexities(Batchelder & Root, 1994; Eyler & Giles, 1999; Eyler, Root, & Giles,1998; Osborne, Hammerich, & Hensley, 1998); and none of themused MER, a reliable production measure of cognitive development(Baxter Magolda & Porterfield, 1985). In this study, MER was chosento explore the impact of service-learning courses on students’ cogni-tive development described by the Perry Scheme (1970, 1999)

Cognitive Development and Developmental Education

The Perry Scheme (1970, 1999) and Reflective Judgment (King &Kitchener, 1994) are the most used theoretical frameworks in study-ing the cognitive development of college students. Both schemesdescribe levels of complexity with which students make meaning ofquestions of knowledge and valuation. In order to measure ReflectiveJudgment, interviews are required; hence, the study of a large numberof students is impractical. MER is an established paper-and-pencilmeasure of the Perry Scheme and is applicable to the study with a larg-er number of students. Therefore, the Perry Scheme was used in thisstudy.

The Perry Scheme (1970, 1999) conceptualizes cognitive develop-ment into nine positions, including five cognitive structural positionsand four existential and psychosocial positions (Broughton, 1975;King, 1982; Rodgers, 1980). Among the five cognitive structural posi-tions, the least complex levels (Positions 1, 2, and 3) are calledDualism because they assume absolute answers to questions of knowl-edge and valuation. Positions 4 and 5 are called Relativism becausethey view answers to questions of knowledge and valuation to beprobabilistic and relative to context. The four psychosocial and exis-tential positions (6 through 9) are descriptions of the use of relativis-

318

Page 4: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

tic structures to make commitments in some content area such associal responsibility. The three positions of Dualism are differentiatedby how uncertainty is accounted for: that is, either (a) uncertainty isnot legitimate; or (b) uncertainty is accounted for as an error commit-ted by an incompetent authority; or (c) uncertainty is legitimatebecause experts do not know the answers yet—however, somedaythey will know for sure. The positions in Relativism are differentiatedby how criteria are used in judgment: that is, either (a) the absence ofcriteria for making judgments or (b) the use of nonabsolute criteria formaking judgment in context.

Development through these positions is dependent upon cognitiveconflict. If a classroom can create cognitive dissonance or disequilib-rium for the learner’s current position or way of making meaning bychallenging the student with an appropriately more complex way ofthinking, cognitive development may be initiated (Widick,Knefelkamp, & Parker, 1975).

The appropriate design criteria for challenging and supporting move-ment from Dualism to Relativism and from Relativism to Commitmenthave been conceptualized by Widick, Knefelkamp, and Parker (1975)and Rodgers (1989). Optimal design criteria for the development ofdualists are as follows: (a) encounter moderate diversity of viewpointson course content; (b) use experiential learning whenever possible; (c)use highly structured learning environment designed by authorities;(d) require reflection on the encounter and emphasize differentiationand the partial legitimacy of the options covered; and (e) develop atrusting, personal atmosphere prior to encountering diversity.

The design criteria for relativists are somewhat different: (a) encounterhigh degrees of diversity in course content and instructional methods;(b) use abstract or experiential learning methods in encountering thisdiversity; (c) use low degrees of structure and permit students tostructure their own experiences; (d) design reflection on theencounter with diversity and emphasize both differentiation and inte-gration toward a commitment; and (e) build a personal atmosphere oftrust and collegiality in the learning environment before and duringlearning experiences.

319

Page 5: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

Both dualists and relativists, therefore, can profit from experientiallearning, a personal and trusting atmosphere, and opportunities toreflect on their experiences. They differ on the optimal degree of diver-sity to be encountered, the use of abstract learning methods, thedegree of structure to be used, and whether only differentiation orboth differentiation and integration are emphasized in reflection.Service-learning pedagogies may manifest these developmental crite-ria in different degrees. It is hypothesized that service-learning cours-es will manifest enough of these criteria to promote cognitivedevelopment.

Social Justice Education and Cognitive Development

Social justice education emerged from the civil rights movements ofthe 1960s. It is focused on race, ethnicity, gender, sexual orientation,or class; and it emphasizes “the role of oppression and social powerplay in perpetuating inequitable social arrangement” (O’Grady, 2000,p. 3). Adams and Zhou (1994) believed that social justice coursesinvolved students in the emotional domain and cognitive domain.Because students in these courses were asked to “relinquish outmod-ed and less complex thinking modes and to question inappropriateand stereotypic beliefs and attitudes” (p. 3), they experienced periodsof disequilibrium. Therefore, Adams and Zhou recognized the poten-tial of social justice education in facilitating students’ cognitive devel-opment, and they applied cognitive developmental theories to thedesign of a social justice education course and studied the effects ofthe course on students’ cognitive development.

Adams and Zhou (1994) used MER to study changes on the PerryScheme for a class of Resident Assistance (N = 68) and a class of stu-dents from the general population (N = 97). These classes had socialjustice as the content and were designed based upon Widick,Knefelkamp, and Parker’s (1975) developmental instruction principlesderived from the Perry Scheme. The differences between the pretestand posttest means were statistically significant for both classes, indi-cating more complex reasoning after taking the course. Hence, a socialjustice focus may promote cognitive development. However, in Adamsand Zhou’s study, no control group was available; therefore, it is notclear if students in a similar class without social justice emphasiswould have similar improvement in their cognitive complexities. In

320

Page 6: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

this study, students from courses both with and without a social jus-tice emphasis were included and comparison was made between thetwo groups of students.

Service-Learning and Social Justice Education

It is controversial whether service-learning courses should incorporatesocial justice education. Some theorists believed that service-learningcourses should not promote one philosophy or pedagogy over othersor limit service-learning to one set of values (Deans, 1999; Leeds,1999). Other theorists argue that social justice education should bepart of service-learning, because service-learning students often pro-vide help to social service agencies to meet the social needs created bythe social inequalities among different races, ethnicities, genders, sex-ual orientation (Kahne & Westheimer, 1999; O’Grady, 2000; Sleeter,1996). Accordingly, a social justice approach to service-learningemphasizes social issues and their underlying possible root causes insocial injustice, knowledge of alternative ways to address social justiceissues, and committment to change social situation (Delve, Mintz, &Stewart, 1990; O’Grady, 2000; Reardon, 1994; Seigel & Rockwood,1993; Sleeter, 1996).

In practice, some service-learning courses incorporate social justiceeducation and some do not (Wang, 2003). Since service-learning ped-agogies with a social justice emphasis appear to manifest some of thedevelopmental criteria described above, it is hypothesized that ser-vice-learning courses with a social justice emphasis may have moreinfluence on cognitive development than those without a social justiceemphasis. This study will compare the cognitive development of stu-dents from service-learning courses with and without a social justiceemphasis.

Methodology

Selection and Classification of Courses

The participants in this study were instructors and students in six ser-vice-learning courses offered at a large Midwestern state university.Five of the courses had one section and one had two sections; there-fore, seven instructors were invited to participate in the study. These

321

Page 7: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

courses were selected based on the academic level of the students inthese courses and whether social justice was an emphasis in the coursedesign. In particular, courses offered to first-year, third-year, fourth-year, and graduate students were chosen in order to cover cognitivedevelopment from position 2 to position 5 on the Perry Scheme.

Qualitative methods were used to classify the six courses into a SocialJustice group or Nonsocial Justice group, based on whether they havea social justice emphasis in course design or not. Interviews were con-ducted with instructors about the foci of their courses and theirdetailed designs for achieving their intended outcomes. Documentanalyses were done with course syllabi, reading packages, textbooks,handouts, and other materials. Based on the interviews and documentanalyses, each course was evaluated in four components: coursedescription and objectives, reading assignments, writing and otherassignments, and instructor’s perception of student achievement.

Criteria for defining a social justice emphasis were as follows: (1)whether social issues such as racism, social class prejudice, and struc-tural prejudice are raised in the course; (2) whether the complexitiesof the causes of these issues are covered; (3) whether social changesneeded to correct social injustice are emphasized; (4) whether invita-tions to commit to act for social change are given. These criteria werecross-tabulated against the above four components of each course. Ifall of the social justice criteria are met in each of the course compo-nents, the course is classified into the Social Justice group; otherwise,the course is classified into the Nonsocial Justice group.

The degrees of social justice emphasis for each course were analyzedby one researcher through analysis of all the course documents andinterview transcripts. A second researcher then read and analyzed allthe interview transcripts and syllabi independently and confirmed theclassifications of the first researcher. Member checks were then per-formed with six out of the seven instructors, and they also agreed withthe classifications of their courses.

Participants

The classifications, titles, and student compositions of these coursesare shown in Table 1. Numbers of students who were enrolled and

322

Page 8: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

who chose to participate in this study both at the pretest and posttestare also listed for each course in Table 1. The response rates rangedfrom 30.0% for Leadership in Community Service to 73.3% forEnglish Workshop. The overall response rate for all the courses was41.1%. A total of 72 students from these six service-learning coursesparticipated in this study. A total of 103 chose not to participate; thesample size of this study may limit the generalizability of the findingsfrom this study. Of the 72 participants, 20 were men and 52 werewomen; 19 were first-year undergraduate, 3 were second-year under-graduate, 11 were third-year undergraduate, 30 were fourth-yearundergraduate, and 9 were first-year master students; and their ageranged from 18 to 33.

Table 1Classifications, Titles, Student Class Rank, Enrollment

Numbers, and Response Rates of Studied Courses

323

Page 9: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

Instrument

This study used MER to measure students’ cognitive development(Baxter Magolda & Porterfield, 1985). MER is a written instrumentdesigned to assess Perry’s five positions of cognitive structural devel-opment. The MER yields a Total Protocol Rating (TPR) both as a cate-gorical score and a continuous score. The TPR scores range from 1through 5, with 5 being the most complex level. The validity of MERhas been shown by conducting analysis of variance by level of educa-tion. Significant differences (p < 0.001) among first-year, fourth-year,and graduate students were consistently found by Baxter Magolda andPorterfield (1988) in three samples of students. In addition, althoughstudies have shown that “men and women have different qualitativepatterns of thinking within those (cognitive) structures” based on theanalysis of reasoning structures (Baxter Magolda, 1988, p. 533), MERhas been shown to be bias-free in measuring cognitive structures ofdifferent gender groups using structural position scores (BaxterMagolda, 1988, 1990). In this study, first-year master students scoredsignificantly higher than undergraduate students both at the pretestand posttest (p < 0.01), and no gender differences were found.

The MER asks the respondents to answer a series of questions in eachof six domains of a learning environment. The six domains are: (a) thenature of knowledge, (b) the role of instructor, (c) the role of peers,(d) the role of learners, (e) evaluation in the learning process, and (f)educational decision making. Each domain starts with a general ques-tion that focuses on the domain content. Then three or four probequestions are used to solicit respondents’ justification and reasoningfor their initial responses, which are then rated for cognitive level.

A standardized MER rating manual (Baxter Magolda & Porterfield,1988) was used by trained and certified raters. There are two ways ofcalculating a TPR: categorical and continuous. The categorical TPRuses modal rating rules to arrive at domains and final categorical rep-resentations of the person. The categorical TPR is reported in threeformats. For example, 2–2 means that five or six of the domains are atstage 2, 2(3) means that four of the domains are at stage 2 and two ofthe domains are at stage 3, and 2–3 means that three of the domainsare at stage 2 and three of the domains are at stage 3. Nonparametricanalyses must be used with categorical TPR data. The continuous TPR

324

Page 10: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

is the arithmetic average of all scores across domains. No scores areomitted and, hence, it is comprehensive and can be used for paramet-ric statistical analyses. Although continuous scoring violates theoreti-cal assumptions that cognitive levels are categorical and not continu-ous traits, Baxter Magolda and Porterfield (1988) argued that the con-tinuous TPR can give researchers “more perspective than modal TPRin understanding a particular respondent’s thinking pattern” (p. 92),regardless of theoretical assumptions. Therefore, both types of TPRscores and both kinds of analyses were used in this study.

Procedure

The MER instruments were administered to students in all the cours-es/sections in the first week and tenth week of the class in the springquarter of 2003. This study used a quasi-experimental pretest-posttestdesign because students cannot be assigned randomly to differentclasses. This design may limit the ability to generalize the findings ofgeneral population; however, comparison between pretest andposttest can be conducted to explore treatment effect, control of selec-tion and mortality variables are provided, and conclusions can bereached about the differential effects of different kinds of treatments(Issac & Michael, 1995). The effects of maturation on MER appear notto be a concern. Previous studies have shown that usually college stu-dents change approximately 1-1/3 stages over the 4 years. However,within 10 weeks of period, changes appear not to be measurableunless the students are involved in a class designed specifically to pro-mote intellectual development (Baxter Magolda & Porterfield, 1988).The pretest effect appears not to be a problem on MER, therefore onlyone version of the instrument is available for both pretest and posttest(Baxter Magolda & Proterfield, 1988).

The MER were rated by a trained rater who rated all the responses. Asecond rater rated 20% of all the responses. The interrater reliabilitieswere as follows: exact agreement, 89%; within 1/3 stages, 95%; andwithin 2/3 stages, 100%. This is a higher level of agreement than mostother studies reported (Baxter Magolda & Proterfield, 1988).

In order to answer each of the research questions, the TPR scores fromMER were analyzed in two ways. The categorical data were analyzedusing frequency tables as well as histograms. The continuous scores

325

Page 11: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

were analyzed using parametric analysis, and the statistical signifi-cance level chosen for each hypothesis test was 0.05. The null hypoth-esis for the first research question is: there is no significant differencebetween MER pretest and posttest scores. Students’ t test was per-formed to compare MER pretest scores and posttest scores for thewhole sample. The null hypothesis for the second research question is:there is no difference in MER posttest scores between students in theSocial Justice group and those in the Nonsocial Justice group. Multiplelinear regression was used to analyze MER posttest scores in order tosee whether students in the Nonsocial Justice group are different fromthose in the Social Justice group. The selection of multiple regressionanalysis is to statistically control the potential influence of variablessuch as gender and age, which were not susceptible to direct controlin such a quasi-experimental study (Neter, Kutner, Nachtsheim, &Wasserman, 1996). Therefore, in addition to course classification,other independent variables such as MER pretest scores, age, classrank, and gender were included. MER pretest scores and age are con-tinuous variables; class rank is an interval variable ranging from 1=first-year undergraduate students through 5 = first-year master stu-dents; for the gender variable, female = 1; for the course classificationvariable, Social Justice group =1.

Results

Influence of Service-Learning Courses onCognitive Development

According to the hypotheses for the first research question, significantincreases on student MER scores from pretest to posttest are expected.Using continuous scores, the results of t test for the whole sampleshow that students’ MER scores have statistically significant increasefrom pretest to posttest, t (71) = 5.016, p = 0.000. The mean MERscores for the pretest and posttest (with standard deviation in paren-thesis) are 2.89 (0.47) and 3.02 (0.48) respectively. This result is con-sistent with the findings from Adams and Zhou’s study (1990, 1994).

For categorical scores, the percentage of each stage at pretest andposttest are shown in Figure 1 as well as in Table 2. As shown inFigure 1, from pretest to posttest, there is a shift of MER percentages

326

Page 12: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

from less complex stages to more complex stages. To be specific, asshown in Table 2: percentage of students at stages below 3–3 reducesfrom 36% to 24% (a decrease of 12%); percentage of students at stage3–3 increases 1% (from 46% to 47%); and percentage of students atstages above 3–3 increases 11% (from 18% to 29%).

Figure 1.Percentage of MER TPR Categorical Stages at Pretest and Posttest

When MER categorical data are used, the percentages of students whomake negative movement, no movement, and positive movement incognitive development are displayed in Table 3. Among the studentsin all the courses, 3% of them make 1/3 stage negative movement;60% do not move; and 38% of the students move upward. To be spe-cific, 26% of the students move upward within 1/3 stage, 6% of thestudents move up 1/2 stage, 3% move up 2/3 stage, 1% move up 5/6stage, and 1% move up one stage. These amounts of changes are con-sistent with previous research on classes designed to improve cogni-tive development (Widick & Simpson, 1978; Touchton, Wertheimer,Cornfeld, & Harrison, 1978).

327

Page 13: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

Table 2 Comparison of Percentage of MER TPR Categorical

Stages between Pretest and Posttest

328

Page 14: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

Table 3Amount of Stage Movement for Whole Sample

and by Social Justice Group

329

Page 15: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

Influence of Social Justice Emphasis in Course Design on Cognitive Development

In order to answer the second research question, multiple regressionis performed using MER posttest scores as the dependent variable andMER pretest scores, age, gender, class rank as well as course classifi-cation as independent variables. As shown in Table 4, only the coeffi-cients for MER Pretest Continuous Score and Social Justice Group arestatistically significant, b = 0.913, p = 0.000 and b = 0.115, p = 0.041respectively. That is, after controlling for all the other factors, studentsin the Social Justice group have significantly higher MER posttestscores than students in the Nonsocial Justice group after taking theservice-learning courses. There are no significant differences in cogni-tive development between male and female, among students with dif-ferent age or at different class ranks.

Table 4Summary of Multiple Linear Regression for Variables

Explaining MER Posttest Continuous Score

330

Page 16: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

When MER categorical data are used, the percentages of students whomake negative movement, no movement, and positive movement incognitive development in each group are displayed in Table 3.Comparison of the two groups shows that the Nonsocial Justice grouphas less positive movement from pretest to posttest than the SocialJustice group. While 29% of the students in the Nonsocial Justicegroup have positive movement, about 45% of the students in theSocial Justice group have positive movements. In addition, while 8%of the students in the Social Justice group move more than 1/2 stage,only 3% of the students in the Nonsocial Justice group do. These find-ings correspond to the results from parametric analysis of the MERcontinuous scores.

DiscussionThis study provides evidence that students’ thinking and reasoningbecome more complex after taking service-learning courses. In partic-ular, the parametric analysis of MER continuous scores show that thecognitive development level of all the students in the six courses sig-nificantly increases from pretest to posttest. The categorical data alsoshow a clear pattern of a shift from lower levels of cognitive develop-ment to higher levels of cognitive development. Among 72 students,38% of them have made positive stage changes after taking the ser-vice-learning courses. Using MER to measure cognitive developmentfor the first time in studying the outcomes of service-learning courses,this study supports the findings from previous studies (Batchelder &Root, 1994; Eyler & Gilers, 1999; Eyler, Root, & Gile, 1998; Osborne,Hammerich, & Hensley, 1998) that service-learning courses willimprove students’ cognitive development. The amount of develop-ment varies from 1/6 to 1 stage, and these amounts of developmentalchange are consistent with the results of other studies in which cours-es are deliberately designed to foster cognitive development (e.g.,Adams & Zhou, 1990, 1994; Widick, Knefelkamp, & Parker, 1975;Widick & Simpson, 1978).

This study also reveals a significant difference in cognitive develop-ment between students who are in the Social Justice group and thosewho are in the Nonsocial Justice group. The parametric analysis ofMER continuous scores show that the cognitive level changes for stu-

331

Page 17: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

dents from the Social Justice group are significantly higher than thosefrom the Nonsocial Justice group when students’ age, gender, classrank, and their cognitive levels at the beginning of the courses werecontrolled. Using categorical data analysis, comparisons of the twogroups also show that the courses in the Nonsocial Justice group haveless positive impact on students’ cognitive development than coursesin the Social Justice group do. These results not only are consistentwith Adams and Zhou’s (1990, 1994) findings about the influence ofsocial justice education on students’ cognitive development in non-service-learning courses, but also show that the combination of ser-vice-learning and social justice education appears to have greaterimpact on student cognitive development than service-learning with-out a social justice emphasis.

The positive findings from this study could be the results of using theprinciples of developmental instruction to design their courses asreported by some studies (Adams & Zhou, 1990, 1994; Widick,Knefelkamp, & Parker, 1975; Widick & Simpson, 1978). Althoughthis study does not focus on whether the instructors of these service-learning courses consciously use these principles, the qualitativeanalysis in this study do reveal that some of the principles are used inthe courses in this study. First, alternative interpretations of socialissues underlying the need for the service sites are presented and dis-cussed; and alternative ways of examining social change are covered,especially in courses with a social justice emphasis. Hence, cognitiveconflicts through diverse points of view are experienced in these class-es. Secondly, the service component in all of these classes is experien-tial; hence, both dualist and relativist students can benefit from thiskind of pedagogy. In addition, every service-learning course in thisstudy uses reflection activities and creates a personal and supportiveatmosphere for students as they attempt to learn from their experi-ences on the service sites and in class. Therefore, although the instruc-tors may not be aware of the developmental instruction criteria forclass design, there is evidence from the qualitative data that actualclass designs, especially in the courses with a social justice emphasis,meet most of the criteria for fostering cognitive development.

332

Page 18: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

ImplicationThe results of this study appear to support the proposition that ser-vice-learning courses with a social justice emphasis may have morepositive influence on student cognitive development than service-learning courses without this emphasis. Faculty members and studentaffairs educators who value both cognitive development and socialjustice may want to incorporate both sets of criteria in designingcourses or workshops. If instructors of service-learning courses andstudent affairs educators deliberately incorporate both the principlesof developmental instruction and social justice in the designs of theircourses, workshop, or retreats—on topics such as respect for diversi-ty, leadership, and social issues—then student cognitive developmentmay be fostered. Service-learning, social justice education, and devel-opmental instruction can be combined; and they appear to promotecognitive development of college students.

Limitation and Future StudyThere are limitations to this study and the interpretations of theresults. There are no control groups available in this study, that is,there are no similar nonservice-learning courses or other sections ofthe same courses without the service component available. In futurestudy, comparison/control groups are needed in order to interpretresults with confidence. In addition, only six service-learning classesat one Midwestern university are used in this study. Additional stud-ies of similar design need to be conducted at this and other universi-ties in various sections of the country before the results in this studycan be generalized to general population.

Further, social justice courses may attract students interested in socialjustice issues, and this motivation could interact with the outcome.This motivation and varying levels of engagement of students are dif-ficult to control in quasi-experimental designs. In this study, the titlesof the courses do not indicate a social justice emphasis, and studentswith social justice motivation would not know about the emphasis inthese classes from the titles. By informal reputation, however, thesocial justice emphasis may well be known. Since enrollment cannotbe controlled—and statistically control is possible only if motivationand engagement could be made explicit with questions at the begin-

333

Page 19: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

ning and the end of courses—this could be addressed by future stud-ies. At last, gender and age could interact with the outcome and arecontrolled statistically in this study. Both of these factors could be fociin future research.

ReferencesAdams, M., & Zhou, Y. (1990). Some cognitive developmental char-

acteristics of social diversity education. Paper presented at the AnnualMeeting of the American Educational Research Association (Boston,MA, April 16, 1990). ED380344.

Adams, M., & Zhou-McGovern, Y. (1994). The socialmoral devel-opment of undergraduates in a “Social Diversity” course: Developmentaltheory, research and instructional applications. Paper presented at theAnnual Meeting of the American Educational Research Association(New Orleans, LA, April 4-8, 1994). ED380345.

Batchelder, T. H., & Root, S. (1994). Effects of an undergraduateprogram to integrate academic learning and service: Cognitive, proso-cial cognitive, and identity outcomes. Journal of Adolescence, 17,341–355.

Baxter Magolda, M. B., & Porterfield, W. D. (1985). A newapproach to assess intellectual development on the Perry scheme.Journal of College Student Personnel, 26, 343–351.

Baxter Magolda, M. B., & Porterfield, W. D. (1988). AssessingIntellectual Development: The Link between theory and Practice.Alexandria, VA: American College Personnel Association.

Bringle, R. G., & Kremer, J. F. (1993). Evaluation of an intergen-erational service-learning project for undergraduates. EducationalGerontology, 19 (5), 407–16.

Broughton, J. M. (1975). The development of natural epistemology inadolescence and early childhood. Unpublished doctoral dissertation,Harvard University.

Cohen, J., & Kinsey, D. (1994). ‘Doing good’ and scholoarship: Aservice-learning study. Journalism Education, 48 (4), 4–14.

Cram, S. B. (1998). The impact of service learning on moral develop-ment and self-esteem of community college ethics students. UnpublishedDissertation, University of Iowa.

334

Page 20: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

Deans, T. (1999). Service-learning in two keys: Paulo Freire’s crit-ical pedagogy in relation to John Dewey’s pragmatism. MichiganJournal of Community Service Learning, 6, 15–29.

Delve, C. I., Mintz, S. D., & Stewart, G. M. (1990). Promoting val-ues development through community service: A design. In C. I. Delve,S. D. Mintz, & G. M. Stewart (Eds.) Community service as values edu-cation. New Directions for Students Services, (no. 50, pp. 7–29). SanFrancisco: Jessey-Bass.

Eyler, J. S. (2000). What Do We Most Need to Know About theImpact of Service-Learning on Student Learning? Michigan Journal ofCommunity Service Learning, Special Issues, 11–18.

Eyler, J. S., & Giles, D. E., Jr. (1999). Where is the learning in ser-vice-learning? San Francisco, CA: Jossey-Bass.

Eyler, J. S., Giles, D. E., Jr., & Braxton, J. (1997). The impact ofservice-learning on college students. Michigan Journal of CommunityService Learning, 4, 5–15.

Eyler, J. S., Root, S., & Giles, D. E., Jr. (1998). Service-learningand the development of expert citizens: Service-learning and cognitivescience. In R.G. Bringle. & D. K. Duffy (Eds.), With service in mind:Concepts and Models for Service-learning in psychology, (pp. 85–100).Washington DC: American Association for Higher Education.

Issac, S., & Michael, W. B. (1995). Handbook in Research andEvaluation: For Education and the Behavioral Sciences (3rd ed.). SanDiego, CA: Educational and Industrial Testing Services (EdITS).

Johnson, S. D., & Bozeman, M. (1998). Service learning and thedevelopment of social responsibility. Paper presented at the AnnualConvention of the Central States Communication Association,Chicago, IL.

Kahne, J., & Westheimer, J. (1999). In the service of what? Thepolitics of service learning. In Claus, J. & Ogden, D. (Eds.), Service-learning for youth empowerment and social change (pp. 25–42). NewYork: Perter Lang.

Kendrick, J. R. (1996). Outcomes of service-learning in anIntroduction in Sociology Course. Michigan Journal of CommunityService Learning, 3, 72–81.

King, P. M. (1982). Perry’s scheme and the Reflective Judgment Model:First cousins once removed. The paper presented at the annual confer-ence of the Association for Moral Education.

335

Page 21: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

King, P. M., & Kitchener, K. S. (1994). Developing reflective judg-ment: Understanding and promoting intellectual growth and critical think-ing in adolescents and adults. San Francisco: Jossey-Bass.

Leeds, J. (1999). Rationales for service-learning: A critical exami-nation. Michigan Journal of Community Service Learning, 6. 112–122.

Markus, G. B, Howard, J. P. F., & King, D. C. (1993). Integratingcommunity service and classroom instruction enhances learning:Results from an experiment. Educational Evaluation and Policy Analysis,15 (4), 410–419.

Miller, J. (1994). Linking traditional and service-learning courses:Outcome evaluation utilizing two pedagogically distinct models.Michigan Journal of Community Service Learning, 1, 29–36.

Myers-Lipton, S. J. (1998). Effect of a comprehensive service-learning program on collegestudents’ civic responsibility. TeachingSociology, 26, 243–258.

Neter, J., Kutner, M. H., Nachtsheim, C. J., and Wasserman, W.(1996). Applied Linear Statistical Models (4th ed.). Chicago, IL: Irwin.

O’Grady, C. R. (2000). Integrating service leaning and multicul-tural education: An overview. In O’Grady, C. R. (Ed.), Integrating ser-vice-learning and multicultural education in colleges and universities (pp.1–21). Mahwah, NJ: Lawrence Erlbaum Associates.

Osborne, R. E., Hammerich, S., & Hensley, C. (1998). Studenteffects of service-learning: Tracking change across a semester. MichiganJournal of Community Service Learning, 5, 5–13.

Payne, C. A. (2000). Changes in involvement as measured by theCommunity Service Involvement Preference Inventory. MichiganJournal of Community Service Learning, 7, 41–46.

Perry, W. G. (1970, 1999). Forms of intellectual and ethical develop-ment in the college year: A scheme. San Francisco: Jossey-Bass.

Reardon, K. M. (1994). Undergraduate research in distressedurban communities: An undervalued from of service-learning.Michigan Journal of Community Service Learning, 1, 44–54.

Rhodes, C. (1999). Psychological changes in student development ofcollege sophomore women along Chickering’s seven vectors with service-learning as an institutional effect. Unpublished Dissertation, PeabodyCollege, Vanderbilt University, Nashville, TN.

Rodgers, R. F. (1980). Theories underlying student development.In D. G. Creamer (Ed.), Student development in higher education:Theories, practices, and future directions (pp. 10–96). Cincinnati, OH:American College Personnel Association.

336

Page 22: Impact of Service-Learning and Social Justice Education on ......tice emphasis were included and comparison was made between the two groups of students. Service-Learning and Social

NASPA Journal, 2006, Vol. 43, no. 2

Rodgers, R. F. (1989). Student development. In U. Delworth & G.R. Hanson (Eds.), Student services: A handbook for the profession (2nd

ed., pp. 117–164). San Francisco: Jossey-Bass.Seigel, S., & Rockwood V. (1993). Democratic education, student

empowerment, and community service: Theory and practice. Equityand Excellence in Education, 26 (2), 65–70.

Shastri, A. (1999). Investigating content knowledge gains in academicservice-learning: A quasi-experimental study in an educational psychologycourse. Paper presented at the Annual Meeting of the AmericanEducational Research Association, Montreal, PQ Canada.

Sleeter, C. (1996). Multicultural education as social activism. NewYork: State University of New York Press.

Strage, A. (2000). Service-learning: Enhancing student learningoutcomes in a college level lecture course. Michigan Journal ofCommunity Service Learning, 7, 5–13.

Touchton, J. G., Wertheimer, L. C., Cornfeld, J. L., & Harrison, K.H. (1978). Career planning and decision making: A developmentalapproach to the classroom. In C. Parker (Ed.), Encouraging developmentin college students (pp. 151–165). Minneapolis, MN: University ofMinnesota Press.

Wang, Y. (2003). Social responsibility and intellectual development asoutcomes of service-learning courses. Unpublished Dissertation, OhioState University, Columbus.

Widick, C., Knefelkamp, L. L., & Parker, C. A. (1975). The coun-selor as a developmental instructor. Counselor Education andSupervision, 14, 286-296.

Widick, C., & Simpson, D. (1978). Developmental concepts incollege instruction. In C. Parker (Ed.), Encouraging development in col-lege students (pp. 27-59). Minneapolis, MN: University of MinnesotaPress.

337