Download - Scientists as communicators: A randomized experiment to ... · Scientists as communicators: A randomized experiment to assess public reactions to scientists’ social media communication

Transcript
Page 1: Scientists as communicators: A randomized experiment to ... · Scientists as communicators: A randomized experiment to assess public reactions to scientists’ social media communication

Scientists as communicators: A randomized experiment to assess public reactions to scientists’ social media communication along the science-advocacy continuum

INTRODUCTION The question of what roles, if any, scientists should play in the dialogue about public policy is a perennial point of discussion in the scientific community. It is often assumed that policy advo-cacy – showing support for one policy approach over another – is likely to compromise the per-ceived credibility of the individual scientist engaged in such behavior, and may also harm the credibility of the scientific community more broadly (Nelson & Vucetich, 2009). Donner (2014) argues that a binary view of advocacy – where statements are either objective or advocacy – is too simplistic, and proposes that public communication by scientists should instead be thought of as falling along a continuum in terms of its “level of advocacy” based upon the extent of nor-mative judgment implicit in a statement. He predicts that as the extent of normative judgment increases, it poses a relatively greater risk to a scientist’s perceived credibility. Research suggests that scientists are judged as more credible and trustworthy to the extent that they are seen as being unbiased and having positive intentions (Eagly, Chaiken, & Wood, 1981; Fiske & Dupree, 2014). Relevant to the debate about advocacy, we examine perceptions that the scientist’s statements are attributable to their evaluation of scientific evidence and/or their polit-ical views. We also examine the extent to which their statement is perceived as intended to per-suade the public to take action or intended to provide impartial information. Such attributions may be associated with differences in the perceived credibility of scientists that engage in differ-ent levels of advocacy or with differences in the perception of the trustworthiness of the broad-er community of scientists as well as public support for funding research.

Finally we also examine the role of political ideology in shaping audience responses to scien-tists’ statements. In the United States, attitudes about climate change are polarized along parti-san and ideological lines with Liberals tending to be more accepting of the existence of climate change and supportive of societal action compared to Conservatives, and political identification has been found to condition information processing of messages about climate change (Gromet, Kunreuther, & Larrick, 2013; Hart & Nisbet, 2012; McCright & Dunlap, 2011).

RESULTSA three-way MANOVA examining the influence of level of advocacy, type of scientist, and politi-cal ideology (liberal, moderate, or conservative) on our DVs was conducted to answer our re-search questions. Multivariate tests found a significant main effect of level of advocacy F(20, 4748)=10.38, p<.001, Pillai’s Trace=.168, partial η2 = .042, and a significant main effect of ideology F(10, 2370)=4.90, p<.001, Pillai’s Trace=.041, partial η2 = .020. There was no significant main effect of type of scientist F(5, 1184)=1.12, p=.346, Pillai’s Trace=.005, partial η2 = .005. There were no significant two-way or three-way interactions among the independent variables. Post-hoc main comparisons for each of the DVs were conducted using Tukey’s HSD to correct for family-wise er-ror rates.

RQ1: Will statements containing progressively higher levels of advocacy be associated with dif-ferent evaluations of the scientist in terms of the extent to which their statement is:

a) more attributed to their political viewsThe control condition is less attributed to the scientist’s political views than all other conditions ex-cept for Risks & Impacts (p<.01, see Figure 1). The Risks & Impacts statement is also less attributed to politics than the Specific Action statement (p<.05).

b) less attributed to their evaluation of scientific evidenceThe Specific Action statement is less attributed to science than all other conditions except for Policy Options & Consequences (p<.01, see Figure 1). We also found that the control condition is more highly attributed to science than the Policy Options & Consequences statement (p<.01).

c) viewed as more intended to persuade the public to take action to address climate changeThe Non-specific and Specific Action statements were seen as more intended to persuade relative to all other levels of advocacy (p<.01, see Figure 2).

d) less intended to provide impartial information about climate changeThe Non-specific and Specific action statements were seen as less intended to inform relative to the control and Risks & Benefits conditions (p<.05, see Figure 2). Furthermore, the control condi-tion was seen as more intended to inform than all other levels of advocacy (p<.05).

DISCUSSIONThe results presented here appear to challenge widely held assumptions about some of the risks associated with scientists engaging in policy advocacy. Contrary to conventional wisdom, our study suggests there is not a linear association between a scientist’s level of advocacy and their perceived credibility. Although we found that when a scientist endorsed a specific policy to address climate change their credibility was relatively lower, in absolute terms, their perceived credibility was still above the midpoint on the scale. Furthermore, we found that ad-vocating for a non-specific action was not associated with a decrease in credibility.

There also does not appear to be a simple trade-off between persuasive and informative in-tentions, and political and scientific attributions. Across conditions, most levels of advocacy were seen as concurrently intended to persuade and inform, and attributable to both scien-tific and political motivations. For the issue of climate change, it appears that statements ad-vocating action without endorsing specific policies are seen as particularly motivated by science and intended to persuade the public to take action. Although Conservatives evaluated the sci-entist more critically than Moderates and Liberals, this difference was independent of the level of advocacy.

Importantly, we did not observe negative spillover effects of the individual scientist’s advo-cacy on attitudes toward the broader scientific enterprise. Both the perceived trustworthiness of the scientific community they were intended to represent as well as support for funding cli-mate change research were unaffected by the level of advocacy. While the results presented here may give some scientists more confidence that their public statements about climate poli-cy carry less professional risk than previously thought, we urge caution in over interpreting the external validity of our results. More research is needed to examine policy advocacy in addi-tional communication contexts beyond single, brief posts on social media to include other for-mats such as newspaper articles, op-eds, and video interviews.

e) result in lower perceived credibility of the scientist?The Specific Action statement was viewed as less credible than all other conditions except Poli-cy Options & Consequences (p<.05, see Figure 3).

RQ2: Will there be a spillover effect such that high levels of advocacy will be associated with a) lower levels of general trust toward climate scientists & television weathercasters more broadly, and b) lower levels of support for funding research to study climate change?

No significant main effects of level of advocacy were observed on general trust toward climate scientists, F(4, 602)=.410, p=.802; nor on general trust toward television weathercasters F(4, 581)=.247, p=.969. Lastly, there was no main effect of level of advocacy on support for funding research to study climate change, F(4, 1185)=1.93, p=.103.

RQ3: Will the effects of level of advocacy in RQ1 and RQ2 be conditioned by the respondent’s political ideology?

Political ideology was coded and modeled as three categories: Liberal, Moderate, and Conser-vative. There were no significant differences between Liberals and Moderates across all of the DVs. However, Conservatives were less likely to attribute the expert’s statement to an evalua-tion of the science compared to both Liberals and Moderates, regardless of level of advocacy (p<.001). Conservatives were also more likely to attribute the statement to the scientist’s politi-cal views than Liberals and Moderates (p<.05). Conservatives were less likely to see the state-ments as intended to inform compared to Liberals and Moderates (p<.01). However, there were no significant differences across political ideology with regard to the perception that the statements were intended to persuade people to take action. Finally, Conservatives also viewed the scientist as less credible relative to Liberals and Moderates (p<.001). There were no interac-tions between level of advocacy and ideology.

John Kotcher ([email protected]), Emily Vraga, Teresa Myers, Neil Stenhouse, Connie Roser-Renouf, and Edward MaibachDepartment of Communication, George Mason University

METHODParticipants

• Online survey experiment in Qualtrics • Data collected July 30-August 5, 2014• Quota Sample from Survey Sampling International to match U.S. demographics• (n=1235) ~100 participants per condition

Procedure• 5 (level of advocacy) x 2 (type of scientist) factorial design• Randomly assigned to read one fictional Facebook post then answered questions

Levels of Advocacy1. Control

• Mentions 400ppm CO2 milestone, no discussion of risks2. Risks & Impacts

• Describes public health risks of climate change3. Policy Options & Consequences

• Discusses pros & cons of two mitigation policies (see specific action below)4. Non-specific Action

• Urges action to address climate change w/o specific policy mentioned 5. Specific Action (2 conditions collapsed for analysis)

• Liberal congruent policy – Endorses limits on CO2 at coal plants• Conservative congruent policy –Endorses more nuclear plants

Dependent MeasuresAttribution to political views

• Dr. Wilson’s statement was shaped by his political views about climate change. • (1=Strongly disagree, 7=Strongly agree.)

Attribution to scientific evidence• Dr. Wilson’s statement was shaped by his evaluation of the scientific evidence about cli-mate change. • (1=Strongly disagree, 7=Strongly agree.)

Perceived goal to persuade• The goal of the Facebook post was to persuade people to take action to address climate change. • (1=Strongly disagree, 7=Strongly agree.)

Perceived goal to inform• The goal of the Facebook post was to provide impartial information about climate change• (1=Strongly disagree, 7=Strongly agree.)

Perceived credibility• Adapted from McCroskey & Teven (1999); • Mean of 9 semantic differential items (α=.91; Min=1, Max=7)• Example: Not at all trustworthy—Extremely trustworthy