That’s Not the Way It Is: How User-Generated Comments on the News Affect Perceived Media Bias
A popular aspect of online journalism is the ability of users to quickly comment on news stories and posts. Depending on a site’s degree of moderation, such content can be an insightful exchange of opinions — or highly partisan rants, often about supposed media bias. News organizations are grappling with ways to curtail online incivility yet keep dialogue open. Research suggests that such forums can serve as a proxy for public opinion. Could they also influence how readers perceive journalistic content?
A 2012 study published in The Journal of Computer-Mediated Communication, “That’s Not the Way It Is: How User-Generated Comments on the News Affect Perceived Media Bias,” investigated the extent to which user-generated comments on Internet news articles shaped readers perceptions. In the study, 214 participants read a neutral article on corporal punishment in elementary schools with comments that either supported or challenged the article. Afterward, the participants were tested for their perceptions of the article’s neutrality, public opinion on the issue and the comments attached to the article.
Key study findings include:
- Given the way certain kinds of readers process news information, some cannot properly distinguish where information came from; the data suggest that “people might misattribute the opinions expressed in others’ comments to the news article.” Reader comments can, in effect, filter news: “[U]ser-generated comments accompanying news stories significantly altered the participants’ beliefs about what other members of the society think…. By changing the participants’ beliefs about the amount of public support, users’ comments exerted indirect effects on their evaluation of the news….”
- Individuals who were invested in a topic and primed with comments supportive of their position were less likely to perceive hostile media bias in the article’s content than those who also read supportive comments but were less personally invested.
- Opinions of participants who were less involved in an issue were not significantly affected by critical comments on media coverage. “Although they, too, inferred public opinion from users’ comments, they did not seem to consider it relevant when judging news bias.”
- “All readers got a sense of what public opinion was on the basis of what the user-generated comments said, but when readers who considered the news topic to be more important to them inferred from the comments that public opinion was on their side, they saw significantly less bias in the news story.”
- “Exposure to other readers’ comments concordant with one’s own position led to perceptions of more congenial public opinion … and the more congenial participants thought that public policy opinion was, the less hostile their perceptions of the news story was.”
Readers invested in an issue and fearful that their position is “losing ground” in the press are more likely to perceive hostile media bias, the researcher suggested. Comments that matched participants’ opinions on the issue reduced impressions of bias, while those that didn’t increased it. Invested readers may also read comments more carefully and process content differently than those less familiar with a topic.
A 2013 study also published in The Journal of Computer-Mediated Communication, “Crude Comments and Concern: Online Incivility’s Effect on Risk Perceptions of Emerging Technologies,” features similar findings. As the authors note in a New York Times editorial based on the study, “Uncivil comments not only polarized readers, but they often changed a participant’s interpretation of the news story itself.”
Tags: cognition, technology
Read the issue-related Scientific American article titled "Eye Contact Quells Online Hostility."
- What key insights from the news article and the study in this lesson should reporters be aware of as they cover these issues?
Read the full study titled "That’s Not the Way It Is: How User-Generated Comments on the News Affect Perceived Media Bias."
- What are the study's key technical term(s)? Which ones need to be put into language a lay audience can understand?
- Do the study’s authors put the research into context and show how they are advancing the state of knowledge about the subject? If so, what did the previous research indicate?
- What is the study’s research method? If there are statistical results, how did the scholars arrive at them?
- Evaluate the study's limitations. (For example, are there weaknesses in the study's data or research design?)
- How could the findings be misreported or misinterpreted by a reporter? In other words, what are the difficulties in conveying the data accurately? Give an example of a faulty headline or story lead.
Newswriting and digital reporting assignments
- Write a lead, headline or nut graph based on the study.
- Spend 60 minutes exploring the issue by accessing sources of information other than the study. Write a lead (or headline or nut graph) based on the study but informed by the new information. Does the new information significantly change what one would write based on the study alone?
- Compose two Twitter messages of 140 characters or fewer accurately conveying the study’s findings to a general audience. Make sure to use appropriate hashtags.
- Choose several key quotations from the study and show how they would be set up and used in a brief blog post.
- Map out the structure for a 60-second video segment about the study. What combination of study findings and visual aids could be used?
- Find pictures and graphics that might run with a story about the study. If appropriate, also find two related videos to embed in an online posting. Be sure to evaluate the credibility and appropriateness of any materials you would aggregate and repurpose.
Class discussion questions
- What is the study’s most important finding?
- Would members of the public intuitively understand the study’s findings? If not, what would be the most effective way to relate them?
- What kinds of knowledgeable sources you would interview to report the study in context?
- How could the study be “localized” and shown to have community implications?
- How might the study be explained through the stories of representative individuals? What kinds of people might a reporter feature to make such a story about the study come alive?
- What sorts of stories might be generated out of secondary information or ideas discussed in the study?