MEDIA WATCH
  • Year: 2021
  • Volume: 12
  • Issue: 2

Testing ‘Crowdcoding’ methods in sub-saharan african settings: Using the 2020 tanzanian elections to test its validity and reliability

1Department of Journalism, University of Colorado-Boulder, USA

2Candidate of Computer Science, University of Colorado-Boulder, USA

*Correspondence to: Gregory Gondwe, College of Media, Communication, and Information (CMCI), Department of Journalism, University of Colorado Boulder, 1511 University Avenue, USA

Gregory Gondwe is an affiliate of the Department of Journalism at the University of Colorado-Boulder, USA where he teaches media-related courses. His research explores the concepts of persuasive messages and their effects on the news. He examines how individuals and groups choose to assimilate and accept news content as either true or false with a particular interest in Sub-Saharan Africa. His current research explores the Chinese news agenda in African media systems.

Abstract

This study replicates existing research on crowdcoding, and content analysis approaches to test the validity and reliability of content analysis methods in the African setting. We use data from the 2020 Tanzanian presidential elections as a case study. Instead of MTurk for crowdsourcing, the study utilized WhatsApp groups and university students from Tanzania to code the data. Using a collected and controlled sample of 400 tweets to represent Tanzania's ruling and opposition parties, respectively, our overall findings suggested that crowdcoding produced more reliable data than qualitative content analysis (QCA). However, further analysis suggests that although Crowdcoding recorded higher agreement on validity scores, trained coders seemed to provide more reliability accuracy scores. Besides, data indicates that the traditional training of the coders was statistically insignificant in providing accurate validity and reliability scores for QCA.

Keywords

Crowdcoding, Crowdsourcing, Sentiment analysis, Content analysis, Tanzania, Sub-Saharan Africa