Victoire Rio
The Role of Social Media in Fomenting Violence: Myanmar
guistic
contextual considerations and negatively impacting on freedom of expression.
15
or
Insufficient investment into human moderation
Not only did Facebook have minimal capacity for automated detection in Burmese language, it also failed to adequately invest in human moderators. According to Reuters, Facebook hired its first moderator for Burmese language content in 2013, a year after concerns over misuse of the platform first made it into the US media. The company then
scaled its moderation effort from two to four Burmese content moderators in 2015 to cope
with the heightened risks associated with the historic elections taking place that year. Despite the rise in real world violence following the October 2016 and August 2017 attacks
in Rakhine state, the company had only “dozens” of reviewers moderating Burmese content by the time Mark Zuckerberg was called to testify in front of the US congress in April
2018. Judging by the company’s recruitment ads at the time, it is also unclear how much
linguistic and contextual understanding these reviewers had. The position of Myanmar
Market Specialist, for example, had Burmese language skills listed as an ‘ideal’ rather than
an ‘essential’ requirement.
Meanwhile, outsourced reviewer jobs with companies like CPL, one of Facebook’s contractors at the time, required applicants to be legally authorised to work in Ireland, which
severely restricted the pool of candidates and introduced a clear bias towards members of
the Myanmar diaspora, who had often left Myanmar while the country was still a military
regime and before Facebook became widely available and used.
Lack of effective emergency mechanism
With Facebook lacking the capacity to self-moderate its platform, it relied extensively on
escalations from third parties to address dangerous content and emergencies. In the
absence of a formal escalation mechanism, however, these escalations had to be channeled
via email or messaging apps to policy staff, who lacked language and context, were not
empowered to take action, and worked outside of Myanmar working hours. As a result,
emergencies, even when flagged, were often not addressed quickly enough to mitigate
their impact.
Focus on individual content appeals and PR campaigns rather than structural
enforcement solutions
Working through the policy team also presented major limitations as policy staff were
neither trained nor empowered to identify and address systemic flaws with the product
and its inner workings. As a result, most of Facebook’s response to the deteriorating situation in Myanmar focused on developing, or commissioning, communication materials and
on
addressing case by case appeals. These solutions placed the bulk of the responsibility on
Myanmar users and civil society and did little to address the root causes of the problem,
which lay in the systematic abuse and weaponisation of the platform by coordinated actors.