Grant Program
Research
Grantee Name
Data & Society Research Institute
Grant Start Date
1 December 2021
Grant End Date
31 May 2023
Amount Funded
US$200,000
Country
Not Country-Specific
Region
Global
Research Question
- What role is verification playing for platforms seeking to distinguish between “trustworthy” or “untrustworthy” sources? What types of evidence are platforms requesting from users as they verify their identities, their property, or their content? How might this evidence unintentionally privilege or disadvantage certain groups who are requesting verification?
- How do users—across professions, and across demographics—experience the process of becoming verified? What are the challenges and frustrations they may experience and encounter as they work to get verified? How can platforms work with these groups and individuals to both take advantage of verification as a tool, but also ensure they are not building in new (and existing) biases into how they verify users?
Why Is This Research Important?
This research is deemed important because verification is increasingly viewed by platforms as a primary solution to the broader issue of online trustworthiness and credibility, often narrowly focused through the lens of misinformation and disinformation. Verification is used in various ways: sometimes to highlight credible and authoritative information, as seen with Twitter (Now X) during the early stages of the COVID-19 pandemic, to signal trustworthy sources, or on platforms like Pornhub to feature content from approved sources. In other instances, verification functions more as an external badge for users navigating the Internet, aligning with a Silicon Valley tendency to place responsibility for content evaluation on individual users. In both these applications, verification represents a significant shift in content management from focusing solely on the content itself to emphasizing the source of the information.
This project addressed a novel research area, as there is very little research available on platform verification, its potential to create or reinforce biases, and its future within Internet and platform governance. The potential impacts of this move towards a “verified Internet,” whether beneficial or harmful, are not yet clear. The importance of this research is underscored by real-world issues and advocacy, such as Pornhub performers advocating for verification to combat piracy, journalism groups like “The Trust Project” urging platforms to recognize the distinct operations of news media, and housing activists raising concerns about platforms like Airbnb being used by professional management companies posing as individuals.
Methodology
The methodology for this project adopted a multi-perspective approach to understand the current and future role of verification in platform governance. It incorporated two distinct approaches focusing on two main subjects: Platform companies and their policies, and Users seeking verification status.
The first part of the research focused on Platform Companies and Verification Policies. This phase examined the features and characteristics of platform verification programs and processes. It involved conducting anonymous, 60-minute interviews with 15-20 Trust and Safety professionals who were involved in these processes. The research also analyzed publicly available documents, including corporate blog posts, SEC filings, and trade publications, that discussed changes to verification policies. These documents provided significant insight into how platforms construct the evidence base for verification, detailing the information required from users for consideration.
The second part of the research focused on Users Seeking Verification. This phase followed users, including individuals and those affiliated with institutions like media, universities, or nonprofits, as they attempted to get verification on one or more platforms. The specific platforms studied in this phase were determined by the access gained in the first phase. The project conducted interviews with 30-40 users about their experiences navigating the verification process. Recruitment utilized various channels, including social media, Craigslist, academic email listservs (like AoIR), and listservs for media professionals and journalism schools. The recruitment strategy was specifically designed to reach a diverse group of users, considering factors such as race, gender, and ethnicity, as well as different professional affiliations (individual users versus those associated with established organizations).
Media and Publications
- Networked Governance Highlights the ways that platforms form relationships with external stakeholders strategically, as a way to receive feedback for policy decisions, as well as gain legitimacy within external stakeholder groups and within the public-at-large.
- Networked Platform Governance: The Construction of the Democratic Platform This article explores the ways that platform companies are trying to distribute the responsibility for content policy making to external stakeholders in response to concerns about their unilateral control and proposes that platforms are deploying a brokered form of network governance that presents opportunities for platform governance but also new concerns for accountability.
- Verified-as-Canadian Content? Bill C-11 and the Platform Infrastructure of the Verified Badge System The piece explores how the verified badge and the system in place at platforms to approve individuals and organizations as ‘official’ or ‘verified’ with these signals in UX design could be used to overcome many of the limitations of prioritizing Canadian content through algorithms, as they have been expressed by platforms like YouTube.
- A Working History of the Verified Internet Part one: Studying a moving target Introduction to the following releases of the work.
- A Working History of the Verified Internet Part two: The battle between Friendsters and Fakesters
- A Working History of the Verified Internet Part Three: The Celebrity Wars Examines what happened as more traditional celebrities and media companies merged onto social media platforms.
