View source for Research:Patrolling on Wikipedia

{{Tracked|T228817}}
{{Research_project
<!-- When was the project page created? Do not edit this section, it will be autogenerated-->
 | created = 23:59, 23 July 2019 (UTC)
 
<!-- Who should be contacted about this project? e.g. {{Investigator|Aaron Halfaker|Wikimedia Foundation}} You can link to your username if you have one:  {{Investigator|[[User:EpochFail|Aaron Halfaker]]|Wikimedia Foundation}}-->
 | contact = {{Investigator|[[User:Jmorgan (WMF)|Jonathan Morgan]]|Wikimedia Foundation}}
 
<!-- Who else is working on the project? You can add as many {{Investigator}} entries as needed -->
 | collaborators = 
 
<!-- What year/month did work start? ... or when will it start? -->
 | start_year = 2019
 | start_month = August
 
<!-- What year/month did work end? ... or when will it end? -->
 | end_year = 2019
 | end_month = September
 
<!-- Project status: draft -> proposed -> planned -> active -> completed -->
 | status = completed
 
}} <!-- End of Research project template -->

[[File:Patrolling on Wikipedia September 2019 research showcase slides.pdf|thumb|Slides for the [[mw:Wikimedia_Research/Showcase#September_2019|September 2019 Wikimedia Research Showcase]] presentation. There's also a [https://www.youtube.com/watch?v=fDhAnHrkBks?t=1973 videorecording].]]
Editors [[En:Wikipedia:Patrolling|patrol]] recent pages and edits to ensure that Wikimedia projects maintain high quality as new content comes in. Patrollers revert vandalism and review newly-created articles and article drafts. Patrolling of new pages and edits is vital work. In addition to making sure that new content conforms to Wikipedia project policies, patrollers are the first line of defense against [[En:Disinformation|disinformation]], copyright infringement, libel and slander, personal threats, and other forms of vandalism on Wikimedia projects.

* '''[https://www.youtube.com/watch?v=fDhAnHrkBks?t=1973 Watch the presentation] (start at 32:57)'''
* '''[[:File:Patrolling_on_Wikipedia_September_2019_research_showcase_slides.pdf|Review the slides]]'''
* '''[[Research:Patrolling_on_Wikipedia/Report|Read the report]]'''

== Research goals ==
This research project is focused on understanding the needs, priorities, and workflows of editors who patrol new content on Wikimedia projects. The findings of this research can inform the development of better patrolling tools as well as non-technological interventions intended to support patrollers and the activity of patrolling.

The goals of the project are:  

# Understand the general workflows of editors who engage extensively in patrolling (at the edit/revision level and the article level; in official or unofficial capacities; at a high and low levels of activity) on different languages of Wikipedia and on non-Wikipedia projects such as WikiData and Wikimedia Commons.
# Understand the tools and techniques that these editors use in their work
# Understand the social and technical structures of the MediaWiki platform (e.g. anti-vandalism wikiprojects, Special:RecentChanges, special user-rights, Huggle) that support patrolling activities.
# Identify limitations of current patrolling tools techniques, and structures that may create [[En:Threat model|vulnerabilities]] to misinformation, disinformation and other forms of individual or coordinated vandalism in multiple languages of Wikipedia. 

<br />

== Methods ==
This research will be conducted in several stages, with each stage building upon the findings from the previous one. 

=== Stage 1: [[Research:Patrolling on Wikipedia/Literature|Literature review]]===
''Status: completed''
In this stage, we will analyze the existing research literature on the activity of patrolling, including but not limited to patroller experiences, workflows, use of supporting tools, and the impacts of patrolling. This research will be used to inform the development of interview protocols and (potentially) survey questions in later research stages.

=== Stage 2: Patroller [[Research:Patrolling on Wikipedia/Interviews|interviews]] and surveys ===
''Status: completed''
;Goal: ''In this stage, we will interview individuals who are engaged in patrolling activities such as new page patrol and recent changes patrol. We may also interview individuals who use assistive tools such as [[Huggle]] and Twinkle to perform edit review activities (whether or not they consider their activities to be "patrolling").''

For this research, we interviewed 4 people who had been involved in patrolling activities on different Wikimedia projects. Participants were recruited through purposeful sampling, with the aim of selecting a set of interviewees who represented diversity in terms of their patrolling role and focus, and the size of the Wikimedia project(s) they work on.   

<div class="toccolours mw-collapsible mw-collapsed">
Interview participant information '''(click to expand)''' 
<div class="mw-collapsible-content">

{| class="wikitable"
| align="center" style="background:#f0f0f0;" |'''Participant'''|| align="center" style="background:#f0f0f0;" |'''Primary projects'''
|-
| p1||Dutch Wikipedia, English Wikipedia, Wikimedia Commons
|-
| p2||Greek Wikipedia, English Wikipedia, WikiData
|-
| p3||English Wikipedia
|-
| p4||Italian Wikipedia, Wikimedia Commons, WikiSource
|}
</div>
</div>


=== Stage 3: Cross-wiki analysis ===
''Status: proposed''

=== Timeline ===

;August 6 - 9
* Conduct literature review (including a review of previous research conducted by the PI, e.g. [[Mw:Flow/Community process workflow interviews (June 2015)|Flow workflow interviews]]) and write up key findings.
* Use key findings to draft interview protocol. 
* Elicit suggestions from Community Liaisons for interview candidates (English speakers, not En-Wiki based)
* Submit interview protocol for Legal review and work with Legal to draft consent form.

''Collaborators:'' WMF Community Liaisons; WMF Legal

''Deliverables:'' Literature review summary (wiki page); draft interview protocol (wiki page); list of interview candidates (spreadsheet)

;August 12 - 23

* finalize interview protocol based on Legal input
*send out invitations to interviewees (Target: 3 interviews)
* conduct interviews
* loosely transcribe interview data (doesn't need to be word for word)
* summarize key points

''Collaborators:'' WMF Legal

''Deliverables:'' Final interview protocol (wiki page); Interview recordings (audio and/or video files); interview transcripts (Google doc); consolidated interview notes (Google doc)

;August 26 - 30

* complete data analysis, publish findings, recommendations, and suggest next steps

''Collaborators:'' n/a

''Deliverables:'' Report of findings, recommendations, and implications (wiki page)

;September 2019-?:''(TBD)'' Potentially: surveys, additional interviews (e.g. with new article and article draft patrollers), quantitative cross-wiki comparative analysis, development of machine learning models to identify threats and aid patrolling

=== Policy, Ethics and Human Subjects Research ===
Interviews and surveys will be conducted according to the Wikimedia Foundation's policies for informed consent. All non-public data gathered during this research (including interview recordings and notes) will be shared and stored in accordance with the Wikimedia Foundation's [[data retention guidelines]]. 

== Results==
{{Main|Research:Patrolling_on_Wikipedia/Report}}

== See also ==
* [[mw:Flow/Community_process_workflow_interviews_(June_2015)|Community_process_workflow_interviews_(June_2015)]]
* [[Research:Autoconfirmed_article_creation_trial]]
* [[Research:New_Page_Patrol_survey/WMF_report]]
* [[Research:Vandal_fighter_work_load]]
* [[Research:Patroller_work_load]]
* [[Research:Wikipedia_Workflows/Article]]
* [[Research:Codex/Roles_of_contributors]]

=== Subpages ===
{{List subpages}}

== References ==
<references />
[[Category:Wikipedia]]
[[Category:Patrolling]]