Jump to content

Wikipedia:Edit filter: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
m removing {{pp-semi-indef}} as page is not edit-protected
link pruning
(40 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{redirect|WP:AF|Article Feedback|Wikipedia:Article Feedback Tool|the April Fools' Day prank history|Wikipedia:April Fools}}
{{Guideline}}
{{Guideline}}
{{Edit filter navigation}}
{{Edit filter navigation}}
<noinclude>{{pp-move-indef}}</noinclude>
<noinclude>{{pp-move-indef}}</noinclude>
[[File:Wikipedia-Crystal_clear-advancedsetting.png|thumb|{{center|The edit filter manager logo}}]]
[[File:Wikipedia-Crystal_clear-advancedsetting.png|thumb|{{center|The edit filter manager logo}}]]
{{Shortcut|WP:EF|WP:AF|WP:FILTER|WP:FLTR}}
{{Shortcut|WP:EF|WP:AF|WP:FILTER}}


The '''[[Special:AbuseFilter|Edit filter]]''' is a tool that allows users in the {{ttt|[[Wikipedia:User access levels#Edit Filter managers|edit filter manager]]}} group to set controls to address common patterns of harmful editing.<ref name="harmlessactions">Filters have been used to track or tag non-harmful edits. For example, the Foundation implemented a log-only [[Special:AbuseFilter/423|filter]], before the [[m:Statistics|Analytics]] team existed, as a simple way to track usage of [[mw:Extension:WikiLove|WikiLove]].</ref> It automatically compares every edit made to Wikipedia against sets of conditions defined in user-created filters. If an edit matches the conditions of a filter, that filter will log the edit. It may also tag the edit summary, warn the editor, and/or disallow the edit entirely.
The '''[[Special:AbuseFilter|Edit filter]]''' is a tool that allows trusted editors in the ''edit filter manager'' group to
set controls mainly<ref name="goodedits">Edit filters can and have been used to track or tag certain non-harmful edits, for example addition of [[mw:Extension:WikiLove|WikiLove]].</ref> to address common patterns of harmful editing. It automatically compares every edit made to Wikipedia against sets of conditions that are defined in user-created filters. If an edit matches the conditions of a filter, that filter will respond by logging the edit. It may also [[WP:Tags|tag]] the edit summary, warn the editor, revoke his/her [[WP:AUTOCONFIRMED|autoconfirmed]] status, and/or disallow the edit entirely.<ref>The extension also allows for temporary blocking, but these features are disabled on the English Wikipedia.</ref>


The [[mw:Extension:AbuseFilter|AbuseFilter extension]] was enabled on the English Wikipedia in 2009. The term "edit filter" rather than "abuse filter" is currently used for user-facing elements of the filter as some of the edits it flags are not harmful;<ref name="goodedits" /> the terms are otherwise synonymous.
The [[mw:Extension:AbuseFilter|AbuseFilter]] extension was enabled on the English Wikipedia in 2009. The term "edit filter" rather than "abuse filter" is used for user-facing elements of the filter as some of the edits it flags are not harmful;<ref name="harmlessactions" /> the terms are otherwise synonymous.


Filters need to be proportionate, in line with our policies and principles, and should not impede legitimate editing. Proposals for new edit filters are discussed among the community to assess need, suitability, and/or suggest improvements. Any user may propose a new filter, or review or raise concerns over an existing one.
Because even the smallest mistake in editing a filter can disrupt the encyclopedia, only editors who have the required good judgement and technical proficiency are permitted to configure filters. This page does not discuss technical issues concerning the feature; technical information relating to the operation of the edit filter can be found at [[mw:Extension:AbuseFilter|Extension:AbuseFilter]].

Because even the smallest mistake in editing a filter can disrupt the encyclopedia, only editors who have the required good judgement and technical proficiency are permitted to configure filters. This page does not discuss technical aspects of the feature; technical information relating to its operation can be found at [[mw:Extension:AbuseFilter|Extension:AbuseFilter]].


There are currently [[Special:ListUsers/abusefilter|{{NUMBERINGROUP:abusefilter}}]] edit filter managers.
There are currently [[Special:ListUsers/abusefilter|{{NUMBERINGROUP:abusefilter}}]] edit filter managers.


==Basics of usage==
==Description==
{{Detail|Wikipedia:Edit filter/Documentation}}
{{Detail|Wikipedia:Edit filter/Documentation|filter parameters}}
Edit filters are mainly<ref name="goodedits" /> used to identify and mitigate harmful edits by comparing edits with filtering criteria that address patterns of harmful editing. Filters are created and configured by edit filter managers, but they can be [[WP:EFR|requested]] by any editor.
Edit filters are generally used to identify and mitigate harmful edits by comparing edits with filtering criteria that address patterns of harmful editing. Filters may be [[#Requesting filters|proposed]] by any editor.


When an edit being saved "triggers" an active filter, the effect depends on a setting associated with that particular filter:
When an edit "trips" a filter, the effect depends on a setting associated with that particular filter:
*The strongest setting is '''disallow'''. In this case, the edit is rejected, and the user will see [[MediaWiki:Abusefilter-disallowed|this]]. (A link is provided for reporting false positives.) It is also possible to have a user's autoconfirmed status revoked if a user trips the filter.
*Under the highest setting, the edit is rejected, and the user sees a [[MediaWiki:Abusefilter-disallowed|message]] to that effect. (A link is provided for reporting false positives.)
*The next lowest setting is to '''warn'''. In this case, the user will see a customisable message that the edit may be problematic. The user then has the option to either proceed with the save or abandon the edit.
*Under a medium setting, the user is warned via a customisable message that the edit may be unconstructive. The user then has the option to either proceed with the save (he may have to redo the captcha) or abandon the edit.
*The next lowest setting is to '''add a tag'''. In this case, the edit is [[Wikipedia:Tags|tagged]] for review by patrollers.
*Under a lower setting, the edit is [[Wikipedia:Tags|tagged]] for review by [[WP:RCPATROL|patrollers]].
*Under the lowest setting, enabled by default, the edit generates a log entry only.
*The lowest setting is to '''log the edit'''. In this case, the edit is merely added to [[Special:AbuseLog|this]]. When testing new filters, this is the suggested setting to use.


==Usage==
==Recommended uses==
{{see also|#Reviewing filters}}
Except in urgent situations, new edit filters should generally be tested without any actions specified (simply enabled) until a good number of edits have been logged and checked before being implemented in "warn" or "disallow" modes. If the filter is receiving more than a very small percentage of false positives it should usually not be placed in 'disallow' mode. If a filter is designed to catch [[WP:AGF|good faith]] edits it should not be placed in disallow mode without an appropriate consensus.
The Edit Filter allows controls to be set which apply automated responses to user-defined patterns of harmful editing. Care and good judgement must be exercised to ensure filters put in place do not themselves [[Wikipedia:Disruptive sanctions|disrupt]] building the encyclopedia. Filters designed to target abusive edits will generally apply to all editors.<sup>[[WP:Requests for arbitration/Durova/Workshop#No one is exempt from policy|[3]]][[WP:=|[4]]]</sup> Filters must be evidence-based, and proportionate.


===Actions===
Edit filter managers should be familiar with alternatives that might be more appropriate in a given situation. For example, problems on a single page might be better served with [[WP:PP|page protection]], and problems with page titles or [[WP:SPAM|link spam]] may find the [[MediaWiki:Titleblacklist|title blacklist]] and [[MediaWiki:Spam-blacklist|spam blacklist]] more effective respectively. Because edit filters check every edit in some way, filters that are tripped only rarely are discouraged.
Edit filters should only be set to disallow where a clear consensus of a significant and substantial amount of editors has been established that a specific type of edit should not be allowed by any editor. Any doubts or grey areas regarding setting a filter to disallow should be discussed with the community.


New edit filters must not be set to disallow without a notice having been posted on-wiki, to allow the community to assess the necessity and technical accuracy of the filter plus allow proper testing. In emergency situations, the notice may be made after-the-fact. Prior to and during discussion and assessment of an edit filter which is set to "disallow" due to an emergency, the user placing the edit filter has responsibility for monitoring the logs and ensuring false positives, if any, are minimized.
Edit filters should only be set to disallow to prevent edits that substantially all good-faith editors would agree are undesirable, or where a clear consensus has been reached that a specific type of edit should not be allowed. Any doubts regarding setting a filter to disallow should be discussed with other edit filter managers.


Except in emergency situations, new edit filters should be tested without any actions specified besides "log" (simply enabled) until a good number of edits have been logged and checked before being deployed in "warn" or "disallow" modes. If the filter is receiving more than a very small percentage of false positives it should not usually be placed in or remain in "disallow" mode.
Except in urgent situations, new edit filters must not be set to disallow without thorough testing and a notice at [[WP:EFN|the noticeboard]] to give other edit filter managers and the community time to review the filter for technical accuracy and necessity.<ref>Non-admins in good standing who wish to review a proposed but hidden filter may message the mailing list for details.</ref> In urgent situations, the notice may be made after-the-fact. Prior to and during the review of an edit filter which is set to "disallow" due to an emergency, the editor placing the edit filter is responsible for seeing that the logs are regularly monitored and false positives are minimized.


The tool capabilities include throttle (rate-limit) control, whereby the filter actions only invoke once the user tries to perform the defined edit a specified number of times in a specified period.
==User right==
{{Shortcut|WP:EFM}}
Only members of the edit filter manager group are allowed to modify filters, though all administrators can view private filters. Edit filter managers also have the ability to edit [[WP:Tags|tags]]. This group is assignable by [[WP:ADMIN|administrators]], who may also assign the right to themselves.


While disallow is the highest available setting, [[MediaWiki:Abusefilter-warning|warnings]] can also damage the project by deterring helpful contributors.<ref><span class="plainlinks">[https://phabricator.wikimedia.org/T87508#1100247 Research has shown]<!--interstitials--></span> that anything put in place between an (unregistered) editor and saving an edit dramatically reduces productivity.</ref>
The assignment of the edit filter manager user right to non-admins is highly restricted. It should ''only'' be requested by and given to highly trusted users; when there is a clear, demonstrated need for it. Demonstrated ability that one can and will use it safely is absolutely critical. This is because widespread disruption of the entire encyclopedia can easily occur&mdash;even unintentionally&mdash;with the smallest of mistakes in changing edit filters. Therefore, demonstrated knowledge of the extension's [[:mw:Extension:AbuseFilter/Rules format|syntax]] and in understanding and crafting [[regular expressions]] is absolutely essential.<ref name="perlre">The extension uses [[Perl]]-style regular expressions, which is the most common style, but is substantially different from and more extensive than [[:mw:Extension:Scribunto/Lua_reference_manual#Patterns|Scribunto]] (Lua) patterns. See [http://www.boost.org/doc/libs/1_43_0/libs/regex/doc/html/boost_regex/syntax/perl_syntax.html#boost_regex.syntax.perl_syntax.perl_regular_expression_syntax this page] for documentation.</ref> Editors that are not edit filter managers should consider helping out at [[Wikipedia:Edit_filter/Requested|requested edit filters]] and troubleshooting at [[Wikipedia:Edit filter/False positives|false positives]] to help demonstrate these skills.


===Scope and application===
Requests for assignment of the group to non-admins can be made at the [[Wikipedia:Edit filter noticeboard|edit filter noticeboard]], where a discussion will be held before a decision is made. In addition a small number of WMF staff have the right, which they may request from the Trust and Safety group, following WMF procedures.
Edit filters should not be used to block edits permitted under [[Wikipedia:policies and guidelines|policies and guidelines]] or otherwise commonly understood as acceptable from being made by any subset of the userbase—registered or unregistered. Filters are not to be implemented in opposition to site policies or overarching WMF policies. Rather, gain consensus to change the relevant policy, then do so; only implement the filter ''after''.


{{shortcut|WP:REDFLAGEF}}A fundamental community and [[Wikimedia:Privacy policy|policy]] principle of Wikipedia is that anyone can edit without an account anywhere on the project (with very limited exceptions such as temporary semi-protection of a single page). It is crucial that edit filter managers do not use the Edit Filter in a way that is divisive,<sup>[[Wikipedia:Requests for arbitration/C68-FM-SV#Consistent standards|[5]]][[Wikipedia:Requests for arbitration/C68-FM-SV#Unnecessarily divisive behavior|[6]]]</sup> or in such a manner to privilege registered users over unregistered users. Pre-emptive restriction is contrary to the open nature of the project.<sup>[[Special:Diff/653436828|[9]]]<!--community placed restrictions-->[[wikipediawikipedia:?curid=28835560#mass_fully_protecting_templates|[10]]]<!--mass protects--></sup> [[Red flag (signal)|Red Flag]]s that indicate a filter might be improper include use of phrases like "There's no need for 'them' to do that", "If people want to do this they [[WP:IPDIS|ought]] to create an account", "I can't think of a reason why users [[WP:newbie|newer]] than I am/IPs should do this". We judge edits on [[WP:FOC|their own merits]].
If an edit filter manager is misusing the user right, the concern should first be raised with them directly. If discussion does not resolve the issue, a request for discussion or removal of the user right may be made at the edit filter noticeboard.


The tool can potentially control and restrict a substantial breadth of types of edit to the project. In practice it is not suitable or is inappropriate to use for some matters. The Edit Filter must not be used for style enforcement or to enforce content disputes. It should not be used for pseudo<sup>[[Wikipedia talk:Edit filter/Archive_2#-modify_right_.28moved_from_AN.29|[12]]][[WP:Arbitration/Requests/Case/Kww_and_The_Rambling_Man#Kww_has_misused_edit_filters|[13]]]</sup> page protection as it offers reduced scrutiny—unlike a usual (semi-)protection no entry is left in the page revision history or logs linked on the history page, nor is a padlock icon shown. As [[WP:PROJGUIDE#OWN|WikiProjects]] do not own articles, the Edit Filter must not be used to control or influence articles according to a WikiProject's preferences. Filter rights mustn't be used to unilaterally impose 'policy change' by fiat, or to violate a community-established consensus.
=== Have a strong password ===
{{see also|Wikipedia:User account security}}
If you have the edit filter manager user right, please ensure you follow the [[WP:PSR|Password strength requirements]] and [[Wikipedia:Personal security practices|appropriate personal security practices]]. Because edit filters affect every edit made, a compromised account will be blocked and its privileges removed on grounds of site security. In the unlikely event that your account is compromised, notify an administrator or bureaucrat (for administrators) immediately so they can block your account and remove any sensitive privileges to prevent damage.


===Alternative tools===
==Requesting edit filters==
Edit filter managers should be familiar with alternatives that might be more appropriate in a given situation. For example, the [[MediaWiki:Titleblacklist|title]] and [[Wikipedia:Spam blacklist|spam]] blacklists address problems with page titles or link spam, respectively. Problems on a single page might be better served with [[WP:PP|page protection]]. Like filters, page protection and blacklisting are evidence-based, not to be used preemptively.
{{main|Wikipedia:Edit filter/Requested}}
Edit filters can be requested at the requests page. Edit filter managers monitor this page and implement edit filters when a good case is made. If there is disagreement [[WP:CONSENSUS]] applies. The desirability of an edit filter may also emerge from discussions elsewhere on Wikipedia or through communication on the mailing list.


===Miscellaneous===
If it would not be desirable to discuss the need for a given edit filter on-wiki, such as where the purpose of the filter is to combat harassment by an abusive banned user who is likely to come across the details of the request, edit filter managers can be emailed directly or on the [[mail:wikipedia-en-editfilters|wikipedia-en-editfilters]] mailing list at '''{{no spam|wikipedia-en-editfilters|lists.wikimedia.org}}'''.
Because edit filters check every edit in some way, filters that are tripped only rarely are discouraged. Similarly they should not be created in response to a single incident or one which has had few occurrences. Rather than change the purpose of an existing filter, the correct approach is to create a new one. If what you are doing fits better into an existing filter (disabled or not) then use that instead. Likewise do not resequence the filters. Once they have had a single hit, that hit is logged pointing to the filter that was tripped. If what the tripped filter does is substantively changed, the log of abuse hits gets very confusing.


The description field is intended to briefly describe the filter rule(s). These should provide a straightforward description of the abuse being targeted. These need to be an accurate and descriptive summary;<sup>[[WP:Requests for arbitration/Betacommand#Communication|[18]]][[WP:Requests for arbitration/Durova#Responsibility|[19]]][[WP:Requests for arbitration/Durova#Transparency and chilling effect|[20]]]</sup> avoid using overly broad or vague uninformative descriptions such as "Vandalism", "Persistent Abuse", "XfD filter".<sup>[[WP:Requests for arbitration/Ryulong#Administrator communications|[21]]]</sup><ref>Examples of good titles are filters {{abbr|368|Making large changes when marking the edit as minor}}, {{abbr|275|New users moving featured articles}}, {{abbr|214|Creating articles with title contained in username}}, and {{abbr|168|Non-admins responding to unblock requests}}.</ref> They also serve as a filter name alongside the filter&nbsp;id.
If an editor (who need not be an edit filter manager) believes that an existing edit filter is unnecessary, is preventing good edits, or is otherwise problematic, they should raise their concerns on the [[WP:EFN|edit filter noticeboard]] or directly with the edit filter manager who created or enabled the filter for further discussion.

==Requesting filters==
{{Hatnote|To view, discuss or make requests for filters, see [[Wikipedia:Edit filter/Requested|''WP:EF/R'']]}}

Edit filters should normally be proposed at the requests page. A proposal will generally contain what it would do, reasoning, compelling evidence of a problem it shall address, and scope. Edit filter managers implement those for which a good case is made. The normal principles of [[WP:consensus|consensus]] apply. The desirability of an edit filter may also emerge from other noticeboards or through [[#mailing list|the mailing list]].

A new or substantively new filter should not be deployed without any public discussion or<!--i.e at the least--> community notification. It is important that edit filter managers make a record in a central location, such as the requests page, whenever a new filter is created.<sup>[[Wikipedia:Requests for arbitration/Durova#Responsibility|[22]]]</sup><ref>A record will typically comprise filter name, purpose, rationale and scope.</ref> This is because increasing and unannounced filters which form a minefield of filters users only learn of as they trip them create a discouraging and unwelcoming [[m:the wiki way|editing environment]]. This additionally helps provide the transparency required for accountability of those entrusted with the user right.

In limited situations such as where the purpose of the filter is to combat harassment by an abusive banned user who is likely to come across the request, it will not be prudent to discuss the need for a given edit filter on-wiki—edit filter managers can be emailed directly or through the mailing list (though see [[Wikipedia:Requests for arbitration/Durova#Responses_to_harassment_and_stalking.3B_perspective|this arbitration ruling]]).

==Reviewing filters==
{{shortcut|WP:EFCOMMS|WP:EFREVIEW}}

Any user may assess the configuration, proportionality and appropriateness, and ongoing need for a given filter. Useful review information includes its origin, related community discussions plus logs and reports of false positives, along with its description, comments, and settings. Any filter manager may adjust or remove inappropriate filters, at any time. Anyone who believes that an existing edit filter is unnecessary or inappropriate, is impeding good edits, or has other problem effects, may raise their concerns with the filter author or on the edit filter [[WP:EFN|noticeboard]].

===Communication and transparency===
Due to the collaborative nature of the project and the tool's technical basis proper communication is vital.<sup>[[WP:Requests for arbitration/Betacommand#Communication|[23]]]</sup> Editors should address, rather than dismiss, good faith concerns raised by other users. Responses that are unhelpful or dismissive (such as the user being told an inappropriate filter worked as designed) are very discouraging.

Filter authors are encouraged to monitor the false positives and noticeboard pages. Anyone may participate at these pages. However, non admins without the userright are not able to modify filters, nor are they able to see hidden filters or their respective log entries.

Like other editors who hold positions of community trust or privileged access, edit filter managers have a heightened responsibility to the community. They are expected to act in a reasonable and transparent manner. <!--The tool is essentially an administrative one.--> Edit filter managers are accountable for their actions involving the Edit filter tool, and unexplained administrative actions can demoralize other editors who lack such tools. Even when reversed, administrative actions that appear arbitrary or capricious, or are based on poor evidence, have a chilling effect on people's willingness to contribute to Wikipedia. Edit filter managers are expected to respond promptly and fully to queries about their Wikipedia-related conduct and administrative actions and to justify them when needed. [[Wikipedia:Fait accompli|''Fait accompli'']] actions, where actions are justified by their having already been carried out, are inappropriate.

==User right==
{{Shortcut|WP:EFM}}
Only members of the {{ttt|edit filter manager}} group can modify filters. Members of the group are also able to edit [[WP:Tags|tags]]. The group (or "user right") is assignable by [[WP:ADMIN|administrators]], who may also assign the right to themselves. All administrators can view private filters (and their respective logs) by default.<ref>[[WP:Oversight|Oversighters]] are additionally able to hide filter log entries from all except oversighters.</ref>

The assignment of the user right to non-admins is highly restricted. It should ''only'' be requested by and given to highly trusted users where there is a clear, demonstrated need for it. Demonstrated ability that one can and will use it safely is absolutely critical. This is because widespread disruption of the entire project can easily occur—even unintentionally—with the smallest of mistakes in changing edit filters. Therefore, in addition to knowledge of the community's policies and norms, demonstrated knowledge of the extension's [[:mw:Extension:AbuseFilter/Rules format|syntax]] and in understanding and crafting [[regular expressions]] is absolutely essential.<ref name="perlre">The extension uses [[Perl]]-style regular expressions ({{scp|1=http://www.boost.org/doc/libs/1_43_0/libs/regex/doc/html/boost_regex/syntax/perl_syntax.html#boost_regex.syntax.perl_syntax.perl_regular_expression_syntax |2=documentation}}), which is the most common style, but is substantially different from and more extensive than [[:mw:Lua reference manual#Patterns|Scribunto]] (Lua) patterns.</ref> Editors may wish to consider helping out at [[WP:EFR|requested edit filters]] and [[WP:FALSEPOS|false positives]] to help demonstrate these skills.

Requests for assignment of the user right to non-admins can be made at the [[Wikipedia:Edit filter noticeboard|edit filter noticeboard]], where a discussion will be held before a decision is made.

If an edit filter manager is misusing the user right, the concern should first be raised with them directly. If this does not resolve the issue, further discussion or a request for removal of the user right can be made at the edit filter noticeboard.


==Private filters==
==Private filters==
{{Shortcut|WP:PRIVATEFILTER}}
{{Shortcut|WP:PRIVATEFILTER}}
The community expects that unless absolutely necessary, filters should remain visible. Filter settings and logs are visible by default. In limited situations they cannot be revealed to the community as a whole and so are set to be private—hidden from public view.
While filter settings and logs are by default publicly viewable, some are set to be private. For all filters, including those hidden from public view, a brief description of what the rule targets is displayed in the [[Special:AbuseLog|log]], the list of active filters, and in any error messages generated by the filter. Edit filter managers should take care not to [[WP:BEANS|discuss the specifics of hidden filters]] publicly.


The core values and principles of the project necessarily rest on openness and mutual collaboration. This includes processes that address vandalism and other abuse. All of the software that runs Wikipedia, including [[WP:CheckUser|checkuser]] tools, is open source. [[WT:Sockpuppet investigations/Archives/Archive15#SPI_evidence_subpages|SPI cases]] are open except in limited situations where the evidence involves<sup>[[wmf:Access to nonpublic data policy|[24]]][[WP:Requests for arbitration/Durova#Responsibility|[25]]]</sup> [[m:Confidentiality agreement for nonpublic information|private or non-public personal information]]. [[WP:BOTAPPROVAL|Bots]] are discussed openly, and [[m:Research talk:Revision scoring as a service/2014#Badword lists|lists]] of "[[m:Research:Revision scoring as a service/Word lists/en|bad]] {{noping|ClueBot/Source#Score_list|label1=words}}" are public. Accordingly, the private setting should be used sparingly, and solely in cases where public knowledge of the filter's content would be harmful—for example, if it is looking for the edit pattern of a [[WP:LTA|long-term]] persistent vandal who could see that filter's ruleset and is likely to use that knowledge to circumvent it.
Filters should only be hidden where necessary, such as in [[WP:LTA|long-term abuse]] cases where the targeted user(s) could review a public filter and use that knowledge to circumvent it. Filters should not generally be named after abusive editors, but rather with a simple description of the type of abuse, provided not too much information is given away.


When a filter is private, only administrators (plus any non-admin filter managers) can view its settings, ruleset, and 'hits' logs. The description is displayed in the user's filter log and the site's list of filters. An entry in a user's filter log from a hidden filter only shows the description—much like [[WP:CFRD|deleted]] or [[WP:OS#Policy|suppressed]] edits, no diff or link to the edit is visible to regular users.
Filter managers may share the contents of private edit filters with non-administrators on the basis of their good judgement. Be careful not to test sensitive parts of private filters in a public test filter (such as {{EF|1}}): use a private test filter (for example {{EF|2}}) if testing is required. Similarly be careful not to post sensitive parts of private filters on talk pages or persistent pages of external sites.


While descriptions must be accurate and descriptive, filter managers should take care not to disclose detailed specifics of hidden filters on-wiki, such as details of their regexes, that would give an excessive level of insight. Similarly be careful not to test sensitive parts of such filters in a publicly visible test filter (such as {{EF|1}}): use a private test filter (for example {{EF|2}}). Sensitive issues concerning a private filter may be raised by emailing filter managers or by contacting them via the [[#Mailing list|mailing list]].
Sensitive issues concerning private filters may be raised by emailing filter managers or by contacting them via the [[mail:wikipedia-en-editfilters|wikipedia-en-editfilters]] mailing list at '''{{no spam|wikipedia-en-editfilters|lists.wikimedia.org}}'''.


==Mailing list==
=={{anchor|mailing list}} Mailing list==
{{Shortcut|WP:EFMAILING}}
{{Shortcut|WP:EFMAILING}}
The mailing list [[mail:wikipedia-en-editfilters|wikipedia-en-editfilters]] is a private list in which only administrators and edit filter managers are subscribers. The list's primary function is for discussion of private filters, both between edit filter managers and with non-admins, who can email the list at '''{{no spam|wikipedia-en-editfilters|lists.wikimedia.org}}'''. The mailing list should not be used as a venue for discussions which could reasonably be held on-wiki.
The mailing list [[mail:wikipedia-en-editfilters|wikipedia-en-editfilters]] is a private list. Only administrators and edit filter managers may be subscribers; non-admins can email the list at {{no spam|wikipedia-en-editfilters|lists.wikimedia.org}}. The list is used for discussion of private filters. It should not be used for discussions which could reasonably be held on-wiki.

==Tools and resources==
A watchable page of recent changes to public filters is generated at [[User:MusikBot/FilterMonitor/Recent changes]], which will show up even if your watchlist is set to hide bot edits. There is also a formatted template {{tlu|User:MusikBot/Filter changes}} that shows this same data.


==See also==
Edit filters sometimes make use of relatively large (though not usually complex) [[regular expression]]s (regexes). External tools such as [https://www.debuggex.com/ Debuggex] can be useful for testing these.{{refn|Be sure to set such tools to its "Perl" or "PCRE" ([[Perl Compatible Regular Expressions]]) mode; avoid using a tool if it doesn't have such a mode. Also this will not be useful with "ccnorm" strings.<ref name="perlre" />}} Because regexes are extremely fragile and almost ''any'' typo in one will cause it to malfunction, use of such a tool is recommended. Use of [[Special:AbuseFilter/test|the test interface]] when creating or editing filters is also recommended.
* [[WP:PSR|Password strength policy]]&nbsp;'''&middot;''' [[Wikipedia:Personal security practices|User security: good practices]]
* Bare list of filter modifications – {{scp|1=https://en.wikipedia.org/w/index.php?title=Special:Log&type=abusefilter&user=Example |2=by user}}
* Filters changelog –&nbsp;[[Special:AbuseFilter/history|all filters]]&nbsp;'''&middot;''' {{scp|1=https://en.wikipedia.org/w/index.php?title=Special:AbuseFilter/history/&user=Example |2=by user}}
* [[toollabs:ptwikis/Filters:enwiki|Graphs/Counts of Abuse&#8202;Filter actions]]
* [[mw:Extension:AbuseFilter#API|API]] – information on filters: <span class="plainlinks">[//en.wikipedia.org/w/api.php?action=query&list=abusefilters&format=jsonfm&abflimit=500&abfprop=id|description|private|status|hits&formatversion=2 to 500]</span>&nbsp;'''&middot;''' <span class="plainlinks">[//en.wikipedia.org/w/api.php?action=query&list=abusefilters&format=jsonfm&abflimit=500&abfprop=id|description|private|status|hits&formatversion=2&abfstartid=501 500+]</span>


==Notes==
==Footnotes==
{{Reflist|30em}}
{{Reflist|30em}}



Revision as of 20:43, 3 February 2016

[[Category:Wikipedia {{{1}}}s|Edit filter]]

The edit filter manager logo

The Edit filter is a tool that allows users in the edit filter manager group to set controls to address common patterns of harmful editing.[1] It automatically compares every edit made to Wikipedia against sets of conditions defined in user-created filters. If an edit matches the conditions of a filter, that filter will log the edit. It may also tag the edit summary, warn the editor, and/or disallow the edit entirely.

The AbuseFilter extension was enabled on the English Wikipedia in 2009. The term "edit filter" rather than "abuse filter" is used for user-facing elements of the filter as some of the edits it flags are not harmful;[1] the terms are otherwise synonymous.

Filters need to be proportionate, in line with our policies and principles, and should not impede legitimate editing. Proposals for new edit filters are discussed among the community to assess need, suitability, and/or suggest improvements. Any user may propose a new filter, or review or raise concerns over an existing one.

Because even the smallest mistake in editing a filter can disrupt the encyclopedia, only editors who have the required good judgement and technical proficiency are permitted to configure filters. This page does not discuss technical aspects of the feature; technical information relating to its operation can be found at Extension:AbuseFilter.

There are currently 141 edit filter managers.

Description

Edit filters are generally used to identify and mitigate harmful edits by comparing edits with filtering criteria that address patterns of harmful editing. Filters may be proposed by any editor.

When an edit "trips" a filter, the effect depends on a setting associated with that particular filter:

  • Under the highest setting, the edit is rejected, and the user sees a message to that effect. (A link is provided for reporting false positives.)
  • Under a medium setting, the user is warned via a customisable message that the edit may be unconstructive. The user then has the option to either proceed with the save (he may have to redo the captcha) or abandon the edit.
  • Under a lower setting, the edit is tagged for review by patrollers.
  • Under the lowest setting, enabled by default, the edit generates a log entry only.

Usage

The Edit Filter allows controls to be set which apply automated responses to user-defined patterns of harmful editing. Care and good judgement must be exercised to ensure filters put in place do not themselves disrupt building the encyclopedia. Filters designed to target abusive edits will generally apply to all editors.[3][4] Filters must be evidence-based, and proportionate.

Actions

Edit filters should only be set to disallow where a clear consensus of a significant and substantial amount of editors has been established that a specific type of edit should not be allowed by any editor. Any doubts or grey areas regarding setting a filter to disallow should be discussed with the community.

New edit filters must not be set to disallow without a notice having been posted on-wiki, to allow the community to assess the necessity and technical accuracy of the filter plus allow proper testing. In emergency situations, the notice may be made after-the-fact. Prior to and during discussion and assessment of an edit filter which is set to "disallow" due to an emergency, the user placing the edit filter has responsibility for monitoring the logs and ensuring false positives, if any, are minimized.

Except in emergency situations, new edit filters should be tested without any actions specified besides "log" (simply enabled) until a good number of edits have been logged and checked before being deployed in "warn" or "disallow" modes. If the filter is receiving more than a very small percentage of false positives it should not usually be placed in or remain in "disallow" mode.

The tool capabilities include throttle (rate-limit) control, whereby the filter actions only invoke once the user tries to perform the defined edit a specified number of times in a specified period.

While disallow is the highest available setting, warnings can also damage the project by deterring helpful contributors.[2]

Scope and application

Edit filters should not be used to block edits permitted under policies and guidelines or otherwise commonly understood as acceptable from being made by any subset of the userbase—registered or unregistered. Filters are not to be implemented in opposition to site policies or overarching WMF policies. Rather, gain consensus to change the relevant policy, then do so; only implement the filter after.

A fundamental community and policy principle of Wikipedia is that anyone can edit without an account anywhere on the project (with very limited exceptions such as temporary semi-protection of a single page). It is crucial that edit filter managers do not use the Edit Filter in a way that is divisive,[5][6] or in such a manner to privilege registered users over unregistered users. Pre-emptive restriction is contrary to the open nature of the project.[9][10] Red Flags that indicate a filter might be improper include use of phrases like "There's no need for 'them' to do that", "If people want to do this they ought to create an account", "I can't think of a reason why users newer than I am/IPs should do this". We judge edits on their own merits.

The tool can potentially control and restrict a substantial breadth of types of edit to the project. In practice it is not suitable or is inappropriate to use for some matters. The Edit Filter must not be used for style enforcement or to enforce content disputes. It should not be used for pseudo[12][13] page protection as it offers reduced scrutiny—unlike a usual (semi-)protection no entry is left in the page revision history or logs linked on the history page, nor is a padlock icon shown. As WikiProjects do not own articles, the Edit Filter must not be used to control or influence articles according to a WikiProject's preferences. Filter rights mustn't be used to unilaterally impose 'policy change' by fiat, or to violate a community-established consensus.

Alternative tools

Edit filter managers should be familiar with alternatives that might be more appropriate in a given situation. For example, the title and spam blacklists address problems with page titles or link spam, respectively. Problems on a single page might be better served with page protection. Like filters, page protection and blacklisting are evidence-based, not to be used preemptively.

Miscellaneous

Because edit filters check every edit in some way, filters that are tripped only rarely are discouraged. Similarly they should not be created in response to a single incident or one which has had few occurrences. Rather than change the purpose of an existing filter, the correct approach is to create a new one. If what you are doing fits better into an existing filter (disabled or not) then use that instead. Likewise do not resequence the filters. Once they have had a single hit, that hit is logged pointing to the filter that was tripped. If what the tripped filter does is substantively changed, the log of abuse hits gets very confusing.

The description field is intended to briefly describe the filter rule(s). These should provide a straightforward description of the abuse being targeted. These need to be an accurate and descriptive summary;[18][19][20] avoid using overly broad or vague uninformative descriptions such as "Vandalism", "Persistent Abuse", "XfD filter".[21][3] They also serve as a filter name alongside the filter id.

Requesting filters

Edit filters should normally be proposed at the requests page. A proposal will generally contain what it would do, reasoning, compelling evidence of a problem it shall address, and scope. Edit filter managers implement those for which a good case is made. The normal principles of consensus apply. The desirability of an edit filter may also emerge from other noticeboards or through the mailing list.

A new or substantively new filter should not be deployed without any public discussion or community notification. It is important that edit filter managers make a record in a central location, such as the requests page, whenever a new filter is created.[22][4] This is because increasing and unannounced filters which form a minefield of filters users only learn of as they trip them create a discouraging and unwelcoming editing environment. This additionally helps provide the transparency required for accountability of those entrusted with the user right.

In limited situations such as where the purpose of the filter is to combat harassment by an abusive banned user who is likely to come across the request, it will not be prudent to discuss the need for a given edit filter on-wiki—edit filter managers can be emailed directly or through the mailing list (though see this arbitration ruling).

Reviewing filters

Any user may assess the configuration, proportionality and appropriateness, and ongoing need for a given filter. Useful review information includes its origin, related community discussions plus logs and reports of false positives, along with its description, comments, and settings. Any filter manager may adjust or remove inappropriate filters, at any time. Anyone who believes that an existing edit filter is unnecessary or inappropriate, is impeding good edits, or has other problem effects, may raise their concerns with the filter author or on the edit filter noticeboard.

Communication and transparency

Due to the collaborative nature of the project and the tool's technical basis proper communication is vital.[23] Editors should address, rather than dismiss, good faith concerns raised by other users. Responses that are unhelpful or dismissive (such as the user being told an inappropriate filter worked as designed) are very discouraging.

Filter authors are encouraged to monitor the false positives and noticeboard pages. Anyone may participate at these pages. However, non admins without the userright are not able to modify filters, nor are they able to see hidden filters or their respective log entries.

Like other editors who hold positions of community trust or privileged access, edit filter managers have a heightened responsibility to the community. They are expected to act in a reasonable and transparent manner. Edit filter managers are accountable for their actions involving the Edit filter tool, and unexplained administrative actions can demoralize other editors who lack such tools. Even when reversed, administrative actions that appear arbitrary or capricious, or are based on poor evidence, have a chilling effect on people's willingness to contribute to Wikipedia. Edit filter managers are expected to respond promptly and fully to queries about their Wikipedia-related conduct and administrative actions and to justify them when needed. Fait accompli actions, where actions are justified by their having already been carried out, are inappropriate.

User right

Only members of the edit filter manager group can modify filters. Members of the group are also able to edit tags. The group (or "user right") is assignable by administrators, who may also assign the right to themselves. All administrators can view private filters (and their respective logs) by default.[5]

The assignment of the user right to non-admins is highly restricted. It should only be requested by and given to highly trusted users where there is a clear, demonstrated need for it. Demonstrated ability that one can and will use it safely is absolutely critical. This is because widespread disruption of the entire project can easily occur—even unintentionally—with the smallest of mistakes in changing edit filters. Therefore, in addition to knowledge of the community's policies and norms, demonstrated knowledge of the extension's syntax and in understanding and crafting regular expressions is absolutely essential.[6] Editors may wish to consider helping out at requested edit filters and false positives to help demonstrate these skills.

Requests for assignment of the user right to non-admins can be made at the edit filter noticeboard, where a discussion will be held before a decision is made.

If an edit filter manager is misusing the user right, the concern should first be raised with them directly. If this does not resolve the issue, further discussion or a request for removal of the user right can be made at the edit filter noticeboard.

Private filters

The community expects that unless absolutely necessary, filters should remain visible. Filter settings and logs are visible by default. In limited situations they cannot be revealed to the community as a whole and so are set to be private—hidden from public view.

The core values and principles of the project necessarily rest on openness and mutual collaboration. This includes processes that address vandalism and other abuse. All of the software that runs Wikipedia, including checkuser tools, is open source. SPI cases are open except in limited situations where the evidence involves[24][25] private or non-public personal information. Bots are discussed openly, and lists of "bad words" are public. Accordingly, the private setting should be used sparingly, and solely in cases where public knowledge of the filter's content would be harmful—for example, if it is looking for the edit pattern of a long-term persistent vandal who could see that filter's ruleset and is likely to use that knowledge to circumvent it.

When a filter is private, only administrators (plus any non-admin filter managers) can view its settings, ruleset, and 'hits' logs. The description is displayed in the user's filter log and the site's list of filters. An entry in a user's filter log from a hidden filter only shows the description—much like deleted or suppressed edits, no diff or link to the edit is visible to regular users.

While descriptions must be accurate and descriptive, filter managers should take care not to disclose detailed specifics of hidden filters on-wiki, such as details of their regexes, that would give an excessive level of insight. Similarly be careful not to test sensitive parts of such filters in a publicly visible test filter (such as 1 ): use a private test filter (for example 2 ). Sensitive issues concerning a private filter may be raised by emailing filter managers or by contacting them via the mailing list.

Mailing list

The mailing list wikipedia-en-editfilters is a private list. Only administrators and edit filter managers may be subscribers; non-admins can email the list at wikipedia-en-editfilters@lists.wikimedia.org. The list is used for discussion of private filters. It should not be used for discussions which could reasonably be held on-wiki.

See also

Footnotes

  1. ^ a b Filters have been used to track or tag non-harmful edits. For example, the Foundation implemented a log-only filter, before the Analytics team existed, as a simple way to track usage of WikiLove.
  2. ^ Research has shown that anything put in place between an (unregistered) editor and saving an edit dramatically reduces productivity.
  3. ^ Examples of good titles are filters 368, 275, 214, and 168.
  4. ^ A record will typically comprise filter name, purpose, rationale and scope.
  5. ^ Oversighters are additionally able to hide filter log entries from all except oversighters.
  6. ^ The extension uses Perl-style regular expressions (documentation), which is the most common style, but is substantially different from and more extensive than Scribunto (Lua) patterns.