Viewing filter 1,163: Repeated text

Filter parameters

Filter ID:	1,163
Description: (publicly viewable)
Filter hits:	68,111 hits
Statistics:	Of the last 185,349 actions, this filter has matched 46 (0.02%). On average, its run time is 0.17 ms, and it consumes 1.3 conditions of the condition limit.
Conditions: (documentation)	!("confirmed" in user_groups) & page_namespace == 0 & ( exp := "(?i)(?<!\S)([^\s\|]++(?: [^\s\|]++)?)(?:\s++\1){2}(?!\S)"; matched := get_matches(exp, added_lines); matched[0] & !(removed_lines irlike exp) & new_wikitext irlike ("(?:" + rescape(matched[1]) + "\s){3}") & /* Avoid edits to multiple non-contiguous lines / matched[1] irlike "\p{L}" & / Exclude numeric data / !(matched[1] irlike "^[!\|{#]") & /* Exclude some lists, tables and templates / !(added_lines irlike "syntaxhighlight\|\{\\|") ) !("confirmed" in user_groups) & page_namespace == 0 & ( exp := "(?i)(?<!\S)([^\s\|]++(?: [^\s\|]++)?)(?:\s++\1){2}(?!\S)"; matched := get_matches(exp, added_lines); matched[0] & !(removed_lines irlike exp) & new_wikitext irlike ("(?:" + rescape(matched[1]) + "\s){3}") & / Avoid edits to multiple non-contiguous lines / matched[1] irlike "\p{L}" & / Exclude numeric data / !(matched[1] irlike "^[!\|{#]") & /* Exclude some lists, tables and templates */ !(added_lines irlike "syntaxhighlight\|\{\\|") )
Notes:	Split from test filter [[Special:AbuseFilter/2]], comments there: ---- Testing generic catching of repeated phrases. Unsure of efficiency, but we'll find out! With thanks to some folks from IRC for helping craft and test variations (digitok & Me-me) --ProcrastinatingReader 14:19 24 Aug 2021 Remove ccnorm for now to prevent some table FPs. Will still be more table issues; still thinking how to get around them. --ProcrastinatingReader 15:55 24 Aug 2021 Tweak for better table support. --ProcrastinatingReader 16:31 24 Aug 2021 ---- (proc @ 23:44 28 Aug 2021) Disable throttle and making public per [[Wikipedia:Edit_filter_noticeboard#Suitability_of_1163_->_disallow]]. --ProcrastinatingReader 23:54 10 Nov 2021 Try exclude some table-related FPs --ProcrastinatingReader 14:57 16 Nov 2021 rv change - introduced too many false positives --ProcrastinatingReader 14:59 16 Nov 2021 retry change with adjustment --ProcrastinatingReader 15:14 16 Nov 2021 TODO: probably try to exclude anything that seems like it's just formatting (<br>s, bullets, lots of \|), and also adjustments to data if possible (changing numerical data) --ProcrastinatingReader 15:19 16 Nov 2021 Might need some more tuning to be disallowable, but definitely good enough filter (>80-90% edits problematic) to tag the edits as possible vandalism. --Galobtter 05:32 1 Apr 2023 Exclude table additions/some modifications and some template additions. --Galobtter 18:27 2 Apr 2023 Also exclude code. --Galobtter 20:48 2 Apr 2023 Attempt to reduce FPs so this can be set to disallow. Require at least one letter (in any script). Avoid lists. Also require that some repeated text appear in new_wikitext; if it doesn't, the edit was to multiple lines that got crammed together in added_lines. --Suffusion of Yellow 21:49 24 Apr 2024
Flags:	Hide details of this filter from public view Enable this filter Enable the use of [https://www.mediawiki.org/wiki/Special:MyLanguage/Extension:AbuseFilter/Rules_format#Protected_variables protected variables] in this filter Mark as deleted
Filter last modified:	21:51, 24 April 2024 by Suffusion of Yellow (talk \| contribs)
History:	View this filter's history
Tools:	Export this filter to another wiki {"data":{"rules":"!(\"confirmed\" in user_groups) \u0026\r\npage_namespace == 0 \u0026\r\n(\r\n exp := \"(?i)(?\u003C!\\S)([^\\s\|]++(?: [^\\s\|]++)?)(?:\\s++\\1){2}(?!\\S)\";\r\n matched := get_matches(exp, added_lines);\r\n matched[0] \u0026\r\n !(removed_lines irlike exp) \u0026\r\n new_wikitext irlike (\"(?:\" + rescape(matched[1]) + \"\\s){3}\") \u0026 /* Avoid edits to multiple non-contiguous lines /\r\n matched[1] irlike \"\\p{L}\" \u0026 / Exclude numeric data /\r\n !(matched[1] irlike \"^[!\|{#]\") \u0026 /* Exclude some lists, tables and templates */\r\n !(added_lines irlike \"syntaxhighlight\|\\{\\\|\")\r\n)","name":"Repeated text","comments":"Split from test filter [[Special:AbuseFilter/2]], comments there:\r\n----\r\nTesting generic catching of repeated phrases. Unsure of efficiency, but we'll find out! With thanks to some folks from IRC for helping craft and test variations (digitok \u0026 Me-me) --ProcrastinatingReader 14:19 24 Aug 2021\r\n\r\nRemove ccnorm for now to prevent some table FPs. Will still be more table issues; still thinking how to get around them. --ProcrastinatingReader 15:55 24 Aug 2021\r\n\r\nTweak for better table support. --ProcrastinatingReader 16:31 24 Aug 2021\r\n---- (proc @ 23:44 28 Aug 2021)\r\n\r\nDisable throttle and making public per [[Wikipedia:Edit_filter_noticeboard#Suitability_of_1163_-\u003E_disallow]]. --ProcrastinatingReader 23:54 10 Nov 2021\r\n\r\nTry exclude some table-related FPs --ProcrastinatingReader 14:57 16 Nov 2021\r\n\r\nrv change - introduced too many false positives --ProcrastinatingReader 14:59 16 Nov 2021\r\n\r\nretry change with adjustment --ProcrastinatingReader 15:14 16 Nov 2021\r\n\r\nTODO: probably try to exclude anything that seems like it's just formatting (\u003Cbr\u003Es, bullets, lots of \|), and also adjustments to data if possible (changing numerical data) --ProcrastinatingReader 15:19 16 Nov 2021\r\n\r\nMight need some more tuning to be disallowable, but definitely good enough filter (\u003E80-90% edits problematic) to tag the edits as possible vandalism. --Galobtter 05:32 1 Apr 2023\r\n\r\nExclude table additions/some modifications and some template additions. --Galobtter 18:27 2 Apr 2023\r\n\r\nAlso exclude code. --Galobtter 20:48 2 Apr 2023\r\n\r\nAttempt to reduce FPs so this can be set to disallow. Require at least one letter (in any script). Avoid lists. Also require that some repeated text appear in new_wikitext; if it doesn't, the edit was to multiple lines that got crammed together in added_lines. --Suffusion of Yellow 21:49 24 Apr 2024","group":"default","actions":{"tag":["possible vandalism"]},"enabled":true,"deleted":false,"privacylevel":0,"global":false},"actions":{"tag":["possible vandalism"]}}

Actions to take when matched

Trigger actions only if the user trips a rate limit

Number of actions to allow:

Period of time (in seconds):

Group throttle by:

user

See the documentation on mediawiki.org.

Trigger these actions after giving the user a warning

System message to use for warning:

Page name of other message:

(without "MediaWiki:" prefix)

Prevent the user from performing the action in question

System message to use for disallowing:

Page name of other message:

(without "MediaWiki:" prefix)

Revoke the user's autoconfirmed status

Tag the edit in contributions lists and page histories

Tags to apply:

(see Wikipedia:Tags for use and formatting)

(please don't rename a tag here, see link above)

(one per line, no commas, publicly visible)

possible vandalism

Require the user to complete a CAPTCHA in order to proceed with the action. Users with permission to skip a CAPTCHA are exempt.