User talk:Yapperbot

Regarding...

...this,[1] why are you soliciting input from a user who's been prohibited from editing Wikipedia? ←Baseball Bugs ^{What's up, Doc?} carrots→ 18:48, 19 March 2021 (UTC)

Because they're still listed at WP:FRS. The bot has a separate task to remove users who have been indefinitely blocked for 2 or more months from the list, however Bus stop was only indeffed for one month so that hasn't triggered yet. * Pppery * _{it has begun...} 02:59, 20 March 2021 (UTC)

Understood. Thanks. ←Baseball Bugs ^{What's up, Doc?} carrots→ 07:07, 20 March 2021 (UTC)

Adding peer review to feedback request service

I'd like to request that peer reviews are added to your feedback request service. The details are:

• There are be 12 possible categories. 11 are based on categories 1 to 11 on WP:PR and then a 12th category called "All peer reviews".
• I will populate the FRS listing at WP:FRS based on the editors at WP:PRV who nominated to be autocontacted (The lists need to be kept separate as one is basically a plain text list intended for people to read and find volunteers, and the other FRS list is designed for a bot to use)
• This would usurp the functionality provided by the now inactive User:KadaneBot
• It will also have the benefit of letting User:Yapperbot keep the FRS list and volunteer lists up to date.

Having a single bot manage this in addition to other FRS will help future maintenance by putting FRS-type listings all the same spot using the same tools and bots.

I realise Naypta is not active at the moment but post this hopeful that another editor will take the bot's reins and take this task on :). Tom (LT) (talk) 03:51, 4 April 2021 (UTC)

Users who have been partially blocked should not be treated as "indeffed" by Pruner

This happened in Special:Diff/1017428026, in which LocalPunk was removed incorrectly. * Pppery * _{it has begun...} 23:10, 29 April 2021 (UTC)

Check for blocks before requesting feedback

Hi, just a quick ping that the bot should check whether the users it's requesting feedback from aren't blocked by any chance.

1. I'm sure you agree it makes little sense to expect contributions from indeffed users
2. When a user has been told they aren't allowed to participate in the project, but then they're bombed with messages asking for contributions, it looks fairly unprofessional and may be quite confusing to them
3. Their Talk pages are getting filled with spam

This Talk page has prompted me to post this request. Cheers, — kashmīrī ^TALK 11:57, 19 June 2022 (UTC)

Down since mid-December?

Yapperbot's last message was posted on 12/18/23; it looks like it needs to be migrated off of GridEngine and has been shut down by the toolforge maintainers. Either komla needs to migrate it or someone else needs to take up maintenance. See T320195 – SJ + 01:54, 29 January 2024 (UTC)

Sj I just noticed that too. I am willing to help with maintenance and debug. I'm not at this point willing to take full responsibility for the code, but more than happy to assist anyone else.

In addition, I would like to address a problem I pointed out to the author (Naypta) of the program long ago that has never been addressed: User_talk:Yapperbot/Archive_2#Concern_about_probability_of_receiving_notifications. It's been a few years since I discussed it with the author. In the end the author didn't feel it worth fixing. I just mentioned the bug to Novem Linguae, who replied "I agree that that sounds like a bug..." here This seems like a good time to consider fixing the bug.

Right now I am reviewing all those old discussions and will see about looking at the code and possibly try to help with documentation before making any recommendation on how to fix it. --David Tornheim (talk) 22:28, 14 February 2024 (UTC)

Naypta hasn't edited in about two years. First things first, someone who is not Naypta needs to 100% fork and take over the bot's source code and get it set up on Toolforge. Are you thinking about doing that David? –Novem Linguae (talk) 22:36, 14 February 2024 (UTC)

Considering it--especially if there are no other takers. --David Tornheim (talk) 22:48, 14 February 2024 (UTC)

Moving Forward

I see there are still no takers. I have been reviewing the code here and here(I believe this is an old version). I am also aware of Wikipedia:Bots/Requests_for_approval/Yapperbot.

Regarding my background and experience: I have a strong background in programming in countless languages popular before 2000, e.g.: C (I read every bit of Kernighan and Richtie's famous book and did all the exercises), Verilog, Pascal, FORTRAN, LISP, BASIC, HPL, Prolog, and Z-80, 8085, 8086, VAX and MIPS assembly. Since then, I have learned some of PERL and Python. Lately, data problems that I might have solved with a program, I just find it faster and easier to maintain an Excel spreadsheet or Access Database. Within the last 5 years, I took a class in Database Management (and learned SQL) and one in HTML. In the old days, I found using a debugger very helpful. I haven't used a recent debugger in quite a while. Those are the pluses.

I do not have experience with GoLang, bots, or any coding on Wikipedia/WikiMedia--other than Wikitext and HTML. I have not used github other than to look at Yapperbot. So if you want me to help get this bot restarted, I have a few questions:

(1) Where is the code that *calls* the bot?

(2) How can a bot be tested without changing Wikipedia pages? I saw the mention of test verification here, but it's not clear to me how that process worked.

(3) Are there any simple bots or simple test GoLang programs you suggest I play with before diving further into the Code? I am also reviewing [2] and read over Pike's post.

--David Tornheim (talk) 22:17, 18 February 2024 (UTC)

You definitely seem to have more than enough background :) I've never run a Wikipedia bot, but here's my interpretation:

1. The bot's entry point seems to be main.go. Bot calls aren't from Wikipedia; the bot operator runs the bot's code on their machine to monitor changes on Wikipedia.
2. See Help:Creating a bot § Testing. Basically do a dry run of your bot.

Aaron Liu (talk) 22:26, 18 February 2024 (UTC)

It was actually run from Toolforge, presumably via a crontab that ran "jsub main.go", although I don't have access to Toolforge so can't be 100% sure. * Pppery * _{it has begun...} 22:53, 18 February 2024 (UTC)

Since the bot inactivity coincided with the grid engine shutdown, that does seem likely. Aaron Liu (talk) 02:16, 19 February 2024 (UTC)

Pinging @Enterprisey: who might have advice. 𝗐♥, – SJ + 01:43, 19 February 2024 (UTC)

If I were you, I would apply for a ToolForge account. ToolForge is where Wikipedia bots are often hosted and set up to automatically run.

Once approved, use an FTP client to take a peek at the Yapperbot files. Toolforge files are usually public to other Toolforge users, unless set to Linux chmod 0600 or similar. The Yapperbot files are probably located at the path "/data/project/yapperbot" or similar. These may be more up-to-date than what is in GitHub repos, and may also include some configuration files that tell you how the cronjob worked (time interval, bash code to start the bot, etc.)

To set up your own bot or your fork of Yapperbot to use Toolforge cron jobs, you'll want to SSH in to your Toolforge account and then set up a "job". This is the new way to do Toolforge cron jobs. The help file is at wikitech:Help:Toolforge/Jobs framework. One of the old ways to do Toolforge cron jobs is the "grid engine", and this also happens to be why Yapperbot was shut down. The Toolforge sysadmins want to force upgrading to the jobs framework, so they are shutting down all bots still running on the grid engine, including Yapperbot.

How can a bot be tested without changing Wikipedia pages? Use https://test.wikipedia.org/ as a big sandbox, if needed. Those edits will go live on test.wikipedia.org, but won't hurt anything. Or see if the bot has a "dry run" option of some sort by reading its program code. –Novem Linguae (talk) 02:41, 19 February 2024 (UTC)

Thank you both for the advice. Will keep you posted on progress, or you can always ask if you are concerned. --David Tornheim (talk) 06:35, 20 February 2024 (UTC)

All the src and job-related files at /data/project/yapperbot/frs are protected, so we can't access them. – DreamRimmer (talk) 16:23, 20 February 2024 (UTC)

Hello @Legoktm. I hope you're doing well! Does Toolforge have a procedure for taking over an inactive account? Maybe the Yapperbot files chmod can be set to public, or David Tornheim and myself can be added as maintainers? Thanks a lot. Looking forward to your feedback. –Novem Linguae (talk) 17:01, 20 February 2024 (UTC)

See wikitech:Help:Toolforge/Abandoned tool policy. * Pppery * _{it has begun...} 17:09, 20 February 2024 (UTC)

Could we just have the responsibility for FRS be taken over by User:Legobot? It may be a big ask, but it would help with consolidation. Maybe a general purpose RfC bot might be in order. Awesome Aasim 20:36, 20 February 2024 (UTC)

Could we just have the responsibility for FRS be taken over by User:Legobot?

Based on my experience with Yapperbot, I would prefer it, because I believe Legobot's function was superior and met the specification better than the new implementation. I am also hoping that Legobot is documented. There was no real documentation for Yapperbot that I found, despite repeated asks.

Maybe a general purpose RfC bot might be in order. What do you mean? I don't know how others feel, but I wonder if it might be better to separate the RfC notification function from the GA notification function. I can't remember if Legobot did that or not. I can see how the functioning of GA and RfC notification might be similar, but it feels like these a significantly different tasks and priorities, and I would feel more comfortable if the code is separated for clarity and to avoid having any change to the code affect both or inadvertently affect the function we were not trying to correct. Is that what you mean?

Of course, getting the bot (either Legobot or Yapperbot) up and running--as it was--will be the first task! --David Tornheim (talk) 22:11, 20 February 2024 (UTC)

Legobot's FRS task when it ran had its own bugs, i.e Wikipedia talk:Feedback request service/Archive 1#Still receiving messages. Legoktm has never been interested in doing anything to this Legobot task other than fixing the most urgent bugs and occasionally deploying urgent code, and has wanted a new maintainer for years, which makes sense since it wasn't his code to begin with - he took it over from Chris G, who took it over from Harej.

I think Legobot's implementation doesn't have any better documentation, and it depended on a SQL database written by the Rfc list maintenance task, so it will be even more of a pain to resurrect whereas Yapperbot at least has the advantage of having no external dependencies. * Pppery * _{it has begun...} 01:15, 21 February 2024 (UTC)

@David Tornheim When I say a general purpose RfC bot may be in order, I mean that having one bot, maybe named User:RfC Bot, handle the tasks of RfC and RfC's FRS. For GAN we can have a different bot for that. I think having one bot for a single task will be a lot less likely to fail, depending on implementation, than one bot for 30 different tasks. Awesome Aasim 04:20, 21 February 2024 (UTC)

Do you have any evidence for that belief? Legobot failed at this because it's original operator abandoned it and Legoktm picked it up in order for the task not to die without a clear plan for long-term maintenance, not because the bot runs 30 other tasks. Counterexample AnomieBOT * Pppery * _{it has begun...} 04:47, 21 February 2024 (UTC)

As long as the code for each task is separable, running them through the same account does not provide much benefits. Aaron Liu (talk) 14:48, 21 February 2024 (UTC)

Back again

It appears Yapperbot has sprung back to life :) ‍—‍a smart kitten_[meow] 07:35, 21 February 2024 (UTC)

Indeed! --David Tornheim (talk) 08:23, 21 February 2024 (UTC)

and the world is saved! Aaron Liu (talk) 14:47, 21 February 2024 (UTC)

I assume the toolforge folks mass re-enabled bots that have been shut down during the Grid deprecation, but I don't see this in the timeline. Wikitech:News/Toolforge Grid Engine deprecation#Timeline. Bit of a mystery, eh? –Novem Linguae (talk) 15:48, 21 February 2024 (UTC)

@Novem Linguae: After looking at the phab link above (phab:T320195), I think Legoktm might have manually migrated the bot as an emergency measure. All the best, ‍—‍a smart kitten_[meow] 15:51, 21 February 2024 (UTC)

Hi! Yes, I got it working last night (well, it started working after I thought it wasn't and went to sleep). This was just a one-time emergency measure, it really needs a permanent maintainer. I'm happy to assist with getting people set up with Toolforge, etc. @David Tornheim do you have a Toolforge account? Would be best to set up a new tool and bot account for this and then we can work on transitioning.

We should set a 1 to 2 month deadline for a new maintainer to get set up (otherwise just turn it off again). Legoktm (talk) 19:05, 21 February 2024 (UTC)