Jump to content

Wikipedia talk:Growth Team features

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Ed Erhart (WMF) (talk | contribs) at 04:36, 16 February 2023 (Concerns about the Marketing Experiment: cmt). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Newcomer experience + new article creation

Hello @Kudpung, @Novem Linguae, @MB, @BusterD, @Sage (Wiki Ed), and anyone else interested in joining this discussion.  Thank you for spending the time to offer your perspective on newcomer onboarding! My name is Kirsten Stoller, and I’m the Growth team’s Product Manager.  @MMiller (WMF) asked that I follow up from the discussion related to the 2022 WMF letter regarding New pages patrol.

Clearly better newcomer onboarding is tied to the NPP work: newcomers who create articles without understanding the complexity of Wikipedia or even the fundamental principles of Wikipedia end up making considerable work for patrollers. My understanding is that you have ideas regarding how we onboard users who are set on creating new articles.    

I always try to make product decisions backed by data, so I was curious to know more about how many new articles are created by new editors. Obviously that answer depends on how you define “new editor,” but here’s at least some initial data I looked at:

On English Wikipedia, over the previous three months (August 1, 2022 - October 31, 2022):

  • 4,616 new articles were created by accounts that are less than 30 days old. 
  • About 2.78% of articles created during that time frame were from accounts less than 30 days old.
  • About 50 new articles are created each day from accounts that are less than 30 days old.

Are those numbers about what you expected?

Another interesting data point to consider, is that on English Wikipedia: about 25% of newcomers (who complete the welcome survey), say they created an account specifically to create a new Wikipedia article. In other words, about a quarter of newcomers are creating accounts with the immediate intention of creating an article.

As you likely already know, the Growth team has so far been focused on encouraging newcomers to try small edits rather than immediately create articles. All newcomers are encouraged to visit their homepage after creating an account. Currently, on the homepage, we try to funnel newcomers into learning some core skills about how the wikis work before they move on to larger tasks like article creation. In fact, we discourage newcomers from creating articles initially but also try to redirect them as needed if they are still focused on creating a new article. Part of the onboarding flow includes the following language:

To successfully create a new article, you'll need to use many of the skills you can learn through completing some easier tasks. To learn more about how to create a new article, click here.

From my perspective, I would like to see Growth team features continue to evolve and better meet users where they are.  So if a newcomer comes to Wikipedia determined to make an article, I think it would be ideal if we are providing them with the information and guidance they need, perhaps even provide a structured task for creating an article.

I’m excited to hear your input!  Keep in mind that the Growth team is in the middle of several projects that we need to wrap up before we consider starting a new project, so I can’t promise any immediate action on your ideas, but I can promise to listen and start to integrate these ideas into our long-term roadmap.

  • What newcomer onboarding or newcomer tools would best serve new users who are looking to create a new article? How might the newcomer homepage better handle these users?
  • What tools or processes would best serve new users who create a new article?
  • Are there any “quick win” ideas that you think we should consider immediately?

Thank you in advance for any ideas or guidance you share! KStoller-WMF (talk) 18:47, 17 November 2022 (UTC)[reply]

Hi Kirsten. Thanks for giving this some thought. It looks as if we're basically on the same page. The statics you provided paint even a more sombre picture than we thought although our anecdotal experience came fairly close. I have been closely following the development of your home page feature and mentoring project for a long time already. I have doubts that it would have a positive impact on the work of NPP by improving the quality of new articles from completely new users and reducing the submissions by them of inappropriate ones. Another interesting data point to consider, is that on English Wikipedia: about 25% of newcomers (who complete the welcome survey), say they created an account specifically to create a new Wikipedia article. In other words, about a quarter of newcomers are creating accounts with the immediate intention of creating an article - this is precisely the problem and it's exacerbated by the fact that probably as much as 50% or more of new articles nowadays are submitted by non-native speakers - something that data mining won't reveal but which the reviewers who spend hours at the new pages feed are critically aware of.
We have already done some preparatory work on this in anticipation of the bugs and new features being addressed for PageTriage that are overdue by many years. We have a 'quick win' solution that absolutely does not need any special programming. It's mainly basic html. php. and .js . Once I have a consensus from the NPP coords on the UI, it could be inserted into the newcomer UX flow quite soon before the NPP backlog grows again. I will be trying to find some time over the weekend to put together what you want to know and how we can integrate your work in our plans. I'll get back to you on Monday. Kudpung กุดผึ้ง (talk) 09:44, 18 November 2022 (UTC)[reply]
Thanks for the response, @Kudpung.
That's interesting regarding how many new articles on enwiki are submitted by non-native English speakers. It's good to have a variety of perspectives contributing to English Wikipedia, but I totally see how that creates additional work and complexity to review.
Thanks again for being willing to share your ideas! I look forward to hearing more about the newcomer flow you are envisioning. KStoller-WMF (talk) 00:33, 22 November 2022 (UTC)[reply]

Thoughts from BusterD. Echoing Kudpung's hearty thanks. We are happy to have your attention, Kirsten. We don't plan on going away. We have reasons to expect a spending increase for the next budgetary year. We hope through discussion we can demonstrate to the community WMF has addressing the flagship's valid and ongoing concerns as a high priority. We're not merely about building tools here. We're about building the connection with the Foundation and staff which leads and compliments the ongoing relationships with each of the pedias and associated projects. Early successes for this team are important. I'm sure our friend Kudpung will bring some needed detail.

I've been playing a bit with the newcomer experience tools. I had an observation (in the weeds a bit, I'll concede): If I was to choose the "create new article" option, I would (as a new user) need to know how essential it is to begin with reliable sources. I shouldn't be able to "publish" unless 1) I've first previewed and 2) in re-reading provided two or more autofilled citations (possibly created from bare links). Known sources might be flagged directly by quality from WP:RSNP red, yellow, green (maybe black for blacklisted). It should be possible to create a new page from the newcomer interface, but doing so should require accomplishments and the interface should educate as it gently impedes. BusterD (talk) 19:24, 20 November 2022 (UTC)[reply]

@BusterD - not in the weeds at all, thanks for bringing this up! This actually sounds very similar to something I've discussed with the Editing team recently. There has been a discussion about providing new editors with more "in the moment" direction, especially for core content guidelines like citing sources. I am definitely supportive of this line of thinking: ideally we are educating newcomers as they progress rather than retroactively reprimanding and reverting their edits (or deleting their articles) once they have made mistakes. Hopefully we can start to better meet newcomers where they are. There is a lot to do, but I see an approach like this being in the long term interest of onboarding newcomers while also hopefully lightening patroller burdens as well. Thanks for the feedback! KStoller-WMF (talk) 00:46, 22 November 2022 (UTC)[reply]
I would (as a new user) need to know how essential it is to begin with reliable sources. I shouldn't be able to "publish" unless 1) I've first previewed and 2) in re-reading provided two or more autofilled citations (possibly created from bare links). Known sources might be flagged directly by quality from WP:RSNP red, yellow, green (maybe black for blacklisted). It should be possible to create a new page from the newcomer interface, but doing so should require accomplishments and the interface should educate as it gently impedes.
hi @BusterD: this is a quick drop-by comment to express a hearty +1 to – what I understand to be – at the core of what you're expressing above: a way to provide people who are new with feedback that helps them to see/understand that the volunteers who will be reviewing the new content they're adding (be it via expanding an existing article or creating a new one) be accompanied by a reliable source.
Assuming the above matches up with what you were expressing above, then I wonder: would you be open to reading through the new project the mw:Editing Team is working on and letting me know whether you think it could help address the issues you're raising here?
Also, hi! I'm Peter. I work as the Product Manager for the Editing Team 👋🏼
And thank you to @KStoller-WMF for making me aware of the conversation y'all are having here ^ _ ^ PPelberg (WMF) (talk) 19:36, 1 December 2022 (UTC)[reply]
Give me a bit to process the link you've provided. A heads up: I noticed this tool yesterday and it looked like a move in the right direction. BusterD (talk) 20:27, 1 December 2022 (UTC)[reply]
I see I'm behind a bit, not noticing CiteHighlighter by good Novem Linguae. So long as we have a system for "greenlighting" sources by reliability, this may tend to provide encouragement to new contributors trying to do the right thing. My initial take is that this project work looks in line with my hopes, and is targeting an important and obvious new user target population. We might develop a (somewhat linear, or option limited, perhaps like a checklist) way of writing what is essentially a secondary school term paper, my outcome expectation of a successful first page creation: has RS, has a Wikipeda-like structure (lead, body sections, citation, supplemental media, categories), and passes self-acceptance tests (Does is look like a Wikipedia article? Is the attempt a basic satisfactory coverage of the subject? Does it conflict with other similar articles?). If the new page satisfies the new contributor's desire to create a page and looks likely to weather an initial NPP, the new contributor may succeed on the first try. Initial success (or at least strong positive feedback) is crucial to building new connection, no matter the language or region served. BusterD (talk) 21:12, 1 December 2022 (UTC)[reply]
User:Headbomb/unreliable: neat! This is the first time I'm seeing the script @Headbomb wrote. Thank you for sharing it, @BusterD. I've documented it on the project page.
My initial take is that this project work looks in line with my hopes, and is targeting an important and obvious new user target population.
I'm encouraged to hear the project initially reads to you as such.
We might develop a (somewhat linear, or option limited, perhaps like a checklist) way of writing what is essentially a secondary school term paper...
While we're still exploring options for the feature's user experience, the Editing Team share's what [I think] is at the core of what you're describing above: for this experience to be integrated within the editing workflow itself, rather than some set of instructions that sit outside of it that are susceptible to people ignoring them.
...my outcome expectation of a successful first page creation: has RS, has a Wikipeda-like structure (lead, body sections, citation, supplemental media, categories), and passes self-acceptance tests (Does is look like a Wikipedia article? Is the attempt a basic satisfactory coverage of the subject? Does it conflict with other similar articles?).
Knowing the kinds of questions you ask yourself when reviewing new articles is helpful considering the project will be for naught if the experience isn't causing people to make contributions that align with the expectations you, and other patrollers, have in mind when reviewing them.
A question related to this last point...
Let's say you were reviewing a new article a newcomer had written or an existing article that they had contributed some amount of new content to (e.g. a new section), but they neglected to accompany with references. Can you imagine any pieces of information that might help you evaluate this newcomers' intent? I ask this question with the following thought in my mind: "Might more experienced volunteers invest a bit more energy/effort into helping out someone who is attempting to add new content to the wiki if they could say, with some certainty, that this newcomer was attempting to do so in good faith?" PPelberg (WMF) (talk) 00:44, 3 December 2022 (UTC)[reply]
Your question is essential for each of us to ponder, so we can experience our own reaction to it. As it turns out, I had an experience along these lines: last year I noticed a relatively new contributor creating new team season pages, like the ones I sometimes create to support NCAA women's basketball teams. Such new pages are often rather involved; when I build one it might take me more than an hour of steady work. My objection to the new contributor's efforts was that the pages lacked at least one RS, though they may otherwise be fully formed. After consulting with other editors, I came to the conclusion that the effort the contributor was making was totally worth my effort in adding a few RSs. If that's all I have to do to save the page, I thought, I'm not going to object unduly to these incomplete efforts. In these cases, I could count myself fortunate that I didn't spend 50 or so hours, if all I needed to do was watch the user's contribs. BusterD (talk) 01:10, 3 December 2022 (UTC)[reply]
It occurred to me that the assistance we want to give might be conveyed as helping the new user ascend a mountain. Creating a new page should be difficult, or at least demanding, or everyone would do it. Many have tried and some have succeeded. "Will you climb this mountain?" The wizard/sherpa must make clear the new user's mere willingness to make the climb does not guarantee success (without willingness to take certain enumerated steps). While the flow chart our Kudpung improves is a useful guide, what I'm envisioning is more like a pyramid, with most minimum required coverage for publication as the foundation: multiple cites from rs, categories, structure, incoming links. The creation pyramid seems counter-intuitive but in creating a new page, we've got to start with foundation, anchored in reality and connection. We're striving to keep the chaos out so to speak, and each step in creation has to be more elevated than the last. The sherpa does not climb the mountain for us; it merely puts us close to our objective, points out risks and foibles, and appears interested in our success. The steps are ours to take. "Will you climb this mountain?" When at last we've summarized the article we've written and thus created our introduction, we're ready to publish. BusterD (talk) 04:39, 4 December 2022 (UTC)[reply]
@BusterD: I appreciate you sharing this story with me and I'm sorry you haven't heard a response from me sooner!
A follow up question related to it...
It sounds the decision you made to save the page and invest some of your own time into improving it was – to some extent – a result of you being knowledgable about/interested in the content of the article you were reviewing.
Assuming the above to be accurate, let's assume you encounter a new article about a topic you are learning about for the first time in that moment who is written by someone you have not yet seen/interacted with before on-wiki...
What questions might you ask yourself when deciding whether to delete the article or keep it?
RE the pyramid metaphor you shared, I agree with you in thinking that it's important that the workflow(s) for creating a new article equip newcomers with the information they need to know what will be expected of them/the content they're writing in order for the volunteers who will be reviewing that article to find it worthy of being published in the main namespace PPelberg (WMF) (talk) 22:46, 22 December 2022 (UTC)[reply]
Page process flow chart
  • Hi Kirsten and @Trialpears, Clovermoss, BusterD, Blaze Wolf, Pppery, MB, and Novem Linguae: (inadevertently place this post in the wrong section) the editor who was probably mostly concerned with adopting users is Worm That Turned but who later shifted the focus of his work to address other Wikipedia issues. He has an exceptional skill in mentorships and conduct problems and there's probably a lot of tips he could offer based on his experience.
While I believe the Growth team's director(s) correctly identified the need for improved onboarding of new users and obtained significant funds for it, their strengths might not necessarily be in UX and the best GUI design for it and they didn't think at the time to tap in to the wealth of experience with new users by admins such as WTT (adoptions), and Nick Moyes at the Teahouse, and the veteran and/or prolific members of the NPP team like Onel5969, some of whom who, like myself, have been patrolling new pages since long before the special tools were created for it 11 years ago.
I'm a bit behind with my work at the moment because the weekend had to be dedicated to issues in RL, but I'll get back to you asap with our suggestions for a special landing page for those who are determined to submit an article as their first participation plus a truly inter-active Article Wizard that we're working on. These pages which are based on our solid anecdotal experience together with Growth's statistics, will complement the work of Growth's current project, enhance user retention in addition to onboarding, and address the concerns brought up by others here. Kudpung กุดผึ้ง (talk) 02:12, 22 November 2022 (UTC)[reply]
Thanks, @Kudpung, I look forward to hearing more about your suggestions for a special landing page for newcomers intent on submitting a new article. I certainly agree there is a lot more we could and should do to improve newcomer onboarding! KStoller-WMF (talk) 01:01, 1 December 2022 (UTC)[reply]
Hi Kirsten (and @MB, BusterD, MB, and Novem Linguae: ), we've all been tied up recently with other aspects of our volunteer work on Wikiedia but of course the onboarding of new users who want to create articles is a top priority. We will get back to you in the next day or two with a suggestion for a date and time for a video chat with the four of us from NPP and anyone whom you would like to bring along from your team. For this first meeting we would like to outline our suggestions and get from you a scope and time frame for possible development as soon as you're able to find banddwidth for it. Kudpung กุดผึ้ง (talk) 01:39, 1 December 2022 (UTC)[reply]
I like this flowchart. Can you perhaps create an annotated version with durations of each step, because I think a lot of ppl don't really understand how long some of these various steps (can) take. It would be good educational material for UX designers etc as well. —TheDJ (talkcontribs) 15:55, 1 December 2022 (UTC)[reply]
HI TheDJ and Kirsten, I don't think that's easily done or would be useful - there are too many variables, and the flow chart only really depicts what has supposed to be being done for years. It's not meant for a lot of people, only those who will be on the conception and realisation for the improvement or rebuilding of the features needed for those steps to perform correctly. I made it some months ago in anticipation of obtaining the WMF's cooperation on these isse, which we now have, and to depict the processes on on en.Wiki with which they are not familiar. It's a talking plan. You know yourself how long those steps take and your input would be most welcome.
I don't think it's our task to educate the UX designers. A good project for the elements of an interactive website (or a video-based instruction manual for using a machine or a process, for example) has a team of people each with their established skill. They start with a story, then a storyboard (in this case, the flow chart). The people include concept designers, an art director, graphic designers, experts in human communication, and finally for websites, the FE and BE coders who make it all work. It's rare for coders to embody all those skills, some of which are talents, and the WMF teams don't appear to have staff for those specific specialisations and that's why working together with the volunteers is essential - some of those skills are our daytime jobs in RL.
What the readers of Wikipedia see is one thing; one of the features that's glaringly missing from Wikipedia is a set of colourful, visually appealing ('in the moment' = interactive) instructions that encourage editors to read them and use them. People click rapidly away from grey walls of text. And that's what's fundamentally wrong with pages like Help:Your first article and what makes for hard and boring work for NPP and AfC. Kudpung กุดผึ้ง (talk) 03:52, 2 December 2022 (UTC)[reply]

Meeting details

PS: Kirsten, would you like to suggest a date and time very soon for a video meeting between our lead NPP coordinators and BusterD and me with you and your team? But please no more conferences in the middle of the night ;) Kudpung กุดผึ้ง (talk) 03:59, 2 December 2022 (UTC)[reply]

@Kudpung: Is there any way I could join? I'm curious even if I'm not sure I'd have more revelant thoughts than people who are more invested in NPP than I am. Feel free to email me details if it's not something that's been discussed on-wiki. I don't mind being a part of something like a video call, though. :) It's okay if I'm not able to be a part of it, either. I'd understand. Clovermoss🍀 (talk) 08:53, 2 December 2022 (UTC)[reply]
@Kudpung I’m available to meet and looking forward to hearing the NPP ideas around this topic. I’ll include @MMiller (WMF) and at least one Growth team engineer in the discussion. Perhaps @Sage (Wiki Ed), @TheDJ, @Nick Moyes, and @Clovermoss can attend if they are interested and available so we hear more perspectives.
Just so we all have clear expectations going into the meeting: I won’t be able to commit to anything during our meeting. The Growth team currently has plans for the coming months based on input from many different wikis and commitments to improve several of the things we’ve already rolled out. But we are all agreed that new article creation is an important part of the newcomer experience, and so I am committed to listening and learning so that we can figure out how the Growth team might address that aspect in the future.
Would next Thursday, December 8th or Friday, December 9th work for a meeting? I imagine we have quite a few time zones and schedules to accommodate. I'm Pacific Time Zone based, but happy to meet outside normal business hours if that helps. KStoller-WMF (talk) 00:20, 3 December 2022 (UTC)[reply]
@KStoller-WMF: For what it's worth, my real life schedule is kind of chaotic (I work nights sometimes) and I'm way more open to something in the middle of the night than others might otherwise be. I can sleep during the day just fine :) What I'm saying is that I'm more willing to compromise if that makes it easier. I'm definitely interested if I'm able to be a part of this. Clovermoss🍀 (talk) 00:46, 3 December 2022 (UTC)[reply]
@KStoller-WMF, MB, BusterD, MB, Novem Linguae, and Clovermoss: this website has an excellent free planner for setting up cross-timezone meetings. I am in Southeast Asia 'Bangkok' zone which covers most of Indochina, Malaysia & Singapore at UTC+7 when I'm available during my daytime and early evening. Kudpung กุดผึ้ง (talk) 01:00, 3 December 2022 (UTC)[reply]
I'm UTC-5, but again, more flexible in regards to when. Just need to know a little bit ahead of time. Clovermoss🍀 (talk) 01:07, 3 December 2022 (UTC)[reply]
I'm UTC-6, living in Northern Illinois. I'm available afternoons and early evenings, working late evenings, but might also be available in the pre-dawn morning before I sack out. BusterD (talk) 01:17, 3 December 2022 (UTC)[reply]
@Kudpung @Clovermoss @BusterD, @MB, @BusterD, @Novem Linguae I'll still need to check to ensure a Growth engineer can attend, but I'm thinking that Friday, December 9, 2022 at 01:00:00 UTC might be a decent compromise for most of us (that's Thursday evening for those of us in the US).
I'll re-read the NPP letter and talk page and watch the previous meeting recording, so I have more background context and we can focus entirely on the newcomer experience discussion. Like I said, I won't be able to make any commitments during the meeting, but I am excited to listen and learn from you all and start to figure out how the Growth team can improve the experience of newcomers who come to the wikis interested primarily in article creation.
For attendees, I plan to invite Marshall and a Growth Engineer, and leave this meeting open to whoever else you all want to invite.
As for an agenda, I'm really open to whatever works for you all, but I was thinking we could do some quick intros and then leave the rest of the meeting for you all to share your ideas. However, I'm certainly happy to do a quick demo of current Growth features to start us off if that's helpful. KStoller-WMF (talk) 19:23, 3 December 2022 (UTC)[reply]
This sounds very good to me. I'm very likely to participate at the suggested date and time. We appreciate your facilitation, Kirsten. BusterD (talk) 19:37, 3 December 2022 (UTC)[reply]
I'm also good with that time. Thanks Kirsten! Clovermoss🍀 (talk) 23:33, 3 December 2022 (UTC)[reply]
Works for me. Kudpung กุดผึ้ง (talk) 01:16, 4 December 2022 (UTC)[reply]
@Kudpung @BusterD, @MB, @Novem Linguae, @Clovermoss, @Sdkb,
Here are the meeting details, I'm looking forward to meeting you all and hearing your ideas!
Growth + NPP: Newcomer experience meeting:
Meeting purpose:
A conversation with WMF Growth team representatives and English Wikimedians (mainly NPP representatives) regarding the newcomer experience for users who come to the wikis primarily to create an article.
Background information to review prior to meeting:
Meeting agenda:
  • Introductions
  • Growth team representative briefly demos the current newcomer experience. (We can keep this very brief, but I think it’s important to ensure we all know what the current newcomer experience is before we discuss improvements).
  • NPP representatives to share their ideas for improving the newcomer experience for users set on article creation.
  • Questions & answers
Setting expectations:
  • I will record this meeting and post on Commons after the meeting, for those of you who are interested but unavailable at this time.
  • I won’t be able to commit the Growth team to any feature work or projects during our meeting. But we are all agreed that new article creation is an important part of the newcomer experience, and so I am committed to listening and learning so that we can figure out how the Growth team might address that aspect in the future.
  • I want to be sure we cover everything the NPP team wants to review, but this meeting might also be of interest for others who think extensively on helping newcomers, so @Sage (Wiki Ed), @TheDJ, @Nick Moyes please feel free to join us if you are interested.
KStoller-WMF (talk) 19:41, 6 December 2022 (UTC)[reply]
Thanks! I'm planning to attend. Sage (Wiki Ed) (talk) 20:33, 6 December 2022 (UTC)[reply]

File:En.Wiki growth of pages.png

Thanks for the reminder about it being a Thursday for me. I should be there and I'll be sure to review all the background information beforehand. My own participation will likely be limited but I'm interested in observing and thinking about the potential impacts to newcomers. Nick Moyes, if you're able to attend, this would be a great opportunity to connect a face to the username :) Clovermoss🍀 (talk) 20:58, 6 December 2022 (UTC)[reply]
  • (I've only briefly skimmed the discussion above beyond the opening post, so apologies if my thoughts are redundant) @KStoller-WMF: Thanks for asking about this! To break down your question, there are two groups of users who might arrive here determined to create an article: those who want to create one on a suitable/notable topic and those who do not.
    The latter group makes up a sizable portion — AfC likely has some stats on how many submissions there are ultimately declined, and some portion of the 50 articles created each day by autoconfirmed-but-not-extended-confirmed get flagged for deletion by NPP. For people in that group, we could try to divert them to other tasks, but that's unlikely to work often, given that the rejection is likely to create sour feelings. So realistically, the best thing to do for that group is to offer a friendly push out the door as quickly as possible, freeing up experienced editor resources elsewhere. People are less likely to get angry if the decline is made early rather than after they've put a ton of effort into the draft/article, so one practical takeaway is that notability ought to be introduced early on — if they can't pass it, then there's no point going further.
    For the group of newcomers who are writing about a notable topic, the problem then becomes that writing a brand new article is one of the hardest tasks on Wikipedia, and our current massively long guidance is woefully ill-equipped to help them through it. I've thought a fair amount about what a structured task for creating an article would look like, and my thoughts are compiled at User:Sdkb/sandbox/Vision for a better Article Wizard. Please feel free to look it over and let me know what you think! It describes a pretty advanced system, which would take a lot of effort to design, but I think if the Growth team really wants to make article creation a feasible task for newcomers it'll need to provide something like this.
    I'd be happy to join the call being discussed above if it ends up being at a time I'm free; please keep me in the loop! Cheers, {{u|Sdkb}}talk 01:02, 4 December 2022 (UTC)[reply]

@KStoller-WMF, MB, BusterD, MB, and Clovermoss: I think Sdkb's suggestions in their sandbox page are excellent and by coincidence they put into words in almost 90% detail of what I have envisioned. It should be read before the meeting. Their formula involves a lot more technology than I have been proposing with the NPP coordination team but would be ideal if Growth could make bandwidth for it when they apply for engineering funds. From meetings we have had with the WMF and other discussions, Novem Linguae has put together a summary at User:Novem Linguae/Drafts/New landing page proposal which I think every one should also read before the meeting.

The main features around my proposal are:

  1. the suggestion for a landing page for users who are determined to to create an article (see flowchart)
  2. A wizard that will prevent continuing to the next step if the previous step has not been correctly accomplished (with a focus of providing sources), and offering the creator a choice of thematic templates which exist already.

With the combination of Sdkb's and my suggestions and those of other veteran New Page Patrollers together with the ideas and technology from the Growth Team, I think we would achieve an enduring solution.

The focus of the upcoming meeting should be on this and not be confused with possible improvements to Growth's user home page/mentorship project which is an entirely different discussion but on which our UX experts and GUI designers would be happy to provide input.

I'm sure Sdkb would be most welcome to attend Friday's meeting. I'm looking forward to it. Kudpung กุดผึ้ง (talk) 04:01, 4 December 2022 (UTC)[reply]

@Kudpung Thank you for the links and additional context. I'll read through those ideas prior to our meeting.
I agree that the meeting should be fully focused on how to improve onboarding for newcomers determined to create an article. I was suggesting a Growth feature demo in case we want to discuss the basics of how all of these ideas fit together. My assumption is that we could use welcome survey responses to help determine how we personalize onboarding. Like I mentioned previously, on English Wikipedia: about 25% of newcomers (who complete the welcome survey), say they created an account specifically to create a new Wikipedia article.
I'm looking forward to chatting with you all synchronously! I'll send out a meeting invite tomorrow and include @Sdkb as well. Thanks all! KStoller-WMF (talk) 05:00, 6 December 2022 (UTC)[reply]

Developments discussed at Wikipedia talk:WikiProject Guild of Copy Editors#ChatGPT promise us that we're all soon obsolete if OpenAI can help us with copyediting... Could be a useful addition to our users' toolset. BusterD (talk) 23:19, 4 December 2022 (UTC)[reply]

Post meeting

  • @KStoller-WMF, MB, BusterD, MB, Clovermoss, Sage (Wiki Ed), and DannyH (WMF): and everyone else who was present, on behalf of the NPP team thank you all so much for such a productive first meeting. I just want you to be sure again that my being logged in under my company Google account was 100% unintentional - I don't have a personal Google account and I thought it would be like Zoom or Whereby. Unfortunately if you've ever used Google once it sticks everywhere. Although from different perspectives, we are certainly agreed on the general principle of inserting a secondary landing page for new users who want to create an article, and the need for an interactive wizard. Perhaps I should have said 'mockup' instead of 'wire frame', but although I am not from an engineering background I've been saying 'wireframe' in a web design UX context for nearly 25 years. For a next meeting I think it would be great to be able to pool our 'mockups' for a wizard and a landing page and screenshare them. The next phase would be to see if a such a concept would be technically realisable within the constraints of Product & Engineering's plans. To recap, my redraft of Your first article is at User:Kudpung/YFA - the possibilities are endless but it needs to be a distinct departure from Wikipedia's traditional monochrome walls of tl;dr text. If anyone wants to adapt my page process flowchart for use with this project I will gladly email a copy of the apple .pages original to save making the whole thing again or something similar. Kudpung กุดผึ้ง (talk) 03:38, 9 December 2022 (UTC)[reply]
My apologies, I forgot to include Sdkb in the pings. Kudpung กุดผึ้ง (talk) 07:50, 9 December 2022 (UTC)[reply]
  • I'm very limited in what I could say from a technical perspective but I will say I found this meeting to be informative and I look forward to engaging in future ones. It was nice to meet everyone! Clovermoss🍀 (talk) 03:42, 9 December 2022 (UTC)[reply]
    It was great to meet all of you who attended the meeting, and I truly appreciate you all taking the time to pass along your ideas! Here is the recording.
    For next steps for me:
    - I'll create a "Potential Project" page at: https://www.mediawiki.org/wiki/Growth
    - I'll continue to listen to ideas and chime in on discussions if I'm pinged
    - I'll set up a meeting for us to have another discussion in January
    - I'll chat more with Growth team members about ideas, and consider which other stakeholders we should consult with
    - I'll see how this work might potentially fit into current or upcoming research projects
    Once again, it was great to hear your ideas and see how much support there is for improving onboarding for newcomers! But just to make sure I'm managing expectations: I still can't guarantee this project fits into our next annual plan. There are a lot of competing great ideas, and I'll need to spend time evaluating ideas and the likely impact and effort of various projects. That all being said, I certainly see this as a project that makes sense and fits with Growth team objectives. I look forward to continuing to partner with you all to further refine the ideas and scope of this project, and I truly hope this is something the Growth team can move forward with in the future.
    Should I schedule our next discussion? Does 1:00am UTC Friday, January 20, 2023 work? KStoller-WMF (talk) 19:01, 9 December 2022 (UTC)[reply]
    The date and time you suggested would work fine for me. Thanks for driving this. BusterD (talk) 19:18, 9 December 2022 (UTC)[reply]
    It's fine for me as well. Clovermoss🍀 (talk) 19:30, 11 December 2022 (UTC)[reply]

Second meeting

@Sdkb, MB, BusterD, Clovermoss, Sage (Wiki Ed), @Kudpung,

For those of you who would like to meet again, I've set up a meeting next month:

1:00am UTC Friday, January 20, 2023 (that's the evening of Thursday, January 19 for people in the US)

Meeting link (link updated)

It's easiest for me to set these up via Google Meet, but I can host on a different platform if someone prefers Zoom or Jitsi. If you want a calendar invite via email, just send me an email and I'll send you an invite.

Here's my initial attempt to document this project idea in a newcomer-focused way that fits how our team generally approaches projects: https://www.mediawiki.org/wiki/Growth/Article_creation_for_new_editors

Thanks again for spending the time to share your initial thoughts! KStoller-WMF (talk) 23:36, 14 December 2022 (UTC)[reply]

Hi Kirsten, Due to commitments in RL I cannot say for sure what my plans are so far in the future, but I'll earmark the date. On another note, Jitsi appears to be the preferred conference software by your colleagues in the WMF and it works fine. For the reasons stated, I prefer not to be associated with Goggle which tracks everything you do, and I don't want to create a personal Google account for the meeting. Kudpung กุดผึ้ง (talk) 23:57, 14 December 2022 (UTC)[reply]
@KStoller-WMF: Just for the record, I'm actually Canadian. But the American timing given still applies to me. I've never used Jitsi, but I'm okay with learning new video conferencing software if other editors would prefer to use it. That's how I felt using Google Meets the last time, afterall. I am much more familar with Zoom, though. Clovermoss🍀 (talk) 01:56, 15 December 2022 (UTC)[reply]
@Kudpung OK, I've updated the link to Jitsi. Meeting link
@Clovermoss Sorry, I should have said those of us in North America. I'm also totally new to Jitsi, but I know it's preferred by many Wikimedians and WMF employees since it's open source, so let's see how it goes. KStoller-WMF (talk) 22:30, 15 December 2022 (UTC)[reply]

Reminder about upcoming meeting

User:KStoller-WMF has previously set up a meeting on Jitsi for this week.

1:00am UTC Friday, January 20, 2023 (that's this Thursday, January 19 for folks here in the US)

Meeting link (link updated)

BusterD (talk) 22:20, 16 January 2023 (UTC)[reply]

Sending out a few pings: @Sage (Wiki Ed), @TheDJ, @Nick Moyes, @MB, @Clovermoss, @Sdkb, @SmokeyJoe, @Atsme, @theleekycauldron

Further reading: Wikipedia:New pages patrol/New landing page proposal

Planning to attend

It may be helpful if we had some idea how large the meeting would be so I've provided a space so we can assemble this week's posse. A smaller group moves more quickly but a larger one provides more input and transparency. Be aware: we record. BusterD (talk) 22:40, 16 January 2023 (UTC)[reply]

  1. BusterD (talk) 22:40, 16 January 2023 (UTC)[reply]
  2. Novem Linguae (talk) 01:39, 17 January 2023 (UTC)[reply]
  3. KStoller-WMF (talk) 17:52, 17 January 2023 (UTC)[reply]
  4. I'm a probably. Barkeep49 (talk) 18:06, 17 January 2023 (UTC)[reply]
  5. Unless something unexpected comes up. Atsme 💬 📧 11:40, 18 January 2023 (UTC)[reply]
  6. I plan to be there again. I look forward to seeing the new participants :) Clovermoss🍀 (talk) 17:46, 18 January 2023 (UTC)[reply]

Not attending

  1. D'oh. Panini! 🥪 14:29, 18 January 2023 (UTC)[reply]

Draft agenda?

Has somebody already been thinking about this so the meeting is useful to all? I've been asked to help so I'm initiating this discussion. We may be starting without much prior workproduct. Kudpung would prefer we don't wp:refund his drafts.

What might we plan to accomplish/discuss this month? (besides continuity) BusterD (talk) 22:40, 16 January 2023 (UTC)[reply]

Thanks @BusterD for the reminder and for getting us organized!
You all are welcome to use this time however you prefer. I'll be there to listen to feedback and ideas. Ideally we can maintain a focus on onboarding newcomers as it relates to article creation (upcoming PageTriage work will be handled by Moderator Tools team, not the Growth team).
If you want, I'm happy to speak to the potential project I added here: https://www.mediawiki.org/wiki/Growth/Article_creation_for_new_editors. KStoller-WMF (talk) 17:51, 17 January 2023 (UTC)[reply]
I second the thanks, and will add a bit more. *As it relates to NPP, and based on prior meetings with WMF, I think Novem Linguae has a good handle on the technical aspects of reviewing, and what needs to be done. It would be much appreciated if he could list what he has in mind so we are not duplicating anything. I am also of the mind that all other aspects of NPP are dependent on decisions by our community and its highly influential administrators who are the ones making final decisions about content. If we have experienced/trained NPP reviewers making decisions about new articles, after they properly conducted a BEFORE exercise, it is rather frustrating when an admin denies a speedy or PROD, and have not done BEFORE and/or are not article creators and/or want to include everything thinking a half-baked article will be magically fixed over time. The latter happens quite often, and I would imagine represents a very high percentage of the cases. NPP should be able to organize a system that allows a qualified group of NPP reviewers to make the final determination in those cases rather than leaving it in the hands of a single admin or AfD. It would save so much time and angst at AfD (and burnout at NPP), the former of which is (a) problematic because it's a hit and miss situation depending on who shows up (including socks & meat puppets), (b) AfD also suffers backlogs and can be a frustrating time sink, and (c) we are dependent on AfDs being closed by someone who may or may not be qualified to do so. To me, it makes no sense when there are much better alternatives. I have requested stats on how many speedies have been turned down by admins, and passed at AfD or were actually deleted. Maybe that is something we can ask for at this meeting. I would also like to know how many unsourced articles remain in the WP corpus of articles, and how many bad articles were kept after an AfD and eventually deleted. Just my 2¢ worth. Atsme 💬 📧 11:40, 18 January 2023 (UTC)[reply]
@Atsme It seems like your thoughts above primarily relate to the patrolling process, rather than new editor article creation guidance. I'd be interested in discussing further over at the Moderator Tools project talk page! Samwalton9 (WMF) (talk) 14:05, 18 January 2023 (UTC)[reply]
My apologies, Sam. I was not paying attention to the url, and incorrectly assumed that with mention of Kudpung, this discussion was about NPP. I won't add another project to your plate while this one is still open, so ping me later if you so desire – ideally when you have more time to focus on patrolling. Atsme 💬 📧 15:09, 18 January 2023 (UTC)[reply]
No worries @Atsme! My team does want to learn about the difficulties folks have with patrolling so happy to discuss over at the linked talk page :) Samwalton9 (WMF) (talk) 15:17, 18 January 2023 (UTC)[reply]

Meeting #2 thoughts by Novem Linguae

Before I forget, here are some notes from the meeting...

  • Attendees
    • Barkeep
    • Enterprisey
    • Novem
    • BusterD
    • Clovermoss
    • Tgr (WMF)
    • KStoller (WMF)
    • DannyH (WMF)
  • Summary
    • Sentiment that your first article and/or the article wizard are too dense/too long. Perhaps we should focus some resources on re-writing those in a more condensed manner.
    • Sentiment that 3 good sources should be the base of any article (WP:GNG), and that this should be baked into any kind of wizard or tool we provide.
    • Growth Team interested in making tools that can be used by all wikis, not just enwiki.
  • Possible action items
    • Schedule next meeting (sentiment that current 5PM USA Pacific meeting time is good)
    • Consider scheduling these meetings on a regular basis, such as every two months.
    • Sdkb's page was well-liked and well-received in the meeting. BusterD and Sdkb should chat in detail about it.
    • (this is Novem's opinion) Keeping in mind that the Growth Team's time is valuable and that one of the main things they can do for us is create wiki software, perhaps for the next meeting we should try to (in advance) have a concrete plan for what software we want to ask them to build.
    • Each meeting should have a clearly articulated goal/focus. Onwiki preparation (brainstorming, discussing ideas) should be done on wiki talk pages before the meeting, in order to arrive at more concrete proposals to present in the meeting.
    • Enterprisey's comment that sharing images of prototypes/wireframes in these kinds of meetings promotes a lot of discussion is a good one. We should try to come up with a visual prototype of some kind, so that we can focus the meetings a bit more.
    • Enterprisey mentioned that he might do an image of a prototype/wireframe for the next meeting. Perhaps him and BusterD should chat a bit about that.
    • Jitsu software wasn't great. Buster's text chat was unreadable due to some kind of Jitsu bug. Consider different video conference software.

Novem Linguae (talk) 02:16, 20 January 2023 (UTC)[reply]

I think that's a fair summary but could I add as a possible action item to have a goal/focus for the meetings? This could also let people who maybe can';t make it give some thoughts ahead of time that those who can could discuss. Best, Barkeep49 (talk) 02:51, 20 January 2023 (UTC)[reply]
I think that would be a good idea to have a goal/focus for the meetings. Same for the thoughts ahead of time. For all the downsides of text-only communication (like tone of voice), one of the advantages is that it gives people time to consider what they're going to say. I think I tend to actually express myself better through writing a lot of the time.
I find that I feel uncomfortable staring into a camera for long periods of time and fidgety. I also think it's easy for me to get into the mentality of it's like a regular conversation and I don't want to interupt people who are trying to share their thoughts, so I think I'm going to try voice next time to give more time to others because I think that'd work better. I can focus more on what I want to say, what others are saying, and just feel more put together. Clovermoss🍀 (talk) 03:24, 20 January 2023 (UTC)[reply]
I agree. I think we should try to do brainstorming ahead of time on these talk pages, etc, and then we can arrive at these meetings with concrete proposals. I'll add a bullet. –Novem Linguae (talk) 03:24, 20 January 2023 (UTC)[reply]
Thank you for the notes, @Novem Linguae! This is especially helpful since I've discovered that only 8 minutes of our meeting was actually recorded yesterday. I'm happy to share that if people are interested, but it's certainly not a very helpful overview of the meeting. The Jitsi UI indicated the recording restarted after it was stopped, but for some reason it never saved to my computer. Sorry about that! In other words, I'm definitely in support of that last bullet point to use a different video conference software next time!
Most of my notes duplicated the notes above, but here are a few more ideas (mentioned by others) that I jotted down:
  • We shouldn’t necessarily limit ourselves to text-based solutions for onboarding newcomers.
  • The Vision for a better Article Wizard is a sizable project, is there a smaller change or MVP we could consider as a start?
  • Some sort of "Start an article" page could be a good place to link to in the new Contribution menu.
And a few things I wanted to mention:
  • I still can't make any commitments to what the Growth team will work on next fiscal year. I just want to be clear that I'm excited by the ideas and thoughts shared so far, but the Growth team will need to prioritize a lot of good ideas along with WMF annual planning priorities, so I can't yet make any promises. BUT now is a really great time to have these discussions, as we are starting to plan for the next fiscal year.
  • I think it's great to brainstorm some bigger project ideas about improving newcomer onboarding about Article creation, but ideally we can also brainstorm some smaller wins or MVPs as well. For example, here's a task @Tgr (WMF) added after our meeting yesterday: T327464. I wonder if something like that (perhaps with some sort of community configurable notability requirement around providing references up front) could be a step in the right direction. The page could then evolve to include more functionality over time. Let us know here or in the Phabricator ticket if you have thoughts on that idea.
And please let me know if I can help with setting an agenda and focus for the next meeting. Do we want to consider splitting the meeting so that the Growth team can share and ask for feedback on some ideas for ~20 minutes of the meeting, and then you all can lead the topics and discussion for ~30 minutes of the meeting? (With the assumption that we'll need ~10 minutes for intros and wrap up).
Thanks again to everyone who joined the meeting, I've really enjoyed meeting you all and hearing the excitement around these project ideas!  :) KStoller-WMF (talk) 23:56, 20 January 2023 (UTC)[reply]
One thing that should be easy enough to plan first is what video conferencing software we should use next time as we all seem to agree Jitsi didn't really work out that well. Clovermoss🍀 (talk) 21:02, 22 January 2023 (UTC)[reply]
It's easiest for me to schedule via Google Meet, but I can schedule via Zoom if that's preferred by the rest of the group.
I've also asked Growth's program manager to attend next meeting, as she's fantastically organized and can help facilitate and keep us focused on the agenda. KStoller-WMF (talk) 03:42, 24 January 2023 (UTC)[reply]
@KStoller-WMF, good question about the MVP. I think one option might be to start with just step 4, the three sources. I say that both because it's fairly isolatable and because sourcing concerns are probably the single most common reason for AfC declines. Incorporating that step into the existing article wizard would ideally result in some immediate improvements, but I'm not sure how much it'd tell us about the other steps or the holistic experience of newcomers looking to create an article, as their frustrations may then just be displaced to the other areas still unaddressed. To get a sense of that, all the steps would need to be built. For that, it would be possible to limit the scope slightly by limiting the article topics initially available.
One thing to note is that I think it's important that step 7's advice panels have community buy-in when that feature launches. TemplateData is a cautionary tale here: It launched too soon, lacking essential features like the ability to wikilink in parameter descriptions, and as a result, it failed to become the go-to central repository of its domain (template documentation). We'd want these advice panels to become the go-to place for wikiprojects to concisely record their best practices for each section, so they'd need to work well enough to be a desirable place to put that info. Cheers, {{u|Sdkb}}talk 04:48, 24 January 2023 (UTC)[reply]
Thanks @Sdkb, I agree that starting with a sources requirement could be an interesting place for an MVP.
And I totally agree that getting community buy-in early is important for any major wiki feature release! One way to get a lot of eyes and potential support for an idea like this would be the community wishlist. Another community member actually contributed a very similar idea earlier today: Community_Wishlist_Survey_2023/New_contributors/Reference_requirement_for_new_article_creation
(To be clear: I'm not saying the idea would need to be tackled by the Community Tech team, just that having clear support for an idea like this in the Community Wishlist would make it even more likely that the Growth Team could focus on this project in the future).
Pinging @BusterD, @Clovermoss, @Barkeep49, @Novem Linguae, and @Enterprisey since you might also be interested in helping shape the Reference_requirement_for_new_article_creation wishlist item. KStoller-WMF (talk) 21:57, 25 January 2023 (UTC)[reply]
Thanks for the ping. Just a quick note that some of the NPP coordinators are hesitant to use the wishlist. Hopefully if a good NPP-related software proposal emerges, the Moderator Tools team would help execute anything PageTriage related, and the Growth Team would help execute anything else. I'm also hoping that BusterD has enough time to take the lead on triaging the ideas being presented on this page and via this group of people. That is, to keep an eye on these ideas that are emerging, to promote discussion, and to collect the best ideas into concrete software proposals to present at our Growth Team meetings. Thank you to everyone that is contributing. –Novem Linguae (talk) 22:54, 25 January 2023 (UTC)[reply]
Thanks so much for writing out these notes, Novem Linguae! I wish I could've attended, but I'm glad that it seems to have been productive and I hope I'll make the next one. BusterD and anyone else, I'm happy to chat more about the vision page if you have thoughts/questions! {{u|Sdkb}}talk 06:50, 20 January 2023 (UTC)[reply]
Thanks for the notes, guys. Not sure sticking with 5pm pacific is ideal - means the same people will generally not be able to make it. 1am UTC is pretty late even for a Brit, and functionally a no-go for mainland Europeans (with workday issues even as we cycle round the world). Nosebagbear (talk) 10:06, 20 January 2023 (UTC)[reply]
Good feedback. For one of the meetings, we might want to try a 9AM USA Pacific / 5PM UTC meeting time to allow interested Europeans to attend the meetings. –Novem Linguae (talk) 17:43, 20 January 2023 (UTC)[reply]
Obviously no time is perfect as putting things at 17:00 UTC is right in the middle of the night for Asia and hits during the working/school day for the Americas. Perhaps some rotation could be helpful? Best, Barkeep49 (talk) 17:49, 20 January 2023 (UTC)[reply]
FYI 17:00 UTC is fine for me. I'm in Chicagoland but I'm home during the day. Been reading all this stuff and not exactly ignoring your pings, but I felt I dominated the meeting discussion (and yet was less than prepared) so I've been following the chat above to comprehend points of view not my own. Very interested in Sdkb's work to date. BusterD (talk) 20:31, 26 January 2023 (UTC)[reply]

@KStoller-WMF, Sdkb, Novem Linguae, and BusterD: I vaguely remember something in the last meeting about researching newcomer experiences and how they react to certain things. Do you think it would be helpful for me to list newcomer experiences that I have observed from the Teahouse relating to stuff like drafts and how it can be frustrating? As in, why isn't there anything to prevent them from wasting so much time when something isn't going to be notable no matter what they do? I'd have to look at this closely again and maybe sift to find different sorts of experiences and what they might have in common with each other but that'd take some time and I want to know it'd be considered worthwhile before I undertake something like that. Clovermoss🍀 (talk) 19:32, 31 January 2023 (UTC)[reply]

Having real-world examples of users who have been frustrated by the article creation process absolutely sounds valuable to me. If your searches don't quickly turn up good ones, though, I wouldn't spend too much time digging; just wait around a bit and it (unfortunately) won't be long before more come up. {{u|Sdkb}}talk 19:41, 31 January 2023 (UTC)[reply]
@Sdkb: Good to know. I'll take a look sometime tomorrow when I'm less tired. At the most, it should take me a few days. Clovermoss🍀 (talk) 20:19, 31 January 2023 (UTC)[reply]
@Sdkb: I'm going through some unexpected dramatic life changes right now so I might be more sporadic in the near future in regards to my edits. I was able to get a sample of some questions yesterday in my sandbox. Not quite what I was thinking of but I think it might be useful to share with KStoller-WMF? Notability is an important concept on enwiki and I think this demonstrates some of the nuances. Clovermoss🍀 (talk) 16:05, 2 February 2023 (UTC), edited 00:13, 11 February 2023 (UTC)[reply]
@Sdkb: Catching COVID-19 postponed some of the life changes so I actually have more free time than I previously would have since I'm stuck inside 24/7. Do you think it'd be useful to keep going with what I was doing or is it only tangentially useful? Clovermoss🍀 (talk) 03:30, 7 February 2023 (UTC)[reply]
Oh no; I hope you feel better soon! I think @KStoller-WMF or some of the other WMF folks might be better positioned to answer that question. Cheers, {{u|Sdkb}}talk 03:42, 7 February 2023 (UTC)[reply]
@Clovermoss Sorry for the slow response and I hope you are feeling better! I just read through the sample of newcomer questions in your sandbox. Thanks for spending the time to do that, I really appreciate it! I don't think I'm seeing anything too unexpected in those exchanges, but it's certainly helpful to read those specific examples and better empathize with how frustrating the current process can be for newcomers and experienced users.
I definitely appreciate your push to review these newcomer questions, but I don't think you need to spend more time gathering examples. I've added a reoccurring reminder for myself to review recent Teahouse conversations. Even just reviewing recent conversations I see many similar scenarios.
I'm very hopeful that the future Page Curation work (Page Curation/2023 Moderator Tools project) will ensure we can also gather more qualitative metrics to go along with the these examples to help guide future work.
We also hope to gather more information soon on Welcome survey responses and follow up newcomer activity. For example, I want to be able to answer questions like:
- Of the newcomers who indicate they want to create an article, what percentage actually go on to attempt article creation in the first month? How does that compare to the newcomers who select a different reason for creating an account?
- Of the newcomers creating accounts, what percentage are deleted? Of the deleted articles, what are the reasons for deletion?
What other metrics would you want to gather before starting a project to help address improvements for new editors related to article creation?
And just FYI, the wishlist item related to requiring references for new article creation was accepted for voting: Community_Wishlist_Survey_2023/New_contributors/Reference_requirement_for_new_article_creation
The more well scoped the idea becomes and more support it gathers, the more likely the Growth team could consider including something like this in our roadmap, so I think it would be great if more people chimed in on that discussion! KStoller-WMF (talk) 18:55, 10 February 2023 (UTC)[reply]
@KStoller-WMF: I've been doing much better lately. I still would've liked to not have COVID-19, though. If you ever want to search Teahouse questions, if you go to the archive box it's actually fairly easy to use search terms like "draft" and get some sample queries like I did. I just figured that looking at previous conversations might be useful in addition to what you're currently researching. I think it's an often underlooked benefit of all the conversations that have taken place since the start of Wikipedia. We're often not the first to identify issues and seek out solutions. Archives at other venues may be helpful, I'll try to think of ones that may be relevant if you're interested. Clovermoss🍀 (talk) 00:00, 11 February 2023 (UTC)[reply]
I got COVID in December. It kicked my butt. Get well soon! –Novem Linguae (talk) 00:02, 11 February 2023 (UTC)[reply]
@Clovermoss Great, thanks so much. And I'm glad that you're feeling better! It really has been a rough winter for germs. KStoller-WMF (talk) 23:08, 14 February 2023 (UTC)[reply]
This is the first I'm seeing of Vision for a better Article Wizard and I think it's fantastic. I'm not too sure which aspects of it would be too sizeable for the Growth Team but I think the COI and RS checking would be an enormous help. "What is your relationship to [article]?" would be such an easy win (although the question and buttons need workshopping).
I also think "Please enter URLs of three sources" would really cut down the number of unsourced drafts even if the wizard did nothing with this information and just allowed the user to pass to the next screen with any 3 URLs. The point is to force editors to engage with the idea that notability or verifiability are part of the rules for writing a Wikipedia article. Most have no clue. Of course, interaction between the wizard and RSP would be amazing. — Bilorv (talk) 22:04, 6 February 2023 (UTC)[reply]

Meeting #3

17:00 UTC works for me, and I like the idea of rotating the meeting schedule. Thursdays are best for me if possible. I'm happy to give you all the whole hour to share ideas with the Growth team if you prefer, but if you are interested, I think it would be interesting to bring someone from the Editing Team in to demo their current Edit Check plans. T265163. One idea the Editing team is exploring is around surfacing guidance within Visual Editor when an editor is adding text that likely needs a citation. I know the Editing team is eager to collect more community feedback about this project, and I also think a citation-related "Edit Check" could somehow integrate into new article creation eventually (which is fairly similar to some of the ideas we've been discussing). Anyway, let me know if you are interested in spending part of the meeting discussing Edit Check, and I'll arrange that. Does anyone have thoughts on when they would like to meet next? 17:00 UTC / 9AM Pacific on February 23? March 9? KStoller-WMF (talk) 22:42, 27 January 2023 (UTC)[reply]

The Feb 23 date works better for my calendar. Happy to hear other thoughts.
A reminder to volunteers that I'd really like to move the brainstorming to on-wiki and do it ahead of the meeting, and then use meeting time for software proposals. Let's maximize the opportunity we have here by doing the brainstorming and planning pre-meeting, if possible. –Novem Linguae (talk) 23:06, 27 January 2023 (UTC)[reply]
Feb. 23 also works better for me, although I could likely make either. Discussing Edit Check for part of it works for me! Cheers, {{u|Sdkb}}talk 23:18, 27 January 2023 (UTC)[reply]
A reminder to everyone that our 3rd meeting is potentially in 2 weeks. What concrete software proposal should we present in the meeting? Who can help lead the brainstorming and discussion of this onwiki? @BusterD, are you available? –Novem Linguae (talk) 07:23, 8 February 2023 (UTC)[reply]
I am all in. Mentioned a few odd things to Sdkb. Would like to be more productive this time. Do we want to create a new page-place for the brainstorm? Is the talkspace already available? BusterD (talk) 09:45, 8 February 2023 (UTC)[reply]
A section of this page might be good since we all have it watchlisted. Starting up quickly would be beneficial. Another good option might be WT:NPPR to get a wider audience. Your idea of a new page would also be acceptable. Thoughts? –Novem Linguae (talk) 10:14, 8 February 2023 (UTC)[reply]
Agree that urgency is a concern. Let's do it here. I'm busy this morning. Would you drive this conversation at first? I'm happy to join in when I get back this afternoon. BusterD (talk) 17:06, 8 February 2023 (UTC)[reply]
@BusterD @Novem Linguae @Sdkb @Clovermoss Thanks for helping organize in advance! Let's finalize a date and time and I'll share out a meeting link. I just found out that Feb 23 won't work for the Editing team, so we can't have the Edit Check discussion that day. Do you prefer to move our meeting to March 9 or March 16 (at 17:00 UTC) so we can also include the Product Manager and Designer of the Editing team, or should we proceed with Feb 23rd and schedule the Edit Check demo for another time? KStoller-WMF (talk) 19:16, 10 February 2023 (UTC)[reply]
I'm very eager to see a demo of Edit Check, but I view it as something that complements the Article Creation for New Editors project, not something inextricable from it, so I'd be fine proceeding with the Feb. 23 meeting and having the demo another time. {{u|Sdkb}}talk 20:05, 10 February 2023 (UTC)[reply]
I'd suggest putting the next meeting on hold until we do our homework and create an actionable software proposal.
Folks, do we want to focus on Sdkb's software proposal (and maybe they'd be willing to lead the next meeting), or do we want to brainstorm some more? –Novem Linguae (talk) 01:42, 14 February 2023 (UTC)[reply]
I certainly don't expect a polished proposal, but I would prefer to have an agenda finalized prior to meeting. So perhaps it's best if we push back the meeting until that is settled? KStoller-WMF (talk) 23:15, 14 February 2023 (UTC)[reply]

February pre-meeting brainstorm

What should we attempt to achieve this month? What shovel-ready projects do we need to move forward now? What decision points are we approaching? Would anyone like to hear about my experiences with new page creator Elttaruuu (talk · contribs · logs) (three weeks and almost 1000 edits in)? BusterD (talk) 17:11, 8 February 2023 (UTC)[reply]

Lessons from Elttaruuu

@BusterD, on the vision for a better article wizard, I may have a little catch-up to do as I missed the last meeting. But I'll be interested in hearing from the folks on the WMF side about what sort of discussions they've been having. Are there elements of the vision that the team thinks would be infeasible, or that are missing, or that should be changed somehow? I know Kirsten asked above about a minimum viable product, so I'll be interested to discuss our options there, as that seems like a potential upcoming decision point.
On your experiences with Elttaruuu, yeah, I think it'd probably be good for the WMF to have some practical examples to reference as they move forward; Clovermoss can also share some of the ones she has collected. Personally, I feel I have a fairly good understanding of the newcomer article creation experience from my own past work, but more information there certainly never hurts! {{u|Sdkb}}talk 19:26, 8 February 2023 (UTC)[reply]
If you are looking at Elttaruuu, then you should not only be looking at the successes but also at articles which perhaps surprisingly have been removed from article space and either deleted or draftified. This is not a pleasant or helpful experience for a new contributor.--Ipigott (talk) 20:45, 8 February 2023 (UTC)[reply]
We are totally in agreement. Without getting into the weeds, IMHO their problems stemmed from 1) an unreasonable expectation of notability and 2) an unfamiliarity with workable processes. The user is smart, quick, and enthusiastic. Boldness is not a problem. At first, I'll grant, their work didn't impress reviewers because their early edits seemed experienced and their subjects so local and obscure that it implied connected editing. So they were good at the work, but reviewers including myself failed the AGF test. Clearly having your work removed or moved is confusing, but learning requires stumbling around a bit, reacting to various sorts of feedback. Humans learn best by doing. Elttaruuu succeeds perhaps because they can weather the foibles and are willing to accept feedback at face value. BusterD (talk) 23:40, 8 February 2023 (UTC)[reply]

Bilorv idea

@Bilorv's idea above looks promising. To recap, their idea is when a new user creates an article, pop up a dialog that collects some basic info... 1) ask "what is your connection to the article?" to look for COI/UPE, and 2) ask for 3 sources.
So ideas to be worked out: a) what information to collect? b) where to display this information to reviewers? c) who to collect this information from, e.g. first article creation attempt only? not extendedconfirmed only? etc. d) make this step optional or mandatory, e.g. are they able to press a "skip" button? e) could this pass a Village Pump RFC? –Novem Linguae (talk) 19:35, 9 February 2023 (UTC)[reply]

Sdkb idea

The Vision for a better Article Wizard is well-considered, and I can't see any specific point with which I disagree. (Kindly remember my preference for "article sherpa" as a non-magical assistant. There's nothing magical about a new contributor's tasks and I want to give no undue illusions to the eager newcomer.) It might be made out to be good fun. It occurred to me that the framework of the Wizard is not unlike a game of combat, the player required to beat each opponent in order to advance to the next stage. If we can channel a user's natural skepticism and agency in a mock contest (Did anyone besides myself just adore the tutorials in Myth: The Fallen Lords? Crickets? Okay. I'm a mature nerd.) we might make creating a new page channeling intrinsic willingness to compete into a new game you play on your phone. "Can you pass the dragon of notability? Dare you risk the final battle: deletion procedure?" BusterD (talk) 20:31, 9 February 2023 (UTC)[reply]

It might alternatively be posed as flash-like game of Bob the Robber, a contributor must visit each room and complete certain key tasks in order to unlock (and unlock is a useful metaphor here) the next level of achievement. BusterD (talk) 20:38, 9 February 2023 (UTC)[reply]
I hope it doesn't seem I've gone down a rabbit hole. I'm conceptualizing how to utilize a new contributor's native determination and stubbornness in their own favor. BusterD (talk) 20:50, 9 February 2023 (UTC)[reply]
Looking over User:Sdkb/sandbox/Vision for a better Article Wizard, this looks like a replacement for the WP:AW. Would we want this to be done in the same style as the current WP:AW, or as software (e.g. a MediaWiki extension)? Is this something we should be asking the Growth Team to make for us, or doing ourselves? What kinds of features does it have that might be technically complicated to implement? And could we get a consensus at WT:AW and the village pump to replace the current article wizard, or is the current wizard well-liked? –Novem Linguae (talk) 20:42, 9 February 2023 (UTC)[reply]
Re naming, that's a good thought, BusterD. We definitely want to give new editors a realistic expectation of the challenges involved, so we should consider alternatives. For article sherpa, I'd have to ponder/research a bit if there are any appropriation issues vis a vis the Sherpa people, but if not, that could be a more interesting one than just something like "article helper".
Novem Linguae, in order to have the desired functionality, I don't think it would be possible to make the Wizard just using wikitext, so we'd have to have the Growth Team code it as software. That said, retaining the ability of the community to maintain/control it will be essential. As a cautionary tale, one of the ways the Wikipedia Adventure fell short is that its advanced technical elements and sophisticated graphics made it very hard for us to update/improve it. For here, some community control is baked in with e.g. the article topic tree, and for other elements (like the copyright disclaimer in step 6 or the post-decline help screens in step 9) we'd want to make sure the team builds in a way for us to modify the text.
Regarding getting consensus, I could be wrong about this, but I don't think there's any cadre of editors devoted to the current wizard, so I don't foresee it being all that hard to get consensus to switch to something else if we put forward a clearly superior alternative.
Cheers, {{u|Sdkb}}talk 03:35, 10 February 2023 (UTC)[reply]
From my perspective, @Sdkb's Vision for a better Article Wizard is solid and makes sense. But I want to acknowledge that as it's currently detailed, it would be a very large project. The Growth team attempts to build features that are community configurable, so communities have control and can customize Growth features to their unique needs. Building a new, detailed Article Wizard that is configurable by non-technical admins would be a major undertaking. For a project this large, I would want the Growth team to do user research and prototype testing with newcomers interested in article creation. I would also want to conduct more discussions with communities and evaluate this project against other potential projects (like engagement emails, user profile work, and a copyedit structured task).
None of that is to say we shouldn't consider this effort, I just want to make sure I'm setting expectations clearly, and encouraging us to work in an agile way. Is there a MVP version of this we should consider? Are there two or three steps that are most important that we could start with? Do you think that a reference / notability check (like this community wishlist proposal) would be a good place to start? Will the Editing team's upcoming Edit check project complement this work or should we somehow consider extending that effort to article creation?
I don't expect anyone to have all of those answers for me, but figured I should share some of the things I've been mulling over. Please let me know if you have any thoughts! KStoller-WMF (talk) 22:54, 14 February 2023 (UTC)[reply]

An elephant in the room

(Taking a liberty to characterize this. I don't mean to derail the above discussion.) The recent failed RfA of our friend User:MB has cast a pale light on the rigor of new page patrolling. Even though MB had seemingly done nothing against policy, the many thousands of perfectly reasonable review and review-necessitated edits they had performed over the years were seen to be in friction with a vocal subset of editors who wanted even further extension of good faith and effort on the part of new page reviewers in each discrete process. If I were an admin candidate, or a newer contributor who had the calling, I'd avoid NPP like the plague after that unfortunate admin run. While it's not directly relevant to today's effort, I think it essential we note that this friction has recently (and hopefully momentarily) cost us the efforts of two vital individual editors, perhaps more. We should not shy away from this fact. For our current mission's own protection, I think it vital we keep our process fully transparent, and be seen as keeping our process fully transparent. Any VP RFC would need to be crafted artfully and narrowly, perhaps introduced in stages over time in order to mine consensus. BusterD (talk) 20:13, 9 February 2023 (UTC)[reply]

There are differences in opinion on this. I know one respected admin has expressed the opinion that the MB RFA was not an anti-NPP pile-on, and that other factors were at play. I have some opinions on this that I'd be willing to discuss via email. But your main point is well-heard: whatever software we propose here needs to have strong community consensus, and we should be transparent about our development process, and involve as many folks as possible. –Novem Linguae (talk) 20:46, 9 February 2023 (UTC)[reply]
P.S. I have posted a link to this discussion at WT:NPPR to help solicit ideas. Are we also ready to post something at the village pump, or should we hold off? –Novem Linguae (talk) 20:50, 9 February 2023 (UTC)[reply]
I hope we're brainstorming towards best ideas before rushing off for approval. When we have best ideas we can put some forward for the peanut gallery. BusterD (talk) 20:53, 9 February 2023 (UTC)[reply]

Growth team newsletter #24

14:44, 31 January 2023 (UTC)

Concerns about the Marketing Experiment

I'm a bit concerned about the Marketing Experiment. Wikipedia is meant to be a non-profit, however if we start advertising Wikipedia then what will happen on Wikipedia? Will we start including ads on Wikipedia itself? Will people start thinking we're trying to sell Wikipedia? Also, what will these ads look like? ― Blaze WolfTalkBlaze Wolf#6545 19:02, 31 January 2023 (UTC)[reply]

@Blaze Wolf I'll chime in since I think I triggered this concern by including a link to the experiment in the recent Growth newsletter. I just wanted to clarify and let you know that this was a one-time small experiment on Spanish Wikipedia. The experiment was around driving an increase in new editors in emerging communities. From my perspective, as the WMF Growth team Product Manager, the results weren't significant enough for us to continue experimenting with that approach. That being said, if you are interested in the details (including what the Spanish ads looked like) you can read about it here, but you can be assured that this experiment ended and we aren't planning to test it in any other languages. KStoller-WMF (talk) 21:13, 31 January 2023 (UTC)[reply]
I definitely noticed this, too. Overall, I don't see anything particularly concerning, especially given the small experiment scale, but there would certainly be ethical concerns about giving money to Facebook to advertise there.
The emails to new users seem to show more potential; I followed up about that here. Cheers, {{u|Sdkb}}talk 21:29, 31 January 2023 (UTC)[reply]
Agreed, thanks for the feedback! The Growth team has a lot of competing priorities, but working on welcome email improvements definitely seems to have potential and I hope we can focus on that more in future. - KStoller-WMF (talk) 21:52, 31 January 2023 (UTC)[reply]
If we start actually advertising anything, another concern would be how this could legitimize other forms of Wikipedia "ads" (like undisclosed paid editing). I also think advertising outside of Wikipedia would be a very controversial change that would generate a lot of pushback from the broader community. I think it's best to explore other ideas more thoroughly, which appears to be the case. Clovermoss🍀 (talk) 14:45, 1 February 2023 (UTC)[reply]
I'm not sure I understand the concern about how trying to recruit more volunteer editors, such as is done with edit-a-thons, for example, would legitimize paid editing. (I appreciate the report found the resulting registration rate to be very low, and thus if social media ads were to be used again for recruitment, there would have to be changes in the implementation.) Even something as small as getting more people to understand that editorial control is in the hands of the users and not WMF-paid staffers would raise awareness that Wikipedia can only thrive with a regular influx of new editors. isaacl (talk) 23:56, 6 February 2023 (UTC)[reply]
It's kind of like how banks say "we'll never contact you in this way". The way this is proposed sounds similar to the way some scams that offer "Wikipedia services" try to contact people. Ads from outside Wikipedia, namely. Google "Wikipedia services" and you'll see what I mean. WP:AFC even has a warning on the project page specifically addressing this. Anyways, my concern is that trying third-party advertising could have the unintended consquence of legitimizing this sort of thing. Clovermoss🍀 (talk) 03:38, 7 February 2023 (UTC)[reply]
I think a call for volunteers, such as a poster advertising an edit-a-thon, is significantly different than someone offering to provide a service to you. As I believe we've discussed, in the past I've suggested that the community should target groups that seem well suited to writing encyclopedia articles, such as historical societies, but maybe the right people can be more easily reached with a broader net. To take a for-instance, imagine for a moment the incredible potential of something with the reach of a Super Bowl ad. Now of course this specific example is a very bad idea: it would swamp the servers, and attract way too many editors making test edits. But I think it's a useful thought exercise to stimulate ideas of what can we do to get more people interested in contributing: if you could somehow reach everyone, what would you say to them? What does the community need to provide in order to offer an attractive value proposition to desirable editors, and to diminish the value proposition to those who aren't aligned with Wikipedia goals? isaacl (talk) 17:29, 7 February 2023 (UTC)[reply]
Regarding "we'll never contact you this way", I think sending followup emails to new users is more of a concern than advertising. However I appreciate that from a pure stats point of view, making that post-signup connection has been shown to improve continued engagement. isaacl (talk) 17:29, 7 February 2023 (UTC)[reply]
Legitimize in whose eyes? I think we need editors and the people who are going to stick around will, largely, already share the community's values and/or assimilate them as they edit in the project. I am not worried that if third party ads were suddenly to become a funnel of new editors that those people are going to be "UPE? Eh, who cares?" because the harm and frustrations of that are real to just about everyone who comes into contact with it. Best, Barkeep49 (talk) 17:33, 7 February 2023 (UTC)[reply]
My concern isn't "UPE, who cares?" but more along the lines of people confusing what is legitimately an ad from the WMF and what is an ad from a scammer that is going against our terms of use. Maybe I didn't make that clear enough? Or maybe I'm not quite getting the heart of what you're trying to say? Clovermoss🍀 (talk) 17:45, 7 February 2023 (UTC)[reply]
I'm not going to say that no one will mistake an ad from a scammer as one from the WMF because... I'm sure it has happened, many times. Nonetheless, I don't think WMF recruitment ads are going to change much in this respect, as I think the differences in their underlying goals would be apparent enough. I agree it would be important for any ad campaign to make it clear what it is not (and I don't agree with the suggestion in the report to use ads for purposes other than recruitment of editors, at least not as a blanket principle). isaacl (talk) 18:02, 7 February 2023 (UTC)[reply]
Yes, isaacl, I was trying to express what was essentially in your first sentence. Barkeep49, maybe reading WP:SCAM would be more helpful in the specifics of what I mean? Unless that page is super outdated and I'm expressing concerns that aren't really relevant anymore.
As for all of the other ideas, I don't necessarily disagree. I like isaacl's idea of making it clear what ads would and would not be for if this route is taken. I just think treading cautiously would be a good idea. Especially since the broader community would likely have strong opinions about advertising off-wiki. My instinct just tells me that quite a few people would be very against the idea for various reasons, but maybe I'm wrong. Exploring the viability of various options in retaining new editors isn't a bad thing though and I appreciate all potential ideas. Clovermoss🍀 (talk) 18:20, 7 February 2023 (UTC)[reply]
People object to things for all sorts of reasons, so I'm sure there'd be opposition. I don't like the idea, though, of guilt by association. Lots of things get used by scammers; we should be wary of thinking that any use of these things is now tainted. (Plus, email would be my first place of concern in this regard, not ads, which have much more than a subject line to create a first impression.) isaacl (talk) 18:32, 7 February 2023 (UTC)[reply]
I think you're right Clover that there would be a group of editors who would share your concern (or similar ones). And I'd work to persuade them as well. I think you and I have even discussed the way that our shortfall of editor capacity is hitting the project and so finding new ways to attract (and then retain) mission aligned editors is something where I think we need to be willing to follow the data. Best, Barkeep49 (talk) 19:22, 7 February 2023 (UTC)[reply]
Apologies for the delayed response, but thanks for the response KStoller. I was concerned seeing it in the newsletter but I"m glad to hear that it was a one-time experiment. ― Blaze WolfTalkBlaze Wolf#6545 16:09, 2 February 2023 (UTC)[reply]
@KStoller-WMF: the report concludes We should continue/expand our use of paid media to reach Wikipedia-aligned audiences, which seems at odds with what you are saying. I am concerned at the idea of Wikimedia Foundation money being spent on Facebook, and I think Clovermoss has a good point about how if Wikipedia were known to advertise on social media it may have unintended consequences in allowing UPE businesses to profit. — Bilorv (talk) 21:57, 6 February 2023 (UTC)[reply]
Hello @Bilorv, thanks for reviewing the report. The report was compiled by the Marketing team back in August of 2022, so it's been several months since I've read it. I'm not aware of any further experiments that expand that work, and I don't have knowledge of any future experiments of a similar nature. That being said, the Growth team was mainly involved in the experiment analysis, so I'm likely not the best person represent this effort. @Ed Erhart (WMF), the report's author, might have more to add regarding any followup from the Newcomer experience marketing 2022 pilot. It sounds like a useful next step for me is to add more details about what concrete next steps have been planned regarding the Newcomer_experience_projects. I'll work on a summary this week. KStoller-WMF (talk) 19:34, 7 February 2023 (UTC)[reply]
Hello everyone, I'm Ed Erhart from the WMF Comms dept. You may know me better as The ed17. As Kirsten said above, the Foundation does not have further plans to use social media ads in future experiments around bringing in new editors.
The only part of this pilot we are looking into continuing are the welcome emails, which showed enormous promise. I'm personally excited about this idea, and I'd love to hear if y'all have any thoughts on them. Ed Erhart (WMF) (talk) 04:36, 16 February 2023 (UTC) (courtesy ping Bilorv)[reply]

Question about the welcome emails

I have some questions about the Welcome Emails. First, do we know if any of these emails were sent to a user's spam folder (I don't know if that's a statistic you can see or if that's something only the user or email service provider knows)? Second, if the user said yes to receiving emails, were they then prompted to enter their email address? If so, was this part skipped if the user had added an email upon registering? Third, did any of the users reply to emails or was replying not available due to the emails being sent from a "noreply" email? Fourth, did the emails look similar to any of the current existing welcome templates? Fifth, are there any plans to start a similar experiment on enWiki? If so I wouldn't mind participating in it (as in helping create the emails, not receive them as there would be no point in me receiving them). ― Blaze WolfTalkBlaze Wolf#6545 16:20, 2 February 2023 (UTC)[reply]