Operator: Maximilianklein ( talk · contribs · SUL · edit count · logs · page moves · block log · rights log · ANI search)
Time filed: 18:50, Monday, January 7, 2019 ( UTC)
Automatic, Supervised, or Manual: automatic
Programming language(s): Python
Source code available: https://github.com/notconfusing/hostbot-ai
Function overview: User:Jtmorgan and User:Maximilianklein have planned, and received consent to run an A/B experiment between the current version of HostBot and a newly developed-AI version. The AI version uses a machine-learning classifier based on ORES to prioritize which users should be invited to the TeaHouse whereas the current version uses rules. The point is to see if we can improve user retention by turning our attention to the most promising users.
The two versions would operate simultaneously. Both versions would log-in as "User:HostBot" so that the end-users would be blinded as to what process they were interacting with.
The A/B experiment would run for 75 days (calculated by statistical power analysis).
Links to relevant discussions (where appropriate):
Wikipedia_talk:Teahouse#Experiment_test_using_AI_to_invite_users_to_Teahouse
Edit period(s): Hourly (AI-version) and Daily (rules-version)
Estimated number of pages affected: ~11,000
Exclusion compliant (Yes/No): No
Already has a bot flag (Yes/No): Yes
Function details: All technical details on meta:Research:ORES-powered_TeaHouse_Invites.
Just posting here to confirm that I am excited to collaborating with Maximilianklein on this experiment. I've been wanting to improve HostBot's sampling criteria for a while now, and other Teahouse hosts have asked for it. J-Mo 19:33, 7 January 2019 (UTC) reply
Thought I'd drop by to voice my support, both for the experiment and for Maximilianklein. During the earlier discussion, I posted a couple of question on their talk page and got both a timely and thoughtful reply. I'm also interested in learning about the outcomes of this experiment, looking forward to them! Cheers, Nettrom ( talk) 15:20, 15 January 2019 (UTC) reply
Approved for extended trial (200 edits or 30 days). Please provide a link to the relevant contributions and/or diffs when the trial is complete. — xaosflux Talk 15:05, 21 April 2019 (UTC) reply
Approved. no issues were reported. — xaosflux Talk 15:23, 27 May 2019 (UTC) reply
Operator: Maximilianklein ( talk · contribs · SUL · edit count · logs · page moves · block log · rights log · ANI search)
Time filed: 18:50, Monday, January 7, 2019 ( UTC)
Automatic, Supervised, or Manual: automatic
Programming language(s): Python
Source code available: https://github.com/notconfusing/hostbot-ai
Function overview: User:Jtmorgan and User:Maximilianklein have planned, and received consent to run an A/B experiment between the current version of HostBot and a newly developed-AI version. The AI version uses a machine-learning classifier based on ORES to prioritize which users should be invited to the TeaHouse whereas the current version uses rules. The point is to see if we can improve user retention by turning our attention to the most promising users.
The two versions would operate simultaneously. Both versions would log-in as "User:HostBot" so that the end-users would be blinded as to what process they were interacting with.
The A/B experiment would run for 75 days (calculated by statistical power analysis).
Links to relevant discussions (where appropriate):
Wikipedia_talk:Teahouse#Experiment_test_using_AI_to_invite_users_to_Teahouse
Edit period(s): Hourly (AI-version) and Daily (rules-version)
Estimated number of pages affected: ~11,000
Exclusion compliant (Yes/No): No
Already has a bot flag (Yes/No): Yes
Function details: All technical details on meta:Research:ORES-powered_TeaHouse_Invites.
Just posting here to confirm that I am excited to collaborating with Maximilianklein on this experiment. I've been wanting to improve HostBot's sampling criteria for a while now, and other Teahouse hosts have asked for it. J-Mo 19:33, 7 January 2019 (UTC) reply
Thought I'd drop by to voice my support, both for the experiment and for Maximilianklein. During the earlier discussion, I posted a couple of question on their talk page and got both a timely and thoughtful reply. I'm also interested in learning about the outcomes of this experiment, looking forward to them! Cheers, Nettrom ( talk) 15:20, 15 January 2019 (UTC) reply
Approved for extended trial (200 edits or 30 days). Please provide a link to the relevant contributions and/or diffs when the trial is complete. — xaosflux Talk 15:05, 21 April 2019 (UTC) reply
Approved. no issues were reported. — xaosflux Talk 15:23, 27 May 2019 (UTC) reply