Operator: ShakingSpirit
Automatic or Manually Assisted: Automatic
Programming Language(s): Python (pywikipedia framework)
Function Summary: To detect and notify on talk pages any dead external links found within articles
Edit period(s) (e.g. Continuous, daily, one time run): Weekly to Monthly
Edit rate requested: 30 edits per minute
Already has a bot flag (Y/N): N
Function Details: I noticed that there's a fair number of dead link bots based on the weblinkchecker.py script included with the pywikipedia framework, but (to the best of my knowledge) none are actually up, alive and kicking. After playing with the weblinkchecker.py script for a while it's easy to see why; although a very easy bot to set up, it requires a very large amount of time to run (a few weeks at the very least per sweep) because, even using something like Special:Export, going through every single article on Wikipedia and grabbing links is no small task! Even once it's done this once, it needs to do at least two sweeps spaced apart to check that the link isn't just down temporarily. ShakingBot abandons the idea of checking through every article as it stands, and instead uses the monthly externallinks.sql database dump. It goes though the following process:
Please note that ShakingBot will not remove links by itself, as some links are important and should be replaced with similar pages or an archived version of the original link - this requires human intervention.
Currently I am working on detecting if ShakingBot previously noted a dead link which hasn't been removed since the last run, and if so, note it to file, and to a noticeboard in my userspace. I hope to have this finnished for if and when ShakingBot is approved.
Seems pretty safe, wanna trial it for a bit -- Tawker 03:12, 27 December 2006 (UTC) reply
Please look at Wikipedia:Dead external links — Iamunknown 01:47, 29 December 2006 (UTC) reply
Regarding the inline tag, <{{dlw}}> is long and ugly. I was thinking of something like this: [1][ bad link. (I've not used a template here, but rather a modified version of Template:Fact, for illustration.) John Broughton | Talk 03:14, 30 December 2006 (UTC) reply
Combining John Broughton and Iamunknown's ideas above, what about tagging the links with something like [ bad link and as part of that template, adding the page to a category (in the same way that [ citation needed adds the page to Category:Articles with unsourced statements)? This has the advantage of the list of bad link pages being dynamic, and doesn't need to have fixed links manually removed and new links added in bulk as the ones on Wikipedia:Dead external links do. Thoughts, opinions? ShakingSpirit talk 07:23, 30 December 2006 (UTC) reply
What is the status of this bot? — Mets501 ( talk) 20:56, 25 January 2007 (UTC) reply
Request Expired. —
Mets501 (
talk)
22:36, 8 February 2007 (UTC)
reply
Operator: ShakingSpirit
Automatic or Manually Assisted: Automatic
Programming Language(s): Python (pywikipedia framework)
Function Summary: To detect and notify on talk pages any dead external links found within articles
Edit period(s) (e.g. Continuous, daily, one time run): Weekly to Monthly
Edit rate requested: 30 edits per minute
Already has a bot flag (Y/N): N
Function Details: I noticed that there's a fair number of dead link bots based on the weblinkchecker.py script included with the pywikipedia framework, but (to the best of my knowledge) none are actually up, alive and kicking. After playing with the weblinkchecker.py script for a while it's easy to see why; although a very easy bot to set up, it requires a very large amount of time to run (a few weeks at the very least per sweep) because, even using something like Special:Export, going through every single article on Wikipedia and grabbing links is no small task! Even once it's done this once, it needs to do at least two sweeps spaced apart to check that the link isn't just down temporarily. ShakingBot abandons the idea of checking through every article as it stands, and instead uses the monthly externallinks.sql database dump. It goes though the following process:
Please note that ShakingBot will not remove links by itself, as some links are important and should be replaced with similar pages or an archived version of the original link - this requires human intervention.
Currently I am working on detecting if ShakingBot previously noted a dead link which hasn't been removed since the last run, and if so, note it to file, and to a noticeboard in my userspace. I hope to have this finnished for if and when ShakingBot is approved.
Seems pretty safe, wanna trial it for a bit -- Tawker 03:12, 27 December 2006 (UTC) reply
Please look at Wikipedia:Dead external links — Iamunknown 01:47, 29 December 2006 (UTC) reply
Regarding the inline tag, <{{dlw}}> is long and ugly. I was thinking of something like this: [1][ bad link. (I've not used a template here, but rather a modified version of Template:Fact, for illustration.) John Broughton | Talk 03:14, 30 December 2006 (UTC) reply
Combining John Broughton and Iamunknown's ideas above, what about tagging the links with something like [ bad link and as part of that template, adding the page to a category (in the same way that [ citation needed adds the page to Category:Articles with unsourced statements)? This has the advantage of the list of bad link pages being dynamic, and doesn't need to have fixed links manually removed and new links added in bulk as the ones on Wikipedia:Dead external links do. Thoughts, opinions? ShakingSpirit talk 07:23, 30 December 2006 (UTC) reply
What is the status of this bot? — Mets501 ( talk) 20:56, 25 January 2007 (UTC) reply
Request Expired. —
Mets501 (
talk)
22:36, 8 February 2007 (UTC)
reply