![]() | This article is rated C-class on Wikipedia's
content assessment scale. It is of interest to the following WikiProjects: | ||||||||||||||||||||||||||||||
|
![]() | The contents of the Paperclip maximizer page were merged into Instrumental convergence on 25 February 2016. For the contribution history and old versions of the redirected page, please see its history; for the discussion at that location, see its talk page. |
I think that Paperclip maximizer should be folded into this article, as the other article is stub-length, and (AFAICT) the paperclip maximizer is a thought experiment intended to illustrate the idea of instrumental convergence. Spectra239 ( talk) 10:18, 30 January 2016 (UTC)
I am missing the section on how to protect humanity from the paperclip problem. Zezen ( talk) 09:01, 4 November 2017 (UTC)
I deleted the second paragraph:
"Instrumental convergence suggests that an intelligent agent with apparently harmless goals can act in surprisingly harmful ways. For example, a computer with the sole goal of solving the Riemann hypothesis could attempt to turn the entire Earth into computronium in an effort to increase its computing power so that it can succeed in its calculations."
IMHO, the paragraph confuses association with causation. The supposed tendency of strong AIs for instrumental convergence does not make them more harmful. If anything, it allows us to better predict their behavior. Should they diverge in every which way depending on goals, they would be far more dangerous. — Preceding unsigned comment added by 176.11.124.251 ( talk) 14:45, 2 February 2018 (UTC)
The article mentions Nick Bostrom as the author of the idea of the paperclip maximizer, however Eliezer Yudkowsky seems to consider himself the author of that idea ( tweet). The article does not seem to have a citation for the source. A citation would not solve the problem unless one of the two has cited the other one at some point, to establish the direction. What do we know about the origin of this idea?
trylks ( talk) 23:19, 16 November 2021 (UTC)
some more tweets by eliezer yudkowsky claiming to have originated the meme. this matches my memory; unfortunately, i do not have a copy of whatever mailing list it might have been to verify the claim. 135.180.194.177 ( talk) 22:47, 9 November 2022 (UTC)
![]() | This article is rated C-class on Wikipedia's
content assessment scale. It is of interest to the following WikiProjects: | ||||||||||||||||||||||||||||||
|
![]() | The contents of the Paperclip maximizer page were merged into Instrumental convergence on 25 February 2016. For the contribution history and old versions of the redirected page, please see its history; for the discussion at that location, see its talk page. |
I think that Paperclip maximizer should be folded into this article, as the other article is stub-length, and (AFAICT) the paperclip maximizer is a thought experiment intended to illustrate the idea of instrumental convergence. Spectra239 ( talk) 10:18, 30 January 2016 (UTC)
I am missing the section on how to protect humanity from the paperclip problem. Zezen ( talk) 09:01, 4 November 2017 (UTC)
I deleted the second paragraph:
"Instrumental convergence suggests that an intelligent agent with apparently harmless goals can act in surprisingly harmful ways. For example, a computer with the sole goal of solving the Riemann hypothesis could attempt to turn the entire Earth into computronium in an effort to increase its computing power so that it can succeed in its calculations."
IMHO, the paragraph confuses association with causation. The supposed tendency of strong AIs for instrumental convergence does not make them more harmful. If anything, it allows us to better predict their behavior. Should they diverge in every which way depending on goals, they would be far more dangerous. — Preceding unsigned comment added by 176.11.124.251 ( talk) 14:45, 2 February 2018 (UTC)
The article mentions Nick Bostrom as the author of the idea of the paperclip maximizer, however Eliezer Yudkowsky seems to consider himself the author of that idea ( tweet). The article does not seem to have a citation for the source. A citation would not solve the problem unless one of the two has cited the other one at some point, to establish the direction. What do we know about the origin of this idea?
trylks ( talk) 23:19, 16 November 2021 (UTC)
some more tweets by eliezer yudkowsky claiming to have originated the meme. this matches my memory; unfortunately, i do not have a copy of whatever mailing list it might have been to verify the claim. 135.180.194.177 ( talk) 22:47, 9 November 2022 (UTC)