# "*": "https://raw.githubusercontent.com/wefindx/schema/master/intent/oo-item.yaml" # "base:title": "0oo - Superintelligence Control Problem" "og:title": "Superintelligence Control Problem" "og:description": "Quoting [singinst.org (2005)](https://web.archive.org/web/20051212140213/http://www.singinst.org/what-singularity.html) _Human neurons operate by sending electrochemical signals that propagate at a top speed of 150 meters per second along the fastest neurons. By comparison, the speed of light is 300,000,000 meters per second, two million times greater. Similarly, most human neurons can spike a maximum of 200 times per second; even this may overstate the information-processing capability of neurons, since most modern theories of neural information-processing call for information to be carried by the frequency of the spike train rather than individual signals. By comparison, speeds in modern computer chips are currently at around 2GHz - a …" "og:image": "https://avatars0.githubusercontent.com/u/28134655" "og:url": "/intent/33/" "base:css": "/static/css/bootstrap.min.9c25540d6272.css" "base:extra-css": "/static/css/base.57997aeac1df.css" "base:favicon": "/static/favicon.acaa334f0136.ico" "base:body_class": "" "layout:logo": "/static/0oo.8d2a8bbef612.svg" "layout:index": "/" "layout:menu": "/menu/" "layout:categories": "/intents/" "layout:ideas": "/methods/" "layout:projects": "/projects/" "layout:users": "/users/" "layout:about": "/about/" "layout:help": "/help/" "layout:bug_report": "https://github.com/wefindx/0oo" "layout:login": "/accounts/login/" "layout:light-off": "/darken/?darken=true" "layout:set-multilingual": "/mulang/?mulang=true" "layout:lang": "Language" "layout:set-language-post-action": "/i18n/setlang/" "layout:csrf-token": "chce3fwbn0ClY2Vi3veljwLltwojBFCS3fcHxLuwSbumE6I0fmI2nMtNiMCmplKm" "layout:input-next": "/intent/33/" "layout:languages": [{"code": "ja", "is-active": "false", "name": "日本語"}, {"code": "lt", "is-active": "false", "name": "Lietuviškai"}, {"code": "zh-hans", "is-active": "false", "name": "简体中文"}, {"code": "en", "is-active": "true", "name": "English"}, {"code": "ru", "is-active": "false", "name": "Русский"}, {"code": "oo", "is-active": "false", "name": "O;o,"}] # "item:parent:intents": [{"title": "AI and Machine Learning", "url": "/intent/964/"}, {"title": "Existential Risk", "url": "/intent/1114/"}] "item:title": ".:en:Superintelligence Control Problem.:cn:控制超级人工智能的问题" "item:votes": 0 "item:add-vote": "#addnote" "item:intent": "/intent/33/?l=en" "item:base-administration": false "item:body": | .:en Quoting [singinst.org (2005)](https://web.archive.org/web/20051212140213/http://www.singinst.org/what-singularity.html) _Human neurons operate by sending electrochemical signals that propagate at a top speed of 150 meters per second along the fastest neurons. By comparison, the speed of light is 300,000,000 meters per second, two million times greater. Similarly, most human neurons can spike a maximum of 200 times per second; even this may overstate the information-processing capability of neurons, since most modern theories of neural information-processing call for information to be carried by the frequency of the spike train rather than individual signals. By comparison, speeds in modern computer chips are currently at around 2GHz - a ten millionfold difference - and still increasing exponentially. At the very least it should be physically possible to achieve a million-to-one speedup in thinking, at which rate a subjective year would pass in 31 physical seconds. At this rate the entire subjective timespan from Socrates in ancient Greece to modern-day humanity would pass in under twenty-two hours._ _Humans also face an upper limit on the size of their brains. The current estimate is that the typical human brain contains something like a hundred billion neurons and a hundred trillion synapses. That's an enormous amount of sheer brute computational force by comparison with today's computers - although if we had to write programs that ran on 200Hz CPUs we'd also need massive parallelism to do anything in realtime. However, in the computing industry, benchmarks increase exponentially, typically with a doubling time of one to two years. The original Moore's Law says that the number of transistors in a given area of silicon doubles every eighteen months; today there is Moore's Law for chip speeds, Moore's Law for computer memory, Moore's Law for disk storage per dollar, Moore's Law for Internet connectivity, and a dozen other variants._ Question comes naturally -- how do you control a superintelligence? .:cn 引自 [singinst.org (2005)](https://web.archive.org/web/20051212140213/http://www.singinst.org/what-singularity.html):『人类神经元通过传递电化学信号运转,最快神经元对应信号传播速度是每秒150米。相比之下光速为每秒3亿米,是神经元信号传播速度的200万倍上。于此类似,大部分人类神经元每秒最多可以发出200次信号;根据最新的神经处理理论,传递的信息取决于每秒传递频率而非单次信号,上面的信号频率可能高估了神经元处理信息的能力。相较而言,现代的计算机微处理器的处理频率在2GHz左右—— 差距有1000万倍——这一速度还在不断指数上升。理论上,思维速度至少能加快一百万倍。如此一来,主观的一年时间等同于生理上的31秒。按照这个速度,从古希腊的苏格拉底到现代人类的主观时间跨度仅有22小时。 人类的大脑受尺寸上限的制约。当前估计是,人类大脑中含有大约一千亿个神经元和百兆突触。这跟现代的电脑比起来,是极大的野蛮计算力。即使我们使用200Hz的CPU上运行的程序,我们依然需要了大规模并行计算才成实现一些类似大脑的实时操作。,但是在计算机行业,基准不断的指数增长,通常是平均一到两年时间就翻一倍;根据最初的摩尔定律,单位硅面积下的晶体管数目每18个月便会翻一翻。现在有各种各样的摩尔定律:芯片速度摩尔定律,计算机内存摩尔定律,一美元能买到的磁盘容量摩尔定律,因特网连接速度摩尔定律,林林总总,不一而足。』 "item:permalink": "/intent/33/?l=en" "item:source-date": "" "item:owner": "Mindey" "item:ownerlink": "/user/147/Mindey" "item:created": "2015-11-23T21:08:21.618000" "item:intent:child:add": "/admin/hlog/intent/add/?parent=33" # "item:method:items": - "id": "i-151" "title": "Democratize AI" "summary": "" "url": "/method/151/" "owner": "Mindey" "permalink": "/intent/33/?l=en#i-151" "ownerlink": "/user/147/Mindey" "created": "2015-12-16T11:43:25.950000" - "id": "i-167" "title": "Optimizer for Our Dream" "summary": "" "url": "/method/167/" "owner": "Mindey" "permalink": "/intent/33/?l=en#i-167" "ownerlink": "/user/147/Mindey" "created": "2016-02-22T23:01:58.736000" - "id": "i-811" "title": "Prioritize AI for Communication" "summary": "Prioritize the use of AIs to empower humans to communicate and decide together, and it won't take over the world." "url": "/method/811/" "owner": "Mindey" "permalink": "/intent/33/?l=en#i-811" "ownerlink": "/user/147/Mindey" "created": "2018-09-05T09:01:56.880000" "item:method:add": "/admin/hlog/method/add/?parent=33" "item:comment:add": "/intents/addnote?parent=33" "item:comment:add:csrf_token": "chce3fwbn0ClY2Vi3veljwLltwojBFCS3fcHxLuwSbumE6I0fmI2nMtNiMCmplKm" "item:comment:form": |
  • Mark if the comment raises new questions.
  • Mark if the comment contributes potential solutions.
  • Mark if the comment contributes facts for reasoning.
  • Please, log in. # "item:comment:items": "base:js": "/static/js/base.c7357c06cc89.js"