Philosophy Dictionary of ArgumentsHome
| |||
|
| |||
| Superintelligence: Superintelligence refers to an artificial intelligence (AI) that surpasses human intelligence in aspects like problem-solving, creativity, and social skills. It denotes a hypothetical level of AI. See also Artificial Intelligence, Intelligence, Strong Artificial Intelligence, Human Level AI, Artificial Consciousness, Superhuman, Humans, Capabilities._____________Annotation: The above characterizations of concepts are neither definitions nor exhausting presentations of problems related to them. Instead, they are intended to give a short introduction to the contributions below. – Lexicon of Arguments. | |||
| Author | Concept | Summary/Quotes | Sources |
|---|---|---|---|
|
Jaan Tallinn on Superintelligence - Dictionary of Arguments
Brockman I 97 Superintelligence/Tallinn: Thesis: the central point of the AI risk is that superintelligent AI is an environmental risk. (…) the universe was not made for us; instead, we are fine-tuned by evolution to a very narrow range of environmental parameters. Any disturbance, even temporary, of this precarious equilibrium and we die in a matter of minutes. Silicon-based intelligence does not share such concerns about the environment. That’s why it’s much cheaper to explore space using machine probes rather than “cans of meat.” Moreover, Earth’s current environment is almost certainly suboptimal for what a superintelligent AI will greatly care about: efficient computation. Hence, we might find our planet suddenly going from anthropogenic global warming to machinogenic global cooling. One big challenge that AI safety research needs to deal with is how to constrain a potentially superintelligent AI - an AI with a much larger footprint than our own - from rendering our environment uninhabitable for biological life-forms. It’s hard to overemphasize how tiny and parochial the future of our planet is, compared with the full potential of humanity. On astronomical timescales, our planet will be gone soon (unless we tame the sun, also a distinct possibility) and almost all the resources - atoms and free energy - to sustain civilization in the long run are in deep space. >Artificial Intelligence, >Artificial General Intelligence, >Strong Artificial Intelligence. “Pareto-topia”/Eric Drexler: the idea that AI, if done right, can bring about a future in which everyone’s lives are hugely improved, a future where there are no losers. A key realization here is that what chiefly prevents humanity from achieving its full potential might be our instinctive sense that we’re in a zero-sum game—a game in which players are supposed to eke out small wins at the expense of others. ((s) No source indicated for “pareto-topia”; cf. (1)). 1. https://www.effectivealtruism.org/articles/ea-global-2018-paretotopian-goal-alignment/ Tallinn, J. “Dissident Messages” in: Brockman, John (ed.) 2019. Twenty-Five Ways of Looking at AI. New York: Penguin Press._____________Explanation of symbols: Roman numerals indicate the source, arabic numerals indicate the page number. The corresponding books are indicated on the right hand side. ((s)…): Comment by the sender of the contribution. Translations: Dictionary of Arguments The note [Concept/Author], [Author1]Vs[Author2] or [Author]Vs[term] resp. "problem:"/"solution:", "old:"/"new:" and "thesis:" is an addition from the Dictionary of Arguments. If a German edition is specified, the page numbers refer to this edition. |
Tallinn, Jaan Brockman I John Brockman Possible Minds: Twenty-Five Ways of Looking at AI New York 2019 |
||
> Counter arguments against Tallinn
> Counter arguments in relation to Superintelligence
Ed. Martin Schulz, access date 2024-04-20