Gryphon0468 wrote:This may just be the smartest, most advanced AI ever created. I mean for anything ever, not just games. Josh is solving all sorts of problems for AI reasoning that it could well have real effects in the world of AI development.
Josh could be inadvertently contributing to the destruction of the world
Or maybe it's not inadvertent! I have this strange fantasy going through my head right now that Josh is secretly a compassionate-minded negative utilitarian covertly attempting to destroy the world
, and that Limit Theory is just a guise for his attempts to create an extremely intelligent AI with the capability of doing so:
David Pearce wrote:
Strictly speaking, however, humanity is more likely to be wiped out by idealists
than by misanthropes, death-cults or psychologically unstable dictators. Anti-natalist philosopher David Benatar's plea
("Better Never to Have Been") for human extinction via voluntary childlessness must fail if only by reason of selection pressure; but not everyone who shares Benatar's bleak diagnosis of life on Earth will be so supine. Unless we modify human nature, compassionate-minded negative utilitarians, with competence in bioweaponry, nanorobotics or artificial intelligence, for example, may quite conceivably take direct action. Echoing Moore's law, Eliezer Yudkowsky warns that "Every eighteen months, the minimum IQ necessary to destroy the world drops by one point”.
I've spoken with David Pearce (he's a really nice chap) and he's not actually heard of any other "compassionate-minded negative utilitarians" trying to destroy the world. But of course, if they were intelligent, they wouldn't reveal their intentions to anyone to maximise their chances of success!
It helps this fantasy that there are a number of parallels that can be drawn between me and Josh. We're both 21, both in our third year of study, both attending pretty good universities, both studying computer science. I've always dreamed of a smarter, more dedicated version of myself being somewhere out there in the world, working on some extremely advanced AI with the pretense of it being for something other than the annihilation of the world.
Of course this is all just pleasant imagination and I don't actually believe any of it, and it would be extreme hubris to say Josh is in any way "a version of myself". It's just a fantasy, as all.