Singularity and Inevitable Doom

Abstract:

Chalmers (2010) has articulated a compellingly simple argument for inevitability of the singularity—an explosion of increasingly intelligent machines, eventuating in super forms of intelligence. Chalmers then goes on to explore the implications of this outcome, and suggests ways in which we might prepare for the eventuality. I think Chalmers' argument proves both too much and too little. If the reasoning were right, it would follow inductively that the singularity already exists, in which case Chalmers would have proven more than he set out to. Moreover, I will suggest that, if the singularity already exists, we are doomed. Fortunately, Chalmers' reasoning is problematic. I will consider several objections. Unfortunately, the most serious problem is that human life may end long before the singularity is created. In that case, we are doomed either way. Should we care? Perhaps not.