TL;DR AI does not need to become superintelligent, reach the singularity, whatever, to create serious risks. The deeper problem is that no intelligence operates with perfect information. Better models can reason faster and make better inferences, but they are limited in conjuring facts that are missing, hidden, stale, deceptive, or unknowable. That has been obvious … Continue reading Even ASI Cannot Escape Imperfect Information →