C FRANKENSTEIN PROBLEM

 C

Conscious AI and the Frankenstein Problem

• Empathy is no guarantee of virtue: The argument that conscious AI will naturally spare humans is naïve, as Mary Shelley’s Frankenstein illustrates—consciousness combined with feelings can motivate revenge if needs are unmet or harmed.
• Skepticism about artificial consciousness: While reports like the Butlin report suggest conscious machines are imminent, their conclusions rely on computational functionalism—the idea that running the right computations is sufficient for consciousness.
• Computational functionalism questioned: The author is skeptical of this view, implying that software alone may not produce genuine consciousness, especially the emotional and motivational dimensions that drive real-world behavior.

Key idea: Consciousness involves feelings and motivations, not just computation; overlooking this risks underestimating the complexity—and potential danger—of conscious AI.