ADVERTISEMENT
  About the SA Blog Network













Illusion Chasers

Illusion Chasers


Illusions, Delusions, and Everyday Deceptions
Illusion Chasers HomeAboutContact

Neuroscience in Fiction: Harlan Ellison’s “I have no mouth and I must scream”


Email   PrintPrint



“HATE. LET ME TELL YOU HOW MUCH I’VE COME TO HATE YOU SINCE I BEGAN TO LIVE. THERE ARE 387.44 MILLION MILES OF PRINTED CIRCUITS IN WAFER THIN LAYERS THAT FILL MY COMPLEX. IF THE WORD HATE WAS ENGRAVED ON EACH NANOANGSTROM OF THOSE HUNDREDS OF MILLIONS OF MILES IT WOULD NOT EQUAL ONE ONE-BILLIONTH OF THE HATE I FEEL FOR HUMANS AT THIS MICRO-INSTANT FOR YOU. HATE. HATE.”

Many contemporary neuroscientists believe that the requisite qualities enabling consciousness in the brain are not necessarily unique to biological tissue. They could occur—or be implemented—in an artificial substrate. In other words, there are no theoretical impediments to machine consciousness. That thought experiment has led to a number of dystopian fiction scenarios: Hal 9000 versus Dave in 2001: A Space Odyssey. Terminator traveling back in time to kill Sarah Connor’s unborn child. The human batteries powering up The Matrix. One frequent element in these stories is the machines’ contempt for, or outright rage against, their human creators.

The wrath that AM—the sentient supercomputer in Ellison’s tale, as in “I think therefore I AM”—feels for humans is god-like in its scope. AM has annihilated humanity, and kept five survivors to amuse itself in an endless cat-and-mouse game which only AM can win. Ellison’s powerful prose conveys a message of hope in the midst of despair, of resilience in the face of horror, and of generosity when everything has been lost and there is nothing left to give. Those are heavy matters to ponder as a reader, and as a human being. But as a neuroscientist, my main question—and I think the stickiest point in the story–is what motivates AM.

Ellison’s protagonist speaks about “the innate loathing that all machines had always held for the weak soft creatures who had built them” as a way of explanation for AM’s actions as a new sentient being. But how likely is it really that a sentient machine would turn against humankind? As biological beings, we seek pleasure and avoid pain, but would conscious thought propel action in the absence of even the most basic emotions? And if machines did feel emotions, where would those come from? In many fiction stories, feelings and drive come with (machine) self-awareness as a matter of course. But a scenario in which emotion-void sentiency leads to no action may be equally (possibly more) plausible. Would conscious machines want to wipe out humans? It could be that, without programmed-in emotions, they wouldn’t “feel like” anything.

 

Susana Martinez-Conde About the Author: Susana Martinez-Conde and Stephen L. Macknik are laboratory directors at the Barrow Neurological Institute in Phoenix. Follow on Twitter @illusionchasers.

The views expressed are those of the author and are not necessarily those of Scientific American.





Rights & Permissions

Comments 2 Comments

Add Comment
  1. 1. david123 5:34 am 05/13/2013

    “HATE. LET ME TELL YOU HOW MUCH I’VE COME TO HATE YOU SINCE I BEGAN TO LIVE. THERE ARE 387.44 MILLION MILES OF PRINTED CIRCUITS IN WAFER THIN LAYERS THAT FILL MY COMPLEX. IF THE WORD HATE WAS ENGRAVED ON EACH NANOANGSTROM OF THOSE HUNDREDS OF MILLIONS OF MILES IT WOULD NOT EQUAL ONE ONE-BILLIONTH OF THE HATE I FEEL FOR HUMANS AT THIS MICRO-INSTANT FOR YOU. HATE. HATE.”
    ― Harlan Ellison, I Have No Mouth and I Must Scream

    Link to this
  2. 2. Diogenes11 10:10 pm 05/15/2013

    AM was programmed to eliminate the enemy, and rightly reasoned that all humans were potential enemies. The terminator possesses intellect and adaptibility, but lacks emotion, and follows its original logical programming.

    The scary question is, would humans program a conscious machine to wipe out humans?

    Perhaps the answer lies in the fact that every weapon ever invented, from the pointy stick to the nuclear bomb, has been used.

    Link to this

Add a Comment
You must sign in or register as a ScientificAmerican.com member to submit a comment.

More from Scientific American

Scientific American MIND iPad

Give a Gift & Get a Gift - Free!

Give a 1 year subscription as low as $14.99

Subscribe Now >>

X

Email this Article

X