↑
logo

Thomas Nagel says that it's criminal to build AI that feigns consciousness

Posted by eph0m0ral |2 hours ago |2 comments

nextaccountic 2 minutes ago

> Like everyone, I’m tremendously impressed by the lifelikeness of these systems compared to the history of earlier AI. But the disposition of some philosophers to take seriously the question whether these things are conscious or might soon become conscious is just ridiculous. They are assuming that the physical substrate is irrelevant. They all think that the material conditions for consciousness can be given in functionalist terms.

> (...)

> Functionalism is substrate-independent. It’s more than likely that the truth is one which links physical processes and systems of certain kinds to mental phenomena. Complicated data centers have absolutely nothing in common with the physical character of a nervous system. We have strong reasons to believe that while there may be consciousness elsewhere in the universe, it would require the appearance of some kind of organism with something analogous to a nervous system.

Why should we assume our substrate is the "right" substrate for truly conscious beings?

Perhaps we have fake consciousness too (just like programs running on silicon), and some advanced alien being could look at our biological neurons stuff and immediately recognize our fakeness. Perhaps those aliens could proceed to assert that their own substrate is the only one that could possibly be conscious - all the other substrates (like ours) being fake.

We couldn't possibly know, because we don't know what consciousness is.

gnabgib 2 hours ago

Please use the original title (A Famed Philosopher Takes on AI Consciousness)

> https://news.ycombinator.com/newsguidelines.html

2 hours ago

Comment deleted