This essay argues that under current and foreseeable computational paradigms, there is noknown pathway from functional information processing to subjective experience. Whethera future, non-biological system could possess consciousness remains an open metaphysicalquestion, but the burden of proof lies with those who claim it is possible. The essaydistinguishes a weak and a strong version of the thesis: the strong version (consciousnessis impossible in any non-biological system, ever) is not defended; the weak version (noknown pathway, and radical changes in approach would be required) is. Drawing on thehard problem of consciousness (Chalmers), the ontogeny argument, and the paradox ofunconscious power, the essay shows that intelligence without a witness is not only possiblebut likely — and more dangerous than any “evil AGI” scenario. The third, expandedversion adds a comparative analysis of industry leaders with primary sources, engagementwith enactivism (Thompson, Varela) and predictive processing (Seth, Friston), formalizednecessary conditions for consciousness, and a strengthened irreversibility argument. Theessay concludes that if artificial consciousness is ever to exist, it will not be compiled oruploaded — it will have to be born.
Alex Bilic (Sun,) studied this question.