> Certainly I believe we can agree that if you program am application or service to act as though it were conscious, that doesn't actually make it conscious

I'm not sure we agree upon that, especially without a clear definition of consciousness.