See, I don't think ot ever needs to go beyond Chinese Room type of scenarios. Once it gets to the point that it's indistinguishable from human, does jt matter if it's a Chinese Room?
The entity may not understand concepts, but in an abstract way, the system does.
It has the potential to out...