But they showed him in the TV screens talking to the achitect, and it was the job of The One to go in that room and talk to him, so it must've been Neo everytime.