Possibly it's the already paranoid and worried frame of mind that makes Zuko actually notice that properly for the first time.

And then, for a few stupefied seconds, there is just staring.