He knew what she was asking. The hesitation is out of loyalty for Leah, not to mention that he really doesn't know Barbara that well.

Which is why he's able to look concerned as well as agreeable when he nods. "No, I agree. I think you should really ask her about it, though. We were only together a couple days."