Honestly I think we've had this conversation before. It's been had, whether it was you and me or someone else.

Personally I think Teyla spotted him coming out of Elizabeth's room at an hour where there was only one possible explanation for why he could be there.