When someone is sleeping, the are basically unconscious and completely unable to consent to anything.
Therefore, it is wrong for you tough your wife's body while she is asleep because, yes, it is very creepy.
Being married or not, you are not entitled to tough anyone at any time unless they willingly participate. A sleeping woman cannot participate. That is called molestation. And, yes, CREEPY.