I believe that practicing deferential thought is an integral aspect of practicing stillness of thought. The goal, as I understand it, is not to be placid or crystalline, but to be accommodating of the world around you, as a vessel would be of water. With that in mind, do you think it is possible that your partner finds you cold because you may be focusing on maintaining your stillness?
I would try allowing your mind to react as naturally as possible to any engagement, in the spirit of robbing your thoughts of the primacy they seek in being acknowledged as interrupted. I am far less experienced than OP in this arena, though, so I apologize if I am stating or misconstruing the obvious.