To feel stubble on someone's face implies that there is a situation that you should avoid. It is best not to get involved.