[ ..."like when you're alone"... ] No, that's called a handjob. It's actually a form of sex. Petting is just -- touching. Like, if you were to sit with him on the couch, and he started to stroke your side, or -- your stomach.
[ after a moment, hopefully ] Petting is something you do through clothes, if that helps.