I don't think youre doing anything wrong, just naturally reacting to the game, but not making a big scene out of it.
While the ref may have been slightly over the top, I totally get his point of view. He probably deals with so many tough parents, and while you weren't being rude, if everytime a ball went out, he saw the same parents in the corner of his eye pointing in a direction, it would probably get very annoying, frustrating and distracting.
So if he asked you to stop, you should definitely stop out of respect, even if you weren't in the wrong.
Previous Message
Feeling like I did nothing wrong here, but willing to listen to the crowd.
10u game, ref is probably mid 40s just like me. Turf field, playing fast so the ball is going out a lot. Just like every other game, whenever the ball goes out I just kinda point the direction that i think it'd go. No words, not even a big point just a finger and thumb down at my side. One of the other dads that I stand with does pretty much the same thing.
Several times ref and I disagreed and I said not a single word or action his direction. No one had yelled a single thing at this guy, not a word from parents, kids, or coaches.
After about 15 minutes, this guy screams at the other dad and I "I'LL CALL THE GAME, YOU STOP POINTING"