I'd probably crank up the ISO and shoot at f/8 and 800 or faster to get more crisp sports photos hand held with that long lens.
I’ve taken photos of area softball games and at 135mm focal length (in shooting from the dugout entrance), at f4 or f.5 at 1/3200 come in so crystal clear. Like you can read the words on the softball. I’m just doing shots of the batters at the plate.
These were taken from behind the center field fence, with a 200mm-600mm lens.
42