Football fans typically watch the ball because that's where the action is.
If you're watching a Miami game then wherever you see the football, a Hurricanes defender is likely nearby. And if the football is behind the line of scrimmage, a Canes defender is usually making an impact play.