Passive mobs need to see the player's hands for them to follow them, such as wheat for cows but sometimes even though you're in distance for them to see you if they don't look they won't follow, however hostile mobs detect you even if you're behind them.