When it seems apparent that a batted ball will be an Infield Fly, the umpire shall immediately declare “Infield Fly” for the benefit of the runners. If the ball is near the baselines, the umpire shall declare “Infield Fly, if Fair.”
The umpire didn't declare it until the ball was about half a second from hitting the ground, therefore the rule was incorrectly applied and should never have been called. If it takes that long to call it, then it probably wasn't ordinary effort.
Again, you have to be insane not to see how terrible that call was.