Pass an object?It can also be fun to pass larger objects like a mug or something. Your brain consistently has trouble with it. Jus a moment of broken expectation. I must have been really bored when I first found it in elementary school but I remember sharing it with my classmates around 3rd grade. To be an adult and to regularly find most people to not know such a simple trick is kind of odd.
I'm assuming your talking about slight of hand, and making it look like you are throwing something? Tricking your brain into trying to track an object, that's not actually there.. right?
If that's the case, that has a lot to do with our evolution, and how we started to get good at hunting.
After all, our brain can very effectively calculate trajectories with only a few frames of reference. If we could remove that built in ability. Motion tracking would be nearly impossible to keep up with. You simply wouldn't know where to look for an object, because you wouldn't know its trajectory. Since our Eyes have physical limitations, (frames per second, detail, ect) we would very easily lose said object. In the case of slight of hand, we are obviously at a handicap. And someone without, would be able to see what's going on with no problem. But you'd never be able to catch a ball.