Could you explain where this bias comes from?Blablahb said:No, you must realise that the number of students used is unimportant basically, because he is testing something else. He is not testing 'do my students show an average that can be compared to population X'. He was testing if gamers with a gun-shaped controller are more accurate than Joe Average.Treblaine said:Uh, the sample size is large enough, how could you get much more than 150 people for a test like this? Even divided into two groups 75 data points is enough to demonstrate a significant trend.
And even if he was comparing an average, 150 wouldn't be enough because the sample group was extremely biased, not random at all. If you're working with a biased group, not even thousands and thousands of people are a large enough group. (because no amount of students in his class can form an accurate representation of all gamers everywhere on the world)
But an even more damning criticism was in that I noted how he failed to properly set up what he was actually testing: if gamers hit more often.
The number of shots he let them take are the actual test. Are the hits a result of coincidence, or an underlying trend? And like I noticed, for that case, the sample was way too small, and the method of testing extremely flawed.
Is it safe to assume it comes from the "screening" stage where they are interviewed for their gaming habits and their prior experience with fire arms? Are you suggesting he put all the people who had pistol experience in the group to be tested for link between playing light-gun games and "real world" accuracy with an airsoft pistol. Or is it something else?
My problem is finding that playing 20 minutes on a toy (Wii video game) meant they were better with another toy (airsoft) is utterly pointless. The relevance should be playing ANY video game involving aiming and shooting (like Call of Duty on a gamepad) with a firearm most often used in murders (S&W revolver seems most common). I don't have access to firearms nor even the several hundred people to test this but I genuinely would like to see this test. I think the result will give no advantage to the CoD gamer. Yet He gives them a light gun to play with then instead of testing with an actual Pistol that is heavy (almost 3-pounds fully loaded) hard to load and complicated to set-to-fire and that has significant recoil, a heavy moving slide and spitting hot brass. He instead tests them with a light plastic airsoft pistol with no significant recoil.
I understand he wants to take reasonable safety precautions, but how about using a Simunition that the military uses? This is real guns loaded with reduced power paintball loads instead of lead bullets in the cartridges, they are very unlikely to be lethal but still have significant recoil and don't particularly interfere with the pistol's functioning. Or if you can't do that, just have the test performed with a real gun with one round loaded at a time by a Range Officer who constantly stands by the test subject to make sure they don't point the gun somewhere dangerous.
As to the "hit more often" do you mean that in the test the subjects were just allowed to take as many shots as they liked with no particular instruction? It could be simply the game players simply inferred from the game they played earlier that they should aim for the head. That's all this test would indicate, the power of suggestion.
However if it was, all that would indicate was a greater tendency to fire more shots. Did his witness plate (I presume it was a paper target with human silhouette) also record missed shots? The more I look at this "study" the more sloppy and contrived it seems.
Does anyone have an actual link to where his study is published? If it is even published AT ALL! I hope he didn't just put it on his website without any kind of review or assessment process otherwise we have all wasted a lot of our time.