The minimum sample size needed for reliable conclusions varies. For surveys, around 400 samples are often used for a 95% confidence level and 5% margin of error. In this game, factors like loot variability/wave can affect this, so more samples might be needed for accuracyI have an off topic question, what would the minimum sample size be for data needed in order to draw a statistical conclusion from ?
Perfect thanks. I am going to hate statistics. 20 samples per run at a cost of 3.1 ped (yes I am going to use an md1) roundup(400/20,0)*3.1 is about $7 total. Also the locations that I am going to be sampling from are not exactly going to be random, but that is the point, I want to see by how my sample hitrate differs from the mean.The minimum sample size needed for reliable conclusions varies. For surveys, around 400 samples are often used for a 95% confidence level and 5% margin of error. In this game, factors like loot variability/wave can affect this, so more samples might be needed for accuracy
I have an off topic question, what would the minimum sample size be for data needed in order to draw a statistical conclusion from ?
It also looks like some areas are biased to either ore or matter.
There’s a post I mentioned it in awhile back with the details, but you’d just have to use a power calculator to determine minimal sample size. At least for the tests done in my threads, the sample size was already more than enough. More is needed depending on what the response variable is, number of comparisons, etc. I’ll see if I can dig the numbers up again someday. IIRC, around 400 was a good amount for the finder decay testing, in part because it dealt with small differences.The minimum sample size needed for reliable conclusions varies. For surveys, around 400 samples are often used for a 95% confidence level and 5% margin of error. In this game, factors like loot variability/wave can affect this, so more samples might be needed for accuracy
Makes a lot of sense.There’s a post I mentioned it in awhile back with the details, but you’d just have to use a power calculator to determine minimal sample size. At least for the tests done in my threads, the sample size was already more than enough. More is needed depending on what the response variable is, number of comparisons, etc. I’ll see if I can dig the numbers up again someday. IIRC, around 400 was a good amount for the finder decay testing, in part because it dealt with small differences.
As for variability or waves, that should already be incorporated into the statistical tests or especially experimental design for the latter. If you are concerned about waves while testing the difference in average MU between treatments or something like that, waves shouldn’t be a confounding factor if you’re switching between treatments (e.g., amped or not) each claim.
That’s partly why you don’t go testing one method X-hundred times and then go try the other method the same amount, especially if it’s over the course of days or weeks later. The two aren’t statistically comparable at that point. If you keep the treatments as close to pair-wise as possible, then both should be getting the same background variation from nuisance factors.