People will always object to parts of the method. We cannot create a method that everyone will completely agree with - as stated in the Pre-Amble - because we all have different opinions on what should and shouldn't count, and debates over opinions just rage on forever... :/

In 2006 when I started the polls, I told everyone that this would be the only time that I would be doing this - and thus to ensure that everyone made their votes count.

Quote Originally Posted by jaydisc
If the method is truly sound, the voting results shouldn't change.
But the data would be useless for annual comparisons if the voting results changed. For example, we would not be able to compare the results of the 2007 collection count survey with the 2008 survey if the 2007 and 2008 data was gathered under different counting definitions.

Say for example in 2007 we've allowed multiples to count. Say we have two collectors - Transfan X who and Transfan Y.
Transfan X owns...
+ Seaspray
+ Seaspray
+ Laserbeak
Transfan Y owns...
+ Seaspray
+ Laserbeak
In the 2007 survey where multiples count, Transfan X owns 3 Transformers and Transfan Y owns 2 Transformers.

Now let's say for the 2008 survey, voters decide that multiples should no longer count. And let's say that over the next year Transfans X and Y acquire no more Transformers, thus their collection count remains static. But due to the new counting definition, their collection count both becomes 2.

This is obviously an extremely simple example, but you can see how in more complex cases with much larger collections numbering in tens, hundreds and thousands where a slight alteration in counting rules can drastically alter the results.

And what would happen in this example is that we would observe an overall decline in the collection size between this sample of fans despite the fact that in reality their collection size didn't alter at all.

At the end of the day, if you don't like this method, don't use it. It's a Serving Suggestion for when you want to compare your collection count with other people's. If you and the other person(s) all don't like it, feel free to sit down and agree to a common system amongst yourselves that you all might feel is gooder.

The only time this system becomes mandatory is if you choose to participate in the annual collection size survey because we want to maintain integrity in results to compare annual trends.