Small populations tend to lose genetic diversity more quickly than large populations due to stochastic sampling error (i.e., genetic drift). This is because some versions of a gene can be lost due to random chance, and this is more likely to occur when populations are small.