When it is considered a lottery, the villagers might feel that, since it's not happening to everyone and only the unlucky are selected, it will not be of any use to complain about it. When a situation is likely to not affect everyone equally, it sometimes becomes unnoticeable or does not seem like it's worth agitating against.