The serfs had the fewest rights in feudal society. Serfs were common people who were compelled to a certain piece of land. Serfs were not slaves but they had to do the task allocated to them and if they did not, they would be punished. In the feudal system, serfs were at the bottom of the social order.