The Factors that led to the Decline of the Middle Ages. The late middle ages were years filled with turmoil. Famine, plague, turmoil in religion, and a war lasting over one hundred years all happened within the same two centuries. The middle ages declined in part because of famine and plague.