The Umayyad Empire fell due to all of the major leaders attending an ambush disguised as a dinner party by the Abbasid clan. The easiest way to have retained control would have not to centralized all of their leaders which led to the total collapse of the empire when they were killed.