White owners were primarily worried that the enslaved people would revolt.
As the number of enslaved people grew, white owners worried a great deal that the slaves would revolt. This fear arose due to the oppressive conditions and treatment that enslaved people were subjected to, including physical abuse and harsh living conditions. White owners were aware of the deep-seated resentment and desire for freedom among the enslaved population, which made the threat of rebellion a constant concern. Slave revolts throughout history, such as the Haitian Revolution, served as evidence for white owners of the potential danger posed by slave uprisings.
Learn more about Slave revolts