Assuming you're still referring to the Fifteenth Amendment, many critics pointed out that the newly-freed slaves lacked the proper amount of education to make informed voting decisions, and that it would be detrimental to the state to have them vote in general and local elections.