They still lived in ghettos, despite being "free", they lived under the shadow of slavery, since, unlike those from the north, they were not allowed many things, like congregating in a church, they were not allowed to travel, vote, or enjoy certain rights, so they just wanted to keep their freedom, no matter what.