They hated carpetbaggers for making a profit off the southerners misfortunes. Scalawags, who were southerners, were hated for working with free blacks to form governments in an era when the "respectable people" who had supported confederacy couldn't.