Weary of the Negro Question means that the person does not want to deal with the question of racism and slavery any more and the ways of promoting civil rights, while the second one means that the person is sick of Northern Politicians who moved south just to become the ruling class.