The reason for the population growth is because Slavery practically transfers millions of population from one area to another.
This not only will increase the initial population of that area, but it also will multiply in the future since a lot of slaves are allowed to marry one another and have their own family