He didn’t necessarily support locating the capital in the south/ DC, he wanted his financial plan passed and to do that he needed leverage. He offered to move the capital (in a private meeting with Jefferson and Madison) to the south so democratic-republicans would pass his bill.