Answer: In principal, yes.
Explanation: If you heat up the air so it is warmer than the surrounding air, then you will have a buoyancy force. But we almost always use helium or hydrogen when going up to the stratosphere. Using light gases, you get a much larger buoyancy force for the same volume than you can get with hot air. Hope this helps.