In 1492, Columbus thought he was in Asia because that's what he and his crew were searching for, so they could find gold, jewels, spices, etc.
As far as Columbus knew, he could just sail west and get to Asia. He didn't realize that America was between Spain and Asia. The Bahamas and Cuba fit the descriptions of what they knew about China and Japan.