The place referred to as the "Gibraltar of the West." is the Columbus-Belmont State Park and more specifically the Confederate Fortification (build 1861) in this park, which had the official name of Fort DeRussey.
This fort was considered an important place which allowed the control of the Mississippi river.