Volcanos. The Caribbean was formed when the Pacific plate sub-ducted beneath the Caribbean, generating a series of Island archipelagos. This subduction not only generated the Caribbean but also various volcanos along Central America, which is part of the "Pacific Ring of Fire". The formation of the islands can still be seen today with evidence of tectonic activity like the 2008 Haiti earthquake.
Hope I helped :)