In New York City, the first “garbage dump” was the ocean.
About 80% of New York's garbage was dumped in the ocean until the 1950s approximately, the garbage was such that eventually, it became artificial land, and upon these lands, neighborhoods were built, increasing New York's own size.
Nowadays, the garbage is dumped in certified landfills or is recycled and dumping waste in the ocean is not common at all.