The Dutch, Swedes, and Finns were the first European settlers in New Jersey. Bergen, founded in 1660, was New Jersey's first permanent European settlement. In 1664 the Dutch lost New Netherlands when the British took control of the land and added it to their colonies.