The answer to the question is: The Dutch. They were the colony who controlled New York before it became an English colony in 1664. The colony of New Amsterdam was established by the Dutch West India Company and settled in the southern parts of Manhattan Island and grew in the present day New York, Long Island, Connecticut and New Jersey.