There are a lot of countries that did not occupy or rule Hong Kong. But among the 1st world countries, China, Great Britain, Japan, and the United States, it is the United States that did not occupy Hong Kong. It fell in the hands of Japan on 1938. China and Great Britain (United Kingdom) had the longest time ruling over Hong Kong.