The density of water is a physical property.
You can measure it without changing the water to a different substance.
It is not a physical change because the water does not change to ice or steam.
You can observe a chemical property or a chemical change only if the water changes to a different substance.