So in a chemical change, the product would loses its properties, would form new products and would not be easily reversed.
In a physical change, the products WILL NOT lose any of their properties, WILL NOT form any new products and WILL be easily reversed.
Talking about Water turning to ice I would say it’s all about physical change and not chemical change.
But I would suggest you to either make a research about it or ask your teacher :))