Each substance has its own unique structure and properties that are based on these structures.
One of those most important properties is the "specific heat" value.
Specific heat is defined as the amount of heat required to raise the temperature of a unit mass of a substance by 1 degree Celsius.
Each substance has its own specific heat. The higher the specific heat of a substance, the longer it will take to heat up or cool down.
Hope this helps :)