As you go to higher altitudes, there are less air molecules pushing down on you (lower pressure). When the pressure of a gas decreases, the temperature also decreases (the reverse is also true – when the gas pressure increases, the temperature increases). Therefore, the air temperature is lower at higher altitudes.