Well it would depend how cold it would be, but I would say if it's below freezing cold, personally (when I go skiing actually) I would dress up in an under layer thing (I don't really know what you call it), a fleece sweater, (assuming there's snow) snow pants, and a jacket.
If you're climbing Mt. Everest, that's a whole different story.