The mean is the average of a set of numbers.
An outlier is a number that is significantly higher or lower than most of the data set.
So, therefore, when you are calculating your mean, the outliers in your data set sway your average higher or lower.
In these instances, the median is usually a better indicator of central tendency.