You have to be smart, yet you don't have to be a prodigy. You have to have the ability to learn new things and solve equations fluently. If you could be a little more specific, like what courses do you have to take to become a physicist, then my answer would be more specific.