There are rule for capiltalized letters. The names of languages are always written with a capital letter. According this rule, the noun French should be capitalized in the sentence.
The sentence would be: My friend is taking a class at the local community college to learn French.
But French as a subject should be not capitalized, because names of disciplines and school subjects are not capitalized.