The correct answer is Serge had studied Latin for three years before he started college.
The Past Perfect tense is used to talk about an action that was completed at some point in the past before another action that also happened in the past. This tense is formed with the auxiliary verb Had + Past Participle of a verb.