Work backwards.
Remarks (no apostrophe) is a noun.
Clever is an adjective telling what kind of remarks.
rather modifies clever (meaning exceptionally clever).
Answer: Adverb
As an aside, you can always look a word like that up. Rather can be other parts of speech, but it is primary an adverb. That way you can save your points for those dratted Chemistry questions.