Because your forearm has muscles while your fingers don't actually have muscles.
In your fingers you only have tendons which don't contribute to the feeling of fatigue. This is different for your forearms because there you would usually find muscles and which, when worked enough, build up lactic acid that we're feeling as fatigue.