One reason this might be has to do with the way your brain processes odors and memories. Smells get routed through your olfactory bulb, which the smell-analyzing region in your brain. It’s closely connected to your amygdala and hippocampus, brain regions that handle memory and emotion.