True, all the way! Of course you will be able to understand the poem better if you have bakcground knowledge on it. If you bring knowledge of areas such as history and mythology in relation to that poem not only will you be able to understand the poem better but probably will be able to distinguish the figurative language of allusion at its finest within the poem.
Hope this helps, if you anymore help or further explanation just let me know! :)