The figure of speech used here is a Metaphor.
A metaphor is a figure of speech that says that one thing is another different thing, so here it is being said the 'some of us had two worlds' meaning that they are living two different lives at the same time.