Gregor is afraid of losing that one last part of him. One of the only things he has left is the memories of his past experience and the memories in his bedroom. If he has everything taken out of his room, it won't really feel like is room anymore at all. He is afraid that now he is an insect, his family will be more poor and less happy because he was supporting them before and paying off his parents debt to his boss.