Because even though their appearance may be similar their experiences are completely different shmuel replies “a little bit” as Bruno will never fully experience or understand what shmuel went through/is going through. They come from completely different backgrounds and are experiencing completely polar lives, Bruno is living in luxury and moving house and has many workers where as Shmuel is living in complete hell and doesn’t even live in a house at this point and is a worker himself.