I think that Desiree's nightgown symbolized her innocence and life.
Armand showered Desiree with fine things to show her off as his possession. When he casted her out with her baby, Desiree was only wearing a nightgown. It represented how everything she owned was not here but Armand's.