It is because of the small size and high electronegativity of nitrogen.
Nitrogen has very small size as compared to the halogens, which have much larger sizes. Due to this, they can not remain bonded to the nitrogen atom and hence are highly unstable.