They are known as Teratogens.
These substances are toxic and they harm the embryo. The harm may be psychological, physiological, or even both. They can come in all forms and even include simple things like alcohol which can cause the Fetal Alcohol spectrum disorder, or they can be complex things like radiation.