Cerebellum. Our sense of balance mostly depends on our cerebellum. While we do need the proper functioning of multiple brain regions, the cerebellum has been shown to be most responsible for balance.
If someone doesn't have a properly functioning cerebellum, he will most likely also have a problem with balance.