There were a lot of people in those states that didn’t want to fight the southerners as they were their fellow man. This made it so states like Virginia, Arkansas, North Carolina, and Tennessee left the Union. Upon doing this, they weren’t forced to fight against their own people.