They wanted to avoid political parties because it results in people taking sides, larger scale disagreements, and even full out war. Which, by the way, is exactly what happened when the US divided into parties. Like Abraham Lincoln said, "A house divided against itself cannot stand," and that is exactly what politicals parties do, they divide people.