Johnson's and Goldsmith's political views were nearest those of a Tory.
Tories were one of the two important parties in Britain during the 17th - 19th centuries (the other one being the Whigs). Whereas the Whigs wanted to depose of King James II/VII, the Tories wanted him to stay and rule. Even though both Johnson and Goldsmith lived during the 18th century, they were still heirs of Tory beliefs.