Morally--many scientists in particular could predict the devastating effects of the atomic bomb. They urged leaders not to use the technology because they knew the death toll would be huge.
Financially--some also opposed the production of the atomic bomb as being a waste of money. Traditional military weapons were working and some were skeptical that the technology would even work.