It is the president, Congress and the courts who holds the federal bureaucracies accountable for their actions. Due to the fact that there are a number of separate agencies present in a bureaucracy, it would be difficult for the president to solely own the responsibility of these agencies. That is why, the Congress and the courts are given certain powers.