Batteries supply electrons to the circuit by releasing negatively charged atoms or ions. These ions are produced by the batteries through a chemical reaction that spontaneously occurs within the battery. So the negative end of the battery pushes the ions towards the positive end of the circuit with the help of the voltage. This is why eventually, batteries "run out" when the electrode is used up and the chemical reaction can no longer continue.