You're right, creo is the indicative 'yo' form of 'creer'.
Cerrar is an irregular verb. To say 'I close' would be cierro, yet the infinitive is cerrar, so the stem would change depending on how the verb is conjugated.
The infinitive of empiezo is 'empezar'.