The reaction is:
4Li(s) + O2 (g) = 2Li+ + 2O-2(s).
The oxidizing agent is the one that is being reduced which is oxygen where the charge changed from neutral to -2 while the reducing agent is the on being oxidized which is lithium where the charge change from neutral to +1.