F=ma
Inertia is a property of mass that resists to a change in motion. Mass and inertia is directly proportional so the less mass there is, the easier it is to make it accelerate.
In equation F=ma,
if we make acceleration constant, force is directly proportional to mass. Therefore the empty cart(less mass) requires less force to have the same acceleration compared to the full one, thus easier to push