As you sight at the portion of the pencil that was submerged in the water, light travels from water to air (or from water to glass to air). This light ray changes medium and subsequently undergoes refraction. As a result, the image of the pencil appears to be broken.