"I love to hear her speak, yet well I know
That music hath a far more pleasing sound;" means that
he would rather never hear music again
his love is really a musician
music cannot compare to how his love sounds
the speaker thinks music is better than his love's voice