The phrase "leave" in reference to the narrator leaving his poem about Mrs. Stein may be from Ernest Hemingway's work "A Moveable Feast." In this memoir, the narrator reflects on his time in Paris and interactions with various literary figures, including Gertrude Stein. However, the exact wording and context may vary, so I recommend checking the specific passage in "A Moveable Feast" to find the accurate quote.