The reminder of guilt was the statement of the hideous beating heart. The narrator had murdered the old man but had not admitted to his crime. The thought and reminder of the beating heart prompted the narrator to lose control and turn himself in, as it reminded him of the murder that he had committed.