It means that citizens "cannot be compelled to affirm and testify against them, leaving the weight of demonstrating that a man has carried out a wrongdoing to the administration".
At a criminal trial, it isn't just the respondent who appreciates the Fifth Amendment right not to affirm. Witnesses who are called to the testimony box can decline to answer certain inquiries if replying would ensnare them in a criminal action.