This is a question with many answers. Your folder system would be a hierarchical structure where you put common attributes of your documents in the same folder. For example the document date could be an attribute, leading to year folders with month sub-folders.
Another attribute could be the subject of your documents, assuming many but not all documents have the same subject in common.