FDR responded to the threat of Randolph's protest by organising the Fair Employment Practices Commission. This was a wartime government agency that investigated complaints and worked to reduce workplace discrimination. Today, we have the EEOC (Equal Employment Opportunities Commission).
Short answer: The FEPC helped convince FDR.