Without Affirmative Action; would women and minorities have come up as quickly as they have?

Someone prevented from moving into higher positions due to discrimination may still be legitimately blocked after the discrimination ends due to lack of experience etc. Without affirmative action; would women and minorities have moved into higher positions as they have?