If you look at Polynesians, the women often tend to be bigger as well, maintaining the size disparity seen in other races and cultures. Wouldn't this suggest that evolutionary pressures which will give preference to larger stature bodies are affecting the sexes equally?

If so, then the innate size disparity between sexes was written into our genetic code before we branched off.

I'm not an evolutionary biologist though.