You make a reasonable argument, that the wage gap is due to women being inclined to raise children and take time off work.

What you're saying there, is that it has absolutely nothing to do with "patriarchy". It's just unfortunately consequence of women taking time off work to raise children.