One of the biggest, and most recent, studies to date concluded there are few differences between our brains. It's a study done in 2019:

https://www.frontiersin.org/articles/10.3389/fnins.2019.00185/full)

In terms of gendered reactions to visual stimuli, this was debunked by a study in 2019: https://www.pnas.org/content/116/31/15671

I also read an interesting book about this topic lately, written by a neuroscientist & neurobiologist Gina Rippon, called 'The Gendered Brain'.

That goes without saying that our environment also plays a big part in shaping our behaviors, as you mentioned. But looking at the recent studies it seems like we might have overestimated how different we really are, at least on the neurological level.