First off, don't let what others say get to you at all. Some people say the dumbest things, they usually don't even realise it, just try to ignore it.
The gender thing I understand, we already have a daughter, and knowing that there are 3 in there, I really wanted one or two to be boys. A boy would also mean the first boy in the family to carry on my DH's family name. So I did put importance on it.
A friend of mine kept "trying" to have a girl, after having multiple boys, she got pregnant again wanting a girl and when she found out it was another boy she was mad.. upset.. angry.. and in a way she sort of took it out on him when he was born. I felt sorry for him.
Just remember that it's a real blessing to have these little lives.. and what matters is that they're happy and healthy and loved... (no matter what's between their legs) 
hugs to you
