Can I have a happy family????? Has enough time passed where he is more mature and can do this family or am I wasting my time?

I've been dating him for 3 years, a few months in I found he hid 5 other kids from me aged 22 17 16 15 12 & the 10 year old is the one I initially always knew about mind you this is with 5 different mothers. Now he has a lot on his plate I have a child from my ex my son who is 11. He claims that even tho he loves his kids its something that he feels he is automatically judged on therefore hes ashamed of himself for having all these kids with different woman, somewhat understandable. My last relationship wasn't the greatest but I was still learning im 28 and hes going to be 40 this year, we've developed a good connection we enjoy each other's company and we do a lot of fun things together. I'm advancing in my career hes also working hard we spend a lot of time together and our kids have met. His younger ones normally come over & I notice that they have a feud with each other as in they don't like each other because their moms don't like each other and I don't see the drama from the mothers but I can see it within the kids. Obviously I am planning to have more kids and I'm scared if I do that the kids will treat the baby as they treat each other with hate and resentment. I really am into him but I just don't know how to let him know that this is bothering me id like to have more children when I'm 32 which is in 4 years i know I have time but I'm thinking of it now would this family life be able to work?