The simple truth: If you really wanted to do it, EVERYTHING ELSE would be on your back burner and you would do it. NO EXCUSES!
There have been days where I've practiced guitar drills for over 8 hours in a day. This was when I was working 50+ hours a week. If you really want to do it, nothing is going to stop you.
ON THE OTHER HAND,
when you bring kids into your life, it's inevitable that your focus must be re-allocated. I definitely wouldn't recommend you let your music recording take over the majority of your time. I honestly don't see how someone could do this AND have kids AND do a good job raising them. I'm sure many will chime in saying that it's possible, but I seriously just can't believe it. Kids need LOTS of time, and as hard as it is to hear it, they deserve it much more than your studio does. Get away from that desk and spend some time with your kids. There are far too many crap parents nowadays.