Well, if it's an outside agency, you can just remove it and go on. Without that, you have to consider how a society would ensure replacement rate fertility. Given some of the tactics SF has proposed to deal with overpopulation -- I suspect they may just not like babies.