Each parent will need to have their own insurance. It can be with the same company, but it doesn't have to be. It is fairly common for one person to have government insurance (Krankenkasse) and the other to have private insurance.
deutschlandfuerdummies.blogspot.com/2007/07/health-insurance-for-whole-family.html