The fashion designer says she and her husband have ‘grown together’ while raising four kids