Yes he does
Dori was a bad kid 
Look I love addie and Harry, but they didn’t actually care about their kids. Jess and Anna were collateral for the two of them to get and stay married without her parents interfering
Neither of them wanted those kids
they barely knew each other at the time
and realistically, Addie still loved Leo, and Harry was upset for losing Leo
this was a business deal but over the years they became better friends and actually started loving each other