Right man, but this was his first marriage (to my Grandmother). Both wives were named Florence.
Grandma & Grandpa were divorced and she went on to remarry. I found that marriage record, so that confirmed that they were, in fact, legally divorced.
I remember hearing that churches here, in Canada, would not marry a divorced person. So if he did actually marry Florence #2, it would have had to be civil or in a Unitarian church.