Not sure, Alastair, but it's not impossible. I've seen it a few times. Most ordinary folk couldn't divorce in those days anyway - would need a private Act of Parliament - RC or not.
I can't find him very easily on the censuses - he had a sister Margaret who was the widow of a John Fraser. She seems to have inherited. A cousin, Archy Chisholm, registered the death.
An open mind is maybe worthwhile - don't discount yet.