His wife died 1922 so maybe he married Mary Anne after that date.
Hi Isy
Just a little more (in case you're interested about Mary Ann ? )

There doesn't appear to have been a marriage between Mary Ann (Marzie / Margie) and Henry Baylie CULLERNE.
Mary Ann was formerly known as (surname) SPERRY and the births, 1901 and 1902, of her sons with Henry, also appear on the Birth index under SPERRY.
She apparently came to NZ from the USA with a husband and 2 sons.
PapersPast has a couple of items regarding her brave soldier sons, Fabian and Reginald P. SPERRY.
http://paperspast.natlib.govt.nz"Auckland Star" - 24 September 1915 - Roll of Honour [re: Francis Fabian M. SPERRY - s/o Mrs M. CULLERNE of 69 Summer Road, Auckland.
1919 - Auckland West e/roll has - Mary Ann and Henry CULLERNE, Architect, at that same address. ]
"Evening Post" (Wellington) - 11 December 1917 - Personal Matters[re: R.P. SPERRY (Reginald) - s/o Mrs CULLERNE ]
Additional details of these boys at Auckland Museum Cenotaph website >
http://muse.aucklandmuseum.com/databases/general/basicsearch.aspx?Dataset=cenotaph ~ Lu