I think this may be your Henry on the 1861 census:
RG9/4438 folio 66 page 1 (Transcribed as Burbigh)
HMS Charybdis
H Burleigh, 29, Single, Lieutenant, born Antrim, Ireland
Royal Navy At Sea And In Ports Abroad
I strongly suspect, but can`t prove, that he was the son of William Burleigh J.P. and Lucretia Wills of Carrickfergus.
The Newry Commercial Telegraph, February 25, 1828
At Carrickfergus Church, on the 15th instant, by the Rev. J. Dobbs, WILLIAM BURLEIGH, Esq. jun. of St. Catharine’s, to LUCRETIA, eldest daughter of James Wills, Esq., Scoutbush.
There is a strong Naval background with the family. Their widowed daughter Lucretia married a RN Commander and there is also references to a Hercules Richard Burleigh, a Commander in the RN who was the son of the above William Burleigh.
Freeman's Journal and Daily Commercial Advertiser (Dublin, Ireland), Tuesday, May 15, 1866
Marriages
9th May, 1866 at Belfast, Arthur Brownlow, Commander Royal Navy, to Lucretia Euphemia, widow of Richard Dobbs and eldest daughter of William Burleigh, Esq, Carrickfergus.
The Belfast News-Letter (Belfast, Ireland), Saturday, June 20, 1891
Deaths
Burleigh – At Calcutta, of fever, Hercules Richard Burleigh, youngest son of the late William Burleigh J.P. Carrickfergus.
Hercules was 48 when he died and actually died at sea according to the Probate index.
This is Henrys Marriage:
The Belfast News-Letter (Belfast, Ireland), Monday, March 30, 1863
Burleigh and Stott - March 28, at Ballymoney, but the Rev. J.R. Phillott, assisted by the Rev. James O`Hara, Henry C Burleigh, Commander R.N., to Emily Hester, daughter of the late John Stott, Esq.,
No Cards.
Regards,
Mo