If the 1891 census is correct then this could be him in 1871:
RG10/2667 51 11
St Pancras, Gloucestershire
Henry Caines, head, 47, Stonemason, b. Cheltenham
Louisa, wife, 48, b. Painswick
William, son, 15, Stonemason Labourer, b. Cheltenham
Louisa, dau, 6, scholar, b. do.
Sounds quite plausible to me, given the family are at Leckhampton (=the place stated as his birth place on the 1901 census) in 1861: RG9/1795 78 21 (different wife for Henry though)
And just in case you have trouble finding them in 1851 (I did!) the reference is HO107/1972 208 18