There is a James Hambling ELLIOTT birth registered June qtr 1853 in Totnes - mother maiden name BLANK.
Presumably this is them in the 1861 census at St George's St, Dittisham:
Samuel Elliott 41 Dittisham, Devon (occ. bargeman)
Sarah Elliott 41 East Alverton, Devon
Mary Sarah Elliott 13 Dittisham, Devon
Susanna Elliott 10 Dittisham, Devon
James Hy Elliott 7 Dittisham, Devon
Eliza Elliott 5 Dittisham, Devon
Samuel Thos Elliott 5 Dittisham, Devon
RG09/1416/149
and in 1871 James is a farm servant at Cornworthy working for Sarah HUTCHINGS
GBC/1871/2098/0124