Could this be him using the name Henry Peek.

There are army records for a Henry Peek and wife Mary Jane of Stinalees? St Austell Cornwall.
Service No.20620 4th Supply Coy Duke of Cornwalls Light Infantry
Age 48 Born Plymouth
1871 Census Metcombe Ottery St Mary Honiton
James Peek age 37 ag lab born Ottery St Mary, Devon
Elizabeth, wife age 33 born Devon
George Peek, son, 10, born Ottery St Mary Devon
Henry Peek, age 8, born Ottery St Mary Devon
John Peek, age 5, born Devon
Baptism:
Charles the Martyr, Plymouth
10th May 1863
Henry Robert Peek date of birth 1st April 1863
Parents: James and Elizabeth Peek, 22 Green St, Plymouth. James is a labourer