The 1881 census seems to support the theory - the children's names match
RG11, 450, 46, Page 43
Benjamin, Mass Head, Married M 24
Benjamin, Catherine Wife, Married F 24
Benjamin, Amy S Daughter, Single F 4
Benjamin, Ernest C. Son, Single M 2
Benjamin, Horace P Son, Single M 1
AMBROSE, John Boarder Single M 21