This is a big headache!
So - may I ask which certificates you actually have? The marriage cert to Alice, I suppose, giving his father's name as James? Who were the witnesses - any siblings?
Now you were wondering whose child Charles born ca. 1867 was. I suppose he belonged to Alice:
1871RG10/2482 40 15
Bath St Michael, SomersetAllice Hanney, head, wid, 28, Laundress, b. Gloucester
Ellen, dau, 6, scholar, b. Somerset Bath
Charles, son, 3, scholar, b. do.
Allice, dau, 1, b. do.
Funny that Charles took the boy with him later! I wonder if she died early for him to do so?
I see Alice is with her Bishop grandparents in 1881:
http://search.ancestry.co.uk/cgi-bin/sse.dll?db=uki1881&indiv=try&h=18793207RG11/2437 56 10
Anyway in the meantime, in 1871, Mary Force is in service (a cook), unm, age 22 at Wymering Hampshire.