Hi there
This is the only James Williams showing a connection with Colchestr on the 1871 census .
Name Age in 1871 Birthplace Relationship Civil Parish County/Island?
Ada Constance Williams 2 Brixton, Surrey, England Daughter Lambeth London
Charles Williams 10 Kennington, Surrey, England Son Lambeth London
Esther Williams 34 Marylebone, Middlesex, England Wife Lambeth London
James Williams 27 Colchester, Essex, England Head Lambeth London
William Williams 4 months Brixton, Surrey, England Son Lambeth London
If you think it could be the correct James, I will then post full reference details and a scan
Chris in 1066Land