This 1871 census is complicated.  It appears to have George and Kate, John's children born to his wife, Mary Jepson/Wood.  
All Charlesworth's born Heckmondwike.  Living: High St, Heckmondwike.
John Charlesworth     51, Fishmonger
Mary Jane Charlesworth    40
James Charlesworth    18
Henry Charlesworth    15
John Charlesworth    12
Edward Charlesworth    10
Charles Charlesworth    4
Mary Ann Charlesworth    25
Hannah Charlesworth    20
Ann Charlesworth    8
Charles Drew    50, brother, Norfolk
George Drew    45, brother, Norfolk
George Wood    20, son in law, iron moulder, Rotherham
Kate Wood    14, daughter, Rotherham
 1881c
 Dennis CHARLESWORTH   Head   W   Male   69   Liversedge, York, England   Card Maker (S M)     
 Ann WOOD   Daur   W   Female   44   Liversedge, York, England   Housekeeper (Dom)     
 Allatt CHARLESWORTH   Son   W   Male   43   Liversedge, York, England   Card Maker (S M)     
 George H. CHARLESWORTH   Son   U   Male   33   Liversedge, York, England   Farmer     
 Frederick CHARLESWORTH   Son   U   Male   30   Liversedge, York, England   Card Maker (S M)     
 William WOOD   Grandson      Male   12   Liversedge, York, England   Scholar     
 Benjamin LEWSEY   Serv   U   Male   40   Huddersfield, York, England   Farm Servant (Ag Lab)     
Hightown Liversedge, York, England