Did he marry in 1832 to Eliza Grinter at Hinton St George?
There's a Thomas Frost aged 28 on the 1841 census, occupation thatcher Ref HO10107, Sched 1, piece 940 folio 13 page 18.
In addition to Elizabeth aged 30 there are Charles 15, Eliza 10, Ellen 6, Mary 2 and George 0. Also Jean & William Frost both aged 53.