The start of a vague connection?
The Thomas Pugh(aged 10) with Joseph in 1841 may be the same one as a nephew(aged 22) with
Elinor Evans,circa 1811 at Cwmffrwd in 1851(though admittedly he would have to appear twice in 1841 as he is there with Elinor in 1841,as well as a Margaret Evans b.1767)However,there is a baptismal record for Thomas Pugh,born 1828 to Stephen Pugh and Mary Evans of Cwmffrwd,so this property,and an Evans family is clearly involved.
There is also a Jane Evans(c.1801) with Joseph in 1841and a John Rowlands.
The 1851 census also has an Evans family and a Rowlands family(possibly with the Evans son at the Rowlands),which may help tie in as a family group at properties called Pen y Cnwch and Tan y Cnwch.
These properties are near the Clawdd Cerrig/Llwyn Goffre grouping
The possibly more interesting fact is that Cwmffrwd was the 1753 will address of the "other" Edward Richard of Ystrad Meurig,who left his property including a Pant y Ffynon,to a Margaret Richard,whose status is awkwardly worded.
Maybe your Richards are related to the other Edward Richard(s) of Ystrad Meurig!
Regards
Roger