I'm NOT convinced that the SWALLOWs are the Wooldale family.
I have transcripts for All Hallows, Kirkburton which includes Scholes and surrounding areas.
I looked for your Joseph SWALLOW bn ab 1826 and here is what I've found -
CANDIDATE 1The Joseph that Heywood found.
Joseph SWALLOWborn 22/05/1826
bap 20/08/1826
father Joseph
mother Martha
abode Cartworth
father's occ Clothier
Looking at the baptisms for the other children that Heywood found in 1851, this Joseph belongs to that family. The rest of the children are baptised from Holmfirth and then the last one from Almondbury. In 1841 they are Woodale.
ORCANDIDATE 2Joseph SWALLOWborn 02/03/1826
bap 11/06/1826
father John
mother Mary
abode Scholes
father's occ Clothier
This is most interesting! This Joseph is from Scholes and in 1841 the family are living in Scholes -
Scholes, Yorkshire - HO107/1277/1/8/9John SWALLOW 50 Woollen Weaver
Mary SWALLOW 45
Jonn SWALLOW 15 Woollen Weaver
Joseph SWALLOW 15 Woollen Weaver
Alfred SWALLOW 1
Ann SWALLOW 5
All born in County
In 1851 this family are still living in Scholes but Joseph is not with them -
Scholes Moor, Yorkshire - HO107/2293/198/10John SWALLOW 60 Labourer Fulstone, Yorks
Mary SWALLOW 54 Netherthong, Yorks
Alfred SWALLOW 21 Woollen Weaver Fulstone, Yorks
Ann SWALLOW 15 Woollen Weaver Fulstone, Yorks
Joseph TAYLOR 40 Woollen Weaver Meltham, Yorks
I still can't find him in 1851 though

I personally think this Joseph is more likely to be the one but I could be wrong of course. I can send all the baptism details for the other children etc or I can look up more baptisms etc if you want.
~ Claire