Hi,
Firstly after a bit of tracking I think the one in Tatham could be the correct family, although at first glance I thought against it. By the way. there are only two Stephen Calverleys on the 1841 census and I am also fairly sure that the one in Whitewell is your Stephen. The other one is still in the same area on the 1851 census.
Now, as you already know, his father Stephen Calverley married Mary Wilson at Waddington on 29th October 1807. He was from Waddington and she was from the parish of
Mitton(keep this in mind). Both signed and the witnesses were Ralph Earnshaw and William Blackburn
Baptisms in Waddington:
18th September, 1808 Ann daughter of Steven Calverley of Waddington
11th Februrary, 1810
JAMES son of Steven and Mary Calverley of Waddington
5th April, 1812 Margaret daughter of Steven Calverley of Waddington
James Calverley born WADDINGTON aged 41 turns up on the 1851 census as a farmer of 118 acres at Oxenforth Green, TATHAM. He is also at the same address in the 1841. Possible mother Mary, Farmer of 48 Acres is only a few folios away and born in what really looks like Balshaweaves but I bet it is a pronunciation error at the time and the fact that there was a "Balshaw" in Tatham. My money is on Bashall Eaves just above Mitton.
Hope this helps,
Mo
P.S,. Yonderpeasant - that dog looks decidedly Wheatie

Am I right?