Yes it does look possible for the family to have been in Scotland for a few years. Before 1843 children born in England had births registered, but between 1844 and 1848 no children registered in England - and the oldest son John married in Glasgow.
The son Robert born 1848, died in Oct 1852 in Burslem. I think we presume he was also born in Scotland. Then the family returned home before the father Robert died in 1850.
Death certificate is available
STUBBS, ROBERT Age 43
GRO Reference: 1850 J Quarter in WOLSTANTON AND BURSLEM UNION Volume 17 Page 208