Well, I'm having trouble identifying James on earlier census! There are several candidates but none with a father James

This could be Margaret:
1891RG12/3701 74 12
Leeds, Yorkshire
(Ecclesiastical parish: St Mark's)
9 Bloomfield Mant?
4 rooms occupied John Walker, head, 49, Moulder's labourer, b. Scotland Glasgow
Esther, wife, 48, b. Lancashire Manchester
Elizabeth, dau, 16, Machinist, b. Leeds
Margaret, dau, 13, Tailoress, b. do.Ellen, dau, 10, scholar, b. do.
Harry, son, 7, scholar, b. do.
Esther, dau, 5, scholar, b. do.
For the record, the above family (= widowed Esther with daughters Ellen and Esther) live just a few households away from James and Margaret in 1901.