1881
RG11 3935 84 7
has 2 Annie Dowlers on it in Manchester area , one age 24 and one age 3
so by James's birth in 1896 they would be 39 and 18, so either could potentially be his mother.
Although as we have never found her on a census, we do not know when or where she was born - could be anywhere! All we know is she was in John Wood Street in 1896 and was of childbearing age at that time.