Hi
I did a bit more work on this and found a tentative link to Yorkshire with birth date of James in the right period plus link to another Daltrey (cousin) who definitely moved to London - also no further records in Yorkshire of this James. Hopefully the attachment explains a bit more !
Keith