Any connection to Yarmouth you know of ?
This chap has the right initial and YoB - but theres another lad born Norwich 1891 +/- 1 year who may also be a candidate, albeit with no middle initial...
you will have to get his Birth Cert (details above) to be 100% certain .... unless you recognise any of these names ?
1901 - RG13/1811; Folio: 45; Page: 34 - Great Yarmouth
16, Maude Terrace
James Miller 35 Head Woodworking Machinist (categorised Sawyer) born London, Middx
Ellen A Miller 36 Wife Norwich
Ellen M Miller 12 dau Norwich
Edith M Miller 11 dau do
Alfred J Miller 9 son Norwich
Frances V Miller 3 dau Great Yarmouth
Sidney Miller 1 son do
Added: Looking at the 1891 census, James was born in Tottenham, Middx.
Looking further back, his father was Francis (c1821) from Bramerton, Norfolk - a ship Brokers Clerk.
1861 shows a PoB of Brandon - and he is married to Emily from Surlingham, already in Tottenham .... oldest child is 5.
Possible marriage:-
Marriages Sep 1854
Miller Francis Norwich v4b p275 to Nobbs Emily
Emily can be seen in 1851 Surlingham, with Father Robert.
Francis is also in the area - farming 130 acres, with 13 men !