None of the military records connected with Albert's death that I've found give his age or parents but this might be him in 1891
Living in Spencers Wood, West Swallowfield
Edward Cox Head 51 General Labourer Beech Hill, Berkshire
Elizabeth Cox Wife 38 - Mortimer, Berkshire
Lily C Cox Dau 6 Scholar Swallowfield
W??? E Cox Son 4 Swallowfield
Albert Cox Son 2 Swallowfield
Amy Cox Dau 10months Swallowfield
The best match in 1901 is in Reading and Wokingham District School. He is listed as a pauper scholar age 12 born Spencer's wood. There is also Edward Cox age 14 born Shinfield and James Ernest Cox age 8 born Spencer's Wood in same school.
There is a death of an Edward Cox registered Q3 1894 Wokingham district age 54 which would match with this Albert's father.
And it looks as if Elizabeth his mother is a servant in Maidenhead in the Rogers household
Piece: 1158, Folio: 84 Page: 47
Can't find his sisters Amy and Lily in 1901, but have found both Lily and her mother in 1911.
There are a couple of military records on Ancestry that have an Albert Cox / Albert Edward Cox which give birthplace as Ewshot and residence as where his mother is in 1911, which seem a bit confusing as year of birth is wrong. The Albert who joined Militia in 1904 said he was 18 years 0 months - is that a bit suspicious and he was actually younger?