I will pass these censues onto you anyway:
1851
Class HO107/ Piece 2061/ Folio 78/ Page 8
16 Court, Aston Road
William Ball head mar 32 pearl button maker
Maria wife 28
Charles son 5
Catherine daur 2
Margaret daur 3mo
Edward Glover brother unmar 36 ornament maker
John son 12 do
Rosa daur 10 do
(all born Birmingham)
I do not understand how Edward Glover is a brother to William, unless he is a half brother or a brother in law?

1861
210 Aston Road Birmingham
RG9/2177/102/17
William Ball head mar 38 pearl button maker Staffs Pugeby(may be Rugeley?)
Mariah wife mar 36 Middlesex London
Charles son 15 gun maker b Birmingham
Margaret 9 do
William 7 do
Margaret Ball mother unmar 66 attends to Dron....(?) shop b Shaksl(t)on County NK
So a few inconsistencies between the censuses which will need chasing up. And a few place names that need investigating.
I can't easily see the family in 1871, but I think I found Margaret as a lodger in another household.