This is probably him.
Births Sep Quarter of 1863
~~~~~~~~
PERRY William Elias Stamford 7a 256
So this is his family in the 1871 census
Edward Perry 42 Head born Rutland, Empingham: Ag Lab
Elizabeth Perry 41 Wife Rutland, Leigh
Richard Perry 12 son Empingham
John E Perry 10 son Pickworth (near Oakham)
William E Perry 8 son ditto
Walter Perry 6 son Pickworth
Ellen J Perry 3 daughter Cottesmore
RG10/Piece 3295 Folio 59 Page 18 Parish of Ragdale, 'The Village'