Do you have an approximate date for Frederick and Emma's marriage? Then you could look through the records to get hold of that again. (It might mean that you'd have to go through several quarters, but if you can narrow it down it might not be too bad). Can you make a guess based on your father's birthday, or the birthdays of his siblings?
Also, do you know where your grandfather was in the order of children? Looking in the FreeBMD births I found the following Tanners in Eccleshall Bierlow, which is in the vicinity of Sheffield :-
Charles 4th Quarter 1895 Vol 9c page 401
Walter 1st Quarter 1900 Vol 9c page 441
Frederick 2nd Quarter 1903 Vol 9c page 481
Harold 2nd Quarter 1906 Vol 9c page 436
There were others as well, but they were not names that you'd listed.
On the offchance that this is your family, Charles and Harold were with their parents Frederick and Emily in the 1901 census. Frederick was listed as 29 year turncock (waterworks) from Birmingham (not a fireman unfortunately), and Emily was 28 from Middlesborough.
RG13 Piece 4350 Folio 17 page 26
Just some thoughts! Good luck
Isobel