freebmd.rootsweb.com shows:
Henry Ernest Ellis, b. Sep 1864 quarter Dudley
Henry Ernest Ellis, m. Sep 1896 quarter Bradford, possibly to Mary Pyrah
- these two seem to fit the information you give.
This might be the 1871 census:
RG10/2996 77/34
Tipton, Staffordshire
William Ellis, 59, grocer employing two assistants, b. Worcs Basall
Ann, wife, 51, b. Dudley
William, son, 22, b. Tipton
George, son, 10, b. Tipton
Henry E, son, 6, b. Tipton
at
www.familysearch.org you can see this family at Tipton, Henry Ernest Eliss, aged 16, parents William and Ann, brothers William, James, and George.
http://freecen.rootsweb.com/ shows Henry E. Ellis with widowed mother Ann and brother James living in Harborne, Worcestershire.