A few thoughts on last night:
"I couldn't find any redeeming qualities in Albert at all "
(I don't think that census forms list people's qualities, redeeming or otherwise.)
"It was obviously Albert's drinking that caused his children to be taken away"
(No, it's not at all obvious)
"This daughter was in Staffordshire on census day so must have been ripped from her mother's breast and sent away to safety" - only slightly paraphrasing (Huge assumptions here)
"The oldest daughter stayed with them, so obviously she had a much stronger character and was able to stand up to the violence in the household". (No evidence at all)
Perhaps, just perhaps, Zilla hated children. Maybe she was too busy with her business empire to look after her daughters and sent them away as soon as possible. There's no evidence for this, but it's just as plausible a theory.
They never checked to see whether Albert had a criminal record - there may have been a legal reason why he couldn't be listed as proprietor of a licensed premises.