Thanks Sandra. This is all stuff I have already as Matilda was my great-grandmother.

. Alice Pritchard is actually daughter Alice (so she may have been living with her at the time as Alice was living in Toronto where she died). This family was already my mystery: Charles just added to it with the possible home child discovery!
In 1891, all three girls are living with their parents. In 1901, the two oldest are "adopted daughters" of German speaking families. Can't find the youngest (Edith) or mother Elizabeth on this census. I believe I have found Charles (maybe) living in Toronto as "single". 1902, he married Sarah Jane Freel (definitely him as his parents are right), calling himself a "bachelor" and in 1911, he was living in Toronto with wife Sarah, claiming he was naturalized in 1901.
There is another part of this. My father (grandson of Matilda) remembers seeing a family tree as a child that had an aboriginal woman, living on the Bruce Peninsula, which is where Elizabeth was from (Keppel, Ontario). So there is a possibility that the girls were given to white families to raise.
Edited to add that it seems that Isabella was born in Ontario, despite some records indicating otherwise.
And all three girls had their biological parents on their marriage licenses.
Also Matilda's birth certificate lists her grandmother (i.e. Charles's mother) as her mother, rather than her actual mother.
Final addition: the German speaking adoptive families are related (the one adopted mother is the mother of the other)
1921 Owen Sound Grey Ontario
Elizabeth Flowers 37 (age should be 57)
Isabella Bayliss 83 Born 1838 England.
Isabella passed away 26 May 1926 - Grey Ontario.
Isabella is shown on find a grave but some details on Elizabeth are incorrect 
FIND A GRAVE
Isabella Lougheed Baylis
Burial - Greenwood Cemetery Owen Sound Grey County Ontario.
http://www.findagrave.com/cgi-bin/fg.cgi?page=gr&GRid=40727455&ref=acom
Sandra