I agree with you on that. My mum and grandmother never stopped repeating the family stories. I am lucky in that some of them must go back to the 1870s and 1880s. The reason I started tracing the family, back in the 1970s, was that, as I told my mother at the time, 'Either this is history or it's baloney and I think we ought to sort out which !'
In fact, more turned out to be true than I would ever believed at that point. Good luck with your ancestors too.