If we are honest, I think most of us only started to look into our family history from our middle age onwards. [...]
I agree. There are a few who start young, but most of us needed a "kick-start" (significant event) in later life to get us going.
If you have kids, then
Don't throw it away, whatever you do!
, just pack everything away in a box (or leave instructions for this) and hand it on to your children with the instructions to either look at it when they have the urge, or to pass it on to their kids, when
they start to have questions about where they came from.
Otherwise, it's as sue1950 says, we all have our hobbies!
We get our pleasure out of them but we can't demand that others do, too. If it dies with us, then it dies with us. Sad, but then our children or childrens' children also get the chance to say -- as we do -- "if only I'd thought to ask them then ..."
Bob