I'm sorry to hear of your loss Vasquez, and doubly sorry to hear of your regrets. As others have pointed out, don't be hard on yourself. Life gets in the way. Take solace in the fact that you're honouring & enjoying the past with your interest in FH.
My grandmother passed away in July in her 101st year. She was with the picture until 4 days before she died and I enjoyed our visits. Six weeks AFTER she died, a distant relative contacted me to see if I could confirm that there was a third child born to my grandma's parents that didn't survive. It was the first I'd heard of it, but he thinks he found a baptismal record for a 4-day-old baby - & he apparently found the record YEARS ago.
It could be so, though my dad, uncle & aunt have no recollection of hearing of it. Why on earth did this fellow wait so long to ask the question when there was only 1 person that could provide the answer?

Those are the joys of our hobby.
Take care Vasquez & give yourself time to enjoy the memories you have of grandfather.