If you haven’t already done so, you could try something like the My Heritage auto cluster tool to group your matches. In theory, you should/may be able to find matches who do not fit with your known branches therefore should/may be from your grandfather’s line.