Yes, that’s correct, he was born “Raby”.
I’m not sure of political/cultural acceptance years ago, but the Raby family declared themselves “Pig Farmers” not just “farmers” or “Pig Butchers” not just “Butchers” I’m guessing as a means of identifying themselves as absolutely not Jewish.
So for him to drop the name is telling also.