Hirsch is German for 'stag' and Berg is 'mountain'. I don't know anything about Yiddish except that it is related to German.
The 1913 Valuation Roll lists several Hirschbergs, none at 22 Queensgate. See screenshot.
The part of the arcade leading off Queensgate is called Queensgate Arcade. Could Louis Hirschberg's shop have been 22 Queensgate Arcade rather than 22 Queensgate?
Louis Hirschberg married Lottie Kahn in Glasgow in 1899. The marriage certificate wil tell you which religion they were married in, if any.
The 1901 census records that Louis and Lottie, and Louis' brother Nathan, were born in Russia. Both Louis and Nathan were jewellers.
There were at least four children born in Inverness: Natan, 1901; Oscar, 1902; Samuel Jack, 1906; Abraham Moses, 1911.
The 1911 census index lists in Inverness Lottie, 35; Louis, 34; Sydney, 10; Nathan, 9; Oscar, 8; Frederick, 6; Jack, 4; Moses, under 1 year.
The birth certificates and/or the original documents will give the addresses where they lived.