At Familysearch.org, I found the following records for that Joseph Golba of Cook County, Illinois. These are free records so you can see them yourself.
United States World War II Draft Registration Cards, 1942
Name Joseph Golba
Registration Date: 1942
Residence: 14738 Wood Street, Harvey, Cook County, Illinois.
Birth Date: 19 Mar 1879
Birthplace: Makuw, Poland
Illinois, Cook County Deaths
Name Joseph Golba
Event Type Death
Event Date 29 Dec 1959
Event Place Harvey, Cook County, Illinois, United States
Address 14738 Wood Street
Age 78
Marital Status Married
Occupation Laborer
Birth Date 19 Mar 1881
Birthplace , , Poland
Funeral Home The Olen Mortuary
Burial Place Calumet City, , Illinois
Cemetery Holy Cross
Father's Name Stanley Golba
Mother's Name Eva
Spouse's Name Mary Golba
Informant's Name Mary Golba
You can see from this death record that his parents were Stanley and Eva, so he must not be the Golba you seek.
I tried to search for any Golba with father = Ludwik and mother = Apolonia, but came up with no matches.
Then I tried searching for any Golba with birthplace Kielce, and got one match:
United States World War I Draft Registration Cards
Name Thomas Golba
Residence: 1450 Robinson Court, Niagra Falls, New York
Event Type Draft Registration
Event Date 1917-1918
Event Place Niagara Falls City, New York, United States
Nationality Russia Poland
Birth Date 13 Oct 1890
Birthplace Kielce, , Russia Poland
He had a wife and 1 child.
Physical: Gray eyes, brown hair, medium height and build.
United States Census, 1920
Name Thomas Golba
Event Place Niagara Falls Ward 3, Niagara, New York, United States
Gender Male
Age 29
Marital Status Married
Race White
Race (Original) White
Relationship to Head of Household Brother
Relationship to Head of Household (Original) Brother
Birth Year (Estimated) 1891
Birthplace Poland
Immigration Year 1913
Father's Birthplace Poland
Mother's Birthplace Poland
Household Role Gender Age Birthplace
Catharine Warzecha Head M 43 Poland
Thomas Golba Brother M 29 Poland
Joseph Gucza Boarder M 30 Poland
United States Census, 1930
Name Thomas Golba
Event Place Niagara Falls, Niagara, New York, United States
Age 40
Marital Status Married
Race White
Race (Original) White
Relationship to Head of Household Head
Relationship to Head of Household (Original) Head
Birth Year (Estimated) 1890
Birthplace Poland
Immigration Year 1908
Father's Birthplace Poland
Mother's Birthplace Poland
Household Role Gender Age Birthplace
Thomas Golba Head M 40 Poland
Katherine Golba Wife F 40 Poland
Zigmund Golba Son M 17 Poland
Sophie Golba Daughter F 8 New York
Boleslaw Golba Son M 6 New York
You can see all these records at Familysearch.org, including the original images.
Since Thomas' first son was born in Poland, there would be no marriage certificate in the U.S., for Thomas and Katherine.
Additionally, I found these on Ancestry.com:
Social Security death claim:
Name: Thomas Golba
SSN: 106161823
Birth Date: 13 Nov 1890 (the day and year are the same, the month is different from that on the draft registration card.)
Death Date: 16 Oct 1954
Claim Date: 21 Oct 1954
The above record might be the right Thomas, as I found city directories for Niagara Falls for 1954 and 1955. In the 1954 directory, Thomas is listed with wife Katherine named, at 125 22nd, apartment 2. In the 1955 directory, Catherine Golba is listed and designated as "widow of Thomas", at the same address.
Thomas appeared in these Niagara Falls city directories as early as 1916, at that time with an address of 1415 Robinson Ct. There were several other Golbas listed in that city, for that year: Ignitius, two John, two Joseph, Michael and Valentine.
The following might have been the same Thomas Golba, on a ship's list. It listed his final destination as Niagara Falls, NY, on the original page image. However, the 1909 arrival is before his first son's 1913 birth in Poland.:
New York, Passenger Lists, 1820-1957
Name: Tomas Golba
Arrival Date: 25 Mar 1909
Nationality: Russia
Race: Polish
Last permanent residence: stupileo?? (hard to read)
Age: 18
Gender: Male
Port of Departure: Antwerp, Belgium
Port of Arrival: New York, New York
Ship Name: Gothland
Another Social Security death claim, for the daughter:
Name: Sophie Bertha Golba
[Sophie B Golda]
SSN: 106164275
Gender: Female
Race: White
Birth Date: 11 Jan 1922
Birth Place: Niagara Fall, New York
Father Name: Thomas Golba
Mother Name: Katherine Gromna
Death Date: 25 Dec 1995
Type of Claim: Original SSN.
Type of Claim: Death Claim