At Familysearch.org, I found the following records for that Joseph Golba of Cook County, Illinois.  These are free records so you can see them yourself.
United States World War II Draft Registration Cards, 1942
Name    Joseph Golba
Registration Date:    1942
Residence:  14738 Wood Street, Harvey, Cook County, Illinois.
Birth Date:    19 Mar 1879
Birthplace:  Makuw, Poland
Illinois, Cook County Deaths
Name    Joseph Golba
Event Type    Death
Event Date    29 Dec 1959
Event Place    Harvey, Cook County, Illinois, United States
Address    14738 Wood Street
Age    78
Marital Status    Married
Occupation    Laborer
Birth Date    19 Mar 1881
Birthplace    , , Poland
Funeral Home    The Olen Mortuary
Burial Place    Calumet City, , Illinois
Cemetery    Holy Cross
Father's Name    Stanley Golba
Mother's Name    Eva
Spouse's Name    Mary Golba
Informant's Name    Mary Golba
You can see from this death record that his parents were Stanley and Eva, so he must not be the Golba you seek.
I tried to search for any Golba with father = Ludwik and mother = Apolonia, but came up with no matches.
Then I tried searching for any Golba with birthplace Kielce, and got one match:
United States World War I Draft Registration Cards
Name    Thomas Golba
Residence:  1450 Robinson Court, Niagra Falls, New York
Event Type    Draft Registration
Event Date    1917-1918
Event Place    Niagara Falls City, New York, United States
Nationality    Russia Poland
Birth Date    13 Oct 1890
Birthplace    Kielce, , Russia Poland
He had a wife and 1 child.
Physical:  Gray eyes, brown hair, medium height and build.
United States Census, 1920
Name    Thomas Golba
Event Place    Niagara Falls Ward 3, Niagara, New York, United States
Gender    Male
Age    29
Marital Status    Married
Race    White
Race (Original)    White
Relationship to Head of Household    Brother
Relationship to Head of Household (Original)    Brother
Birth Year (Estimated)    1891
Birthplace    Poland
Immigration Year    1913
Father's Birthplace    Poland
Mother's Birthplace    Poland
Household    Role  Gender  Age   Birthplace
Catharine Warzecha    Head    M    43    Poland
Thomas Golba    Brother    M    29    Poland
Joseph Gucza    Boarder    M    30    Poland
United States Census, 1930
Name    Thomas Golba
Event Place    Niagara Falls, Niagara, New York, United States
Age    40
Marital Status    Married
Race    White
Race (Original)    White
Relationship to Head of Household    Head
Relationship to Head of Household (Original)    Head
Birth Year (Estimated)    1890
Birthplace    Poland
Immigration Year    1908
Father's Birthplace    Poland
Mother's Birthplace    Poland
Household    Role  Gender  Age   Birthplace
Thomas Golba    Head    M    40    Poland
Katherine Golba    Wife    F    40    Poland
Zigmund Golba    Son    M    17    Poland
Sophie Golba    Daughter    F    8    New York
Boleslaw Golba    Son    M    6    New York
You can see all these records at Familysearch.org, including the original images.
Since Thomas' first son was born in Poland, there would be no marriage certificate in the U.S., for Thomas and Katherine.
Additionally, I found these on Ancestry.com:
Social Security death claim:
Name:    Thomas Golba
SSN:    106161823
Birth Date:    13 Nov 1890  (the day and year are the same, the month is different from that on the draft registration card.)
Death Date:    16 Oct 1954
Claim Date:    21 Oct 1954
The above record might be the right Thomas, as I found city directories for Niagara Falls for 1954 and 1955.  In the 1954 directory, Thomas is listed with wife Katherine named, at 125 22nd, apartment 2.  In the 1955 directory, Catherine Golba is listed and designated as "widow of Thomas", at the same address.  
Thomas appeared in these Niagara Falls city directories as early as 1916, at that time with an address of 1415 Robinson Ct.  There were several other Golbas listed in that city, for that year:  Ignitius, two John, two Joseph, Michael and Valentine.
The following might have been the same Thomas Golba, on a ship's list.  It listed his final destination as Niagara Falls, NY, on the original page image.  However, the 1909 arrival is before his first son's 1913 birth in Poland.:
New York, Passenger Lists, 1820-1957
Name:    Tomas Golba
Arrival Date:    25 Mar 1909
Nationality:    Russia
Race:  Polish
Last permanent residence:    stupileo??  (hard to read)
Age:    18
Gender:    Male
Port of Departure:    Antwerp, Belgium
Port of Arrival:    New York, New York
Ship Name:    Gothland
Another Social Security death claim, for the daughter:
Name:    Sophie Bertha Golba
[Sophie B Golda] 
SSN:    106164275
Gender:    Female
Race:    White
Birth Date:    11 Jan 1922
Birth Place:    Niagara Fall, New York
Father Name:    Thomas Golba
Mother Name:    Katherine Gromna
Death Date:    25 Dec 1995
Type of Claim:    Original SSN.
Type of Claim:    Death Claim