Birth records for South Africa are now becoming more available through indexing on Familysearch. I would explore the birth details in South Africa. Its hard, but look for family names (great grandparents) at the National Archives:
Also Familysearch indexes for the church he may have been baptised in. Even out of wedlock babies were usually baptised in the early 1900s in SA.