You say he was born near Pontypridd? If very close the family
could be included in the Pontypridd census of 1901. This could save money on many birth certificates and would give all members of the family (including the father and mothers christian names, besides any older siblings.
Good luck, Derek.