"Australia Death Index, 1787-1985" has two Joseph Henry Hardings. One says born in Prahran, Victoria and a matching birth record can be found, but here's the other one.
Name: Joseph Henry Harding
Death Place: Nhill, Victoria
Father's Name: Harry
Mother's Name: Angeline Churchman
Registration Year: 1959
Registration Place: Victoria
Registration number: 23720
Estimated Birth Year: abt 1882
The birth year is obviously rather different from what you've got. Do you have any information on your Joseph Henry Harding's parents' names?
There are also numerous Joseph Hardings with no middle name specified, I think you'd really need parents' names, again, to look at them with any confidence.