The Willeys you mention in your message are also in my family tree. I am descended from George Willey and Sarah Webb through their son William who married Mary Buttle. My gg grandfather was Henry Willey, the brother of Joseph. Frederick and Alfred were their cousins. All came from Drayton, Somerset.
I have a lot of information on the Willey and Buttle families but it seems I don't have your line to the present.
I was just talking to my cousin, Bob Willey, who has found the Robert Willey you believe came to Australia. He is buried in the Drysdale Cemetery on the Bellarine Peninsula.
I hope to hear from you soon.
All the best