Sherry,
I looked on-line to see if there were any free birth records or baptismal records from parishes regarding your ancestral names for Shelburne/Queens, Ragged Island. Only through the Nova Scotia Vital Records you'd have to pay or with the Historical Society. The society wants search fees.

Shelburne County Genealogical Society
168 Water Street, P.O. Box 248
Shelburne, Nova Scotia, B0T 1W0
telephone : (902) 875-4299
fax: (902) 875-3267

e-mail :gencentre@ns.sympatico.ca

WEBSITE: http://nsgna.ednet.ns.ca/shelburne/main/index.php

However, at their website there was a section called "Member's Search Interests" and the following person came up as doing research on surname "Belong" and looks to be a current member.
Here is her information:

BOWER, Mary J.
186 Lake Road, Box 847, Shelburne, NS, B0T 1W0, CA
E-Mail:
mary.bower "at" ns.sympatico.ca

She researches these surnames for that area -
Belong, Johnson, Sperry & Williams

I'm sorry I couldn't be more help but perhaps Mary Bower can find the middle name you need for Edward.
Kathleen