OK, then I'm making a mistake (I'd rather that than find out I just can't get it done with FTM). In your example, did you use a custom report to get the person id? You must have. I'll try using the exact same fields you did and see if I can get the same results. My PID and Name CSV looked like this:
Name Joe Bloe
Name Mary Smith
Name John Doe
etc... Thanks for being patient and trying to help me. I will assume you are using FTM custom person report and will try that again.