First, where did you test, and is that a predicted or confirmed haplogroup? STR test results can usually predict a haplogroup, but only a SNP test can actually confirm it.
Second, while J2 is rare in Europe, it's not unheard of. According to Eupedia (http://www.eupedia.com/europe/european_y-dna_haplogroups.sht...
), it's found in 4.5% of Germans and 3.5% of English.
Third, the Y chromosome has no genes for hair or eye color. Y-DNA is mostly irrelevant to physical appearance (except, of course, the fact you're male and not female).
Fourth, even if you had a solid paper trail for your paternal ancestors back to the 1500s, how do you know the paper genealogy and biology match? The rule of thumb for NPEs is 2-5% per generation. Using the most generous value, and about 15 generations since the mid-16th century, there's a (1-0.02)^15 = 73.9% chance there wasn't a NPE.