Apparently 'Lettish' was a generic term to cover Lithuanian, Latvian and (I think) Estonian. If your family consider themselves Lithuanian then that is what they were. When Russia took over all that area people fought hard to keep their own identity even though Russia would not them teach Lithuanian in schools.
Janice