Lithuania has its national archives in Vilnius that include church records but you need to know the birthplace for them to find anything useful.
How were they listed in the 1900 Census because I couldn't find anything on them. If the were born in the 1880s and came over in their 20s, the math doesn't work for them to be showing up in the 1900 Census.
I found a Louis Rimkus with wife Barbara, children Sophie, Eva, and Christina, all living in Southampton (Suffolk) NY, in the 1920 Census.
The 1930 Census yields a Joseph Rimkus with wife Anna, and children Edward & Mary, all living in Queens NY.
Either of these two the right people?